Jul 07 17:11:37 devstack cinder-volume[75971]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 07 17:11:37 devstack cinder-volume[75971]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 17:11:37 devstack cinder-volume[75971]: we strongly recommend against using it for new projects. Jul 07 17:11:37 devstack cinder-volume[75971]: If you are already using Eventlet, we recommend migrating to a different Jul 07 17:11:37 devstack cinder-volume[75971]: framework. For more detail see Jul 07 17:11:37 devstack cinder-volume[75971]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 17:11:37 devstack cinder-volume[75971]: import eventlet # noqa Jul 07 17:11:40 devstack cinder-volume[75971]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 17:11:40 devstack cinder-volume[75971]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 17:11:40 devstack cinder-volume[75971]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 17:11:41 devstack cinder-volume[75971]: INFO dbcounter [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] Registered counter for database cinder Jul 07 17:11:41 devstack cinder-volume[75971]: DEBUG oslo_db.sqlalchemy.engines [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75971) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:11:41 devstack cinder-volume[75971]: DEBUG dbcounter [-] [75971] Writer thread running {{(pid=75971) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 17:11:41 devstack cinder-volume[75971]: INFO cinder.rpc [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 07 17:11:41 devstack cinder-volume[75971]: INFO cinder.rpc [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 07 17:11:41 devstack cinder-volume[75971]: DEBUG oslo_db.sqlalchemy.engines [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75971) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:11:41 devstack cinder-volume[75971]: INFO cinder.volume.manager [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] Determined volume DB was empty at startup. Jul 07 17:11:41 devstack cinder-volume[75971]: DEBUG cinder.volume.manager [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75971) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 07 17:11:41 devstack cinder-volume[75971]: INFO cinder.volume.manager [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 07 17:11:41 devstack cinder-volume[75971]: WARNING stevedore.named [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 17:11:41 devstack cinder-volume[75971]: WARNING castellan.key_manager [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 17:11:41 devstack cinder-volume[75971]: WARNING cinder.keymgr.conf_key_mgr [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 17:11:41 devstack cinder-volume[75971]: DEBUG cinder.volume.drivers.lvm [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75971) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 07 17:11:41 devstack cinder-volume[75971]: DEBUG oslo_concurrency.processutils [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_concurrency.processutils [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] CMD "cinder-rtstool verify" returned: 0 in 0.563s {{(pid=75971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_db.sqlalchemy.engines [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75971) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:11:42 devstack cinder-volume[75971]: INFO cinder.rpc [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 07 17:11:42 devstack cinder-volume[75971]: INFO cinder.rpc [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 07 17:11:42 devstack cinder-volume[75971]: WARNING stevedore.named [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 17:11:42 devstack cinder-volume[75971]: WARNING castellan.key_manager [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 17:11:42 devstack cinder-volume[75971]: INFO cinder.volume.manager [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_db.sqlalchemy.engines [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75971) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:11:42 devstack cinder-volume[75971]: INFO oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] Starting 1 workers Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] Started child 76146 {{(pid=75971) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] Full set of CONF: {{(pid=75971) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] ******************************************************************************** {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] Configuration options gathered from: {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 07 17:11:42 devstack cinder-volume[76146]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] ================================================================================ {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] allow_availability_zone_fallback = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] allow_compression_on_image_upload = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] allowed_direct_url_schemes = [] {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] api_rate_limit = True {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] auth_strategy = keystone {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] az_cache_duration = 3600 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_availability_zone = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_host = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_name = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_stats_polling_interval = 60 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backup_api_class = cinder.backup.api.API {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backup_name_template = backup-%s {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backup_use_same_host = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backup_use_temp_snapshot = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] chap_password = **** {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] chap_username = {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] cinder_internal_tenant_project_id = 3e9dde6e02074d7c8ee91e8d05da273f {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] cinder_internal_tenant_user_id = fcee88d635fd46f487552730215c0aab {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] cloned_volume_same_az = True {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] cluster = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] compression_format = gzip {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] compute_api_class = cinder.compute.nova.API {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] config_dir = [] {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] config_source = [] {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] control_exchange = openstack {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] debug = True {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] default_availability_zone = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] default_group_type = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] default_volume_type = lvmdriver-1 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] disk_geometry = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] driver_client_cert = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] driver_client_cert_key = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] driver_data_namespace = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] driver_ssl_cert_path = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] driver_ssl_cert_verify = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] driver_use_ssl = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] enable_force_upload = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] enable_new_services = True {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] enable_unsupported_driver = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] enforce_multipath_for_image_xfer = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] filter_function = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] glance_api_insecure = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] glance_api_servers = ['http://192.168.122.20/image'] {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] glance_api_ssl_compression = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] glance_ca_certificates_file = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] glance_catalog_info = image:glance:publicURL {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] glance_certfile = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] glance_keyfile = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] glance_num_retries = 3 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] glance_request_timeout = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] goodness_function = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] graceful_shutdown_timeout = 5 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] group_api_class = cinder.group.api.API {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] host = devstack {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] image_compress_on_upload = True {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] image_conversion_address_space_limit = 1 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] image_conversion_cpu_limit = 60 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] image_conversion_disable = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] image_upload_use_cinder_backend = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] image_upload_use_internal_tenant = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] image_volume_cache_enabled = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] image_volume_cache_max_count = 0 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] image_volume_cache_max_size_gb = 0 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] init_host_max_objects_retrieval = 0 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] instance_format = [instance: %(uuid)s] {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] iscsi_target_flags = {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] iscsi_write_cache = on {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] iser_helper = tgtadm {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] iser_ip_address = 192.168.122.20 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] iser_port = 3260 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] log_color = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] log_config_append = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] log_dir = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] log_file = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] log_options = True {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] log_rotate_interval = 1 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] log_rotate_interval_type = days {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] log_rotation_type = none {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] max_age = 0 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] max_logfile_count = 30 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] max_logfile_size_mb = 200 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] max_over_subscription_ratio = 20.0 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] message_reap_interval = 86400 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] message_ttl = 2592000 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[76146]: INFO cinder.volume.manager [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] migration_create_volume_timeout_secs = 300 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] monkey_patch = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] monkey_patch_modules = [] {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] my_ip = 192.168.122.20 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] no_snapshot_gb_quota = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] num_iser_scan_tries = 3 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] num_shell_tries = 3 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] num_volume_device_scan_tries = 3 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] nvmeof_conn_info_version = 1 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] nvmet_ns_id = 10 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] nvmet_port_id = 1 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] osapi_max_limit = 1000 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] osapi_volume_ext_list = [] {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] osapi_volume_listen_port = 8776 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] osapi_volume_use_ssl = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] osapi_volume_workers = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] per_volume_size_limit = -1 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] periodic_fuzzy_delay = 60 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] periodic_interval = 60 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] public_endpoint = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] publish_errors = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] quota_backup_gigabytes = 1000 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] quota_backups = 10 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] quota_gigabytes = 1000 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] quota_groups = 10 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] quota_snapshots = 10 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] quota_volumes = 10 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] rate_limit_burst = 0 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] rate_limit_except_level = CRITICAL {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] rate_limit_interval = 0 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] reinit_driver_count = 3 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] replication_device = **** {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] report_discard_supported = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] report_interval = 120 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] reservation_clean_interval = 86400 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] reservation_expire = 86400 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] reserved_image_namespaces = [] {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] reserved_percentage = 0 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] rpc_response_timeout = 120 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] run_external_periodic_tasks = True {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] scst_target_driver = iscsi {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] scst_target_iqn_name = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] service_down_time = 720 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] shell_completion = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] snapshot_name_template = snapshot-%s {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] snapshot_same_host = True {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] split_loggers = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] state_path = /opt/stack/data/cinder {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] storage_availability_zone = nova {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] storage_protocol = iSCSI {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] syslog_log_facility = LOG_USER {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] target_helper = lioadm {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] target_ip_address = 192.168.122.20 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] target_port = 3260 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] target_protocol = iscsi {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] target_secondary_ip_addresses = [] {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] trace_flags = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] transport_url = **** {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] until_refresh = 0 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] use_chap_auth = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] use_default_quota_class = True {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] use_journal = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] use_json = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] use_multipath_for_image_xfer = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] use_stderr = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] use_syslog = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] verify_glance_signatures = enabled {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] volume_api_class = cinder.volume.api.API {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] volume_backend_name = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] volume_clear = zero {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] volume_clear_ionice = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] volume_clear_size = 0 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] volume_copy_bps_limit = 0 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] volume_dd_blocksize = 1M {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] volume_name_template = volume-%s {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] volume_service_inithost_offload = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] volume_usage_audit_period = month {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] zoning_mode = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_concurrency.disable_process_locking = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] keystone_authtoken.auth_section = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] keystone_authtoken.auth_type = password {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] keystone_authtoken.auth_version = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] keystone_authtoken.cache = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] keystone_authtoken.certfile = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] keystone_authtoken.include_service_catalog = True {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] keystone_authtoken.insecure = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] keystone_authtoken.interface = public {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] keystone_authtoken.keyfile = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] keystone_authtoken.memcache_password = {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] keystone_authtoken.memcache_username = {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] keystone_authtoken.region_name = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack sudo[76150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] keystone_authtoken.service_type = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.20/identity {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] cache.backend = dogpile.cache.null {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack sudo[76150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] cache.backend_argument = **** {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] cache.backend_expiration_time = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] cache.config_prefix = cache.oslo {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] cache.debug_cache_backend = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] cache.enable_retry_client = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] cache.enable_socket_keepalive = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] cache.enabled = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] cache.expiration_time = 600 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] cache.hashclient_retry_attempts = 2 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] cache.memcache_dead_retry = 300 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] cache.memcache_pool_maxsize = 10 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] cache.memcache_sasl_enabled = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] cache.password = **** {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] cache.proxies = [] {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] cache.redis_db = 0 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] cache.redis_server = localhost:6379 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] cache.retry_attempts = 2 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] cache.retry_delay = 0.0 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] cache.socket_keepalive_count = 1 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] cache.socket_keepalive_idle = 1 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] cache.socket_keepalive_interval = 1 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] cache.socket_timeout = 1.0 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] cache.tls_allowed_ciphers = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] cache.tls_cafile = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] cache.tls_certfile = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] cache.tls_enabled = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] cache.tls_keyfile = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] cache.username = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] coordination.backend_url = **** {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] database.asyncio_connection = **** {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] database.asyncio_slave_connection = **** {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] database.backend = sqlalchemy {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] database.connection = **** {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] database.connection_debug = 0 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] database.connection_parameters = {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] database.connection_recycle_time = 3600 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] database.connection_trace = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] database.db_inc_retry_interval = True {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] database.db_max_retries = 20 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] database.db_max_retry_interval = 10 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] database.db_retry_interval = 1 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] database.max_overflow = 50 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] database.max_pool_size = 5 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] database.max_retries = 10 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] database.mysql_wsrep_sync_wait = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] database.pool_timeout = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] database.retry_interval = 10 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] database.slave_connection = **** {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] database.sqlite_synchronous = True {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] database.synchronous_reader = True {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] database.use_db_reconnect = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] profiler.connection_string = messaging:// {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] profiler.enabled = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] profiler.es_doc_type = notification {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] profiler.es_scroll_size = 10000 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] profiler.es_scroll_time = 2m {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] profiler.filter_error_trace = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] profiler.hmac_keys = **** {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] profiler.sentinel_service_name = mymaster {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] profiler.socket_timeout = 0.1 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] profiler.trace_requests = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] profiler.trace_sqlalchemy = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] profiler_jaeger.process_tags = {} {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] profiler_jaeger.service_name_prefix = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] profiler_otlp.service_name_prefix = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_policy.enforce_new_defaults = True {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_policy.enforce_scope = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_policy.policy_default_rule = default {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_policy.policy_file = policy.yaml {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] privsep_osbrick.group = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] privsep_osbrick.helper_command = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] privsep_osbrick.user = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] cinder_sys_admin.group = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] cinder_sys_admin.helper_command = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] cinder_sys_admin.user = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] service_user.auth_section = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] service_user.auth_type = password {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] service_user.cafile = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] service_user.certfile = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] service_user.collect_timing = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] service_user.insecure = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] service_user.keyfile = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] service_user.send_service_user_token = True {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] service_user.split_loggers = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] service_user.timeout = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] glance.auth_section = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] glance.auth_type = password {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] glance.certfile = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] glance.collect_timing = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] glance.insecure = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] glance.keyfile = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] glance.region_name = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] glance.split_loggers = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] glance.timeout = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.backend_availability_zone = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.chap_password = **** {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.chap_username = {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.disk_geometry = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.driver_client_cert = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.driver_client_cert_key = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.driver_data_namespace = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.driver_use_ssl = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.extra_capabilities = {} {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.filter_function = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.goodness_function = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.iscsi_target_flags = {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.iscsi_write_cache = on {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.iser_helper = tgtadm {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.iser_ip_address = 192.168.122.20 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.iser_port = 3260 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.lvm_share_target = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.lvm_type = auto {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.num_shell_tries = 3 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.replication_device = **** {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.report_discard_supported = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.reserved_percentage = 0 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.target_helper = tgtadm {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.target_ip_address = 192.168.122.20 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.target_port = 3260 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.target_protocol = iscsi {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.trace_flags = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.unique_fqdn_network = True {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.use_chap_auth = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.volume_backend_name = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.volume_clear = zero {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.volume_clear_ionice = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.volume_clear_size = 0 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_reports.file_event_handler = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_reports.log_dir = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.backend_host = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.chap_password = **** {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.chap_username = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.disk_geometry = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.driver_client_cert = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.extra_capabilities = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.filter_function = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.goodness_function = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.iser_helper = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.iser_ip_address = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.iser_port = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.lvm_share_target = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.lvm_type = auto {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.num_shell_tries = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.replication_device = **** {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.report_discard_supported = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.reserved_percentage = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.scst_target_driver = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.storage_protocol = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.target_helper = lioadm {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.target_ip_address = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.target_port = 3260 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.trace_flags = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.use_chap_auth = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.volume_clear = zero {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.volume_clear_size = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] lvmdriver-1.volumes_dir = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_messaging_rabbit.ssl = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_messaging_notifications.driver = [] {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_messaging_notifications.retry = -1 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] key_manager.fixed_key = **** {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] barbican.barbican_api_version = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] barbican.barbican_endpoint = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] barbican.barbican_endpoint_type = public {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] barbican.barbican_region_name = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] barbican.cafile = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] barbican.certfile = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] barbican.collect_timing = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] barbican.insecure = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] barbican.keyfile = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] barbican.number_of_retries = 60 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] barbican.retry_delay = 1 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] barbican.send_service_user_token = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] barbican.split_loggers = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] barbican.timeout = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] barbican.verify_ssl = True {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] barbican.verify_ssl_path = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] barbican_service_user.auth_section = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] barbican_service_user.auth_type = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] barbican_service_user.cafile = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] barbican_service_user.certfile = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] barbican_service_user.collect_timing = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] barbican_service_user.insecure = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] barbican_service_user.keyfile = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] barbican_service_user.split_loggers = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] barbican_service_user.timeout = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] vault.approle_role_id = **** {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] vault.approle_secret_id = **** {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] vault.kv_mountpoint = secret {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] vault.kv_path = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] vault.kv_version = 2 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] vault.namespace = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] vault.root_token_id = **** {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] vault.ssl_ca_crt_file = None {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] vault.timeout = 60.0 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] vault.use_ssl = False {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:11:42 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] ******************************************************************************** {{(pid=75971) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 07 17:11:43 devstack sudo[76150]: pam_unix(sudo:session): session closed for user root Jul 07 17:11:43 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.652s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:43 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:43 devstack sudo[76251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:11:43 devstack sudo[76251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:11:43 devstack sudo[76251]: pam_unix(sudo:session): session closed for user root Jul 07 17:11:43 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.704s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:43 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:11:43 devstack cinder-volume[76146]: INFO cinder.brick.local_dev.lvm [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 07 17:11:43 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:43 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:43 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:43 devstack sudo[76500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 17:11:43 devstack sudo[76500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:11:44 devstack sudo[76500]: pam_unix(sudo:session): session closed for user root Jul 07 17:11:44 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.731s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:44 devstack cinder-volume[76146]: DEBUG cinder.brick.local_dev.lvm [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76146) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 07 17:11:44 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:44 devstack sudo[76716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:11:44 devstack sudo[76716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:11:45 devstack sudo[76716]: pam_unix(sudo:session): session closed for user root Jul 07 17:11:45 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.187s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:45 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:45 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.050s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:45 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:45 devstack sudo[76917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:11:45 devstack sudo[76917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:11:46 devstack sudo[76917]: pam_unix(sudo:session): session closed for user root Jul 07 17:11:46 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.732s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:46 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:46 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:46 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:46 devstack sudo[76930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 07 17:11:46 devstack sudo[76930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:11:47 devstack sudo[76930]: pam_unix(sudo:session): session closed for user root Jul 07 17:11:47 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.800s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:47 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:47 devstack sudo[76935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 17:11:47 devstack sudo[76935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:11:48 devstack sudo[76935]: pam_unix(sudo:session): session closed for user root Jul 07 17:11:48 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.898s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:48 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:48 devstack sudo[76946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 17:11:48 devstack sudo[76946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:11:49 devstack sudo[76946]: pam_unix(sudo:session): session closed for user root Jul 07 17:11:49 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.823s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:49 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:49 devstack sudo[76953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:11:49 devstack sudo[76953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:11:49 devstack sudo[76953]: pam_unix(sudo:session): session closed for user root Jul 07 17:11:49 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.741s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:49 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:50 devstack sudo[76957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:11:50 devstack sudo[76957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:11:50 devstack sudo[76957]: pam_unix(sudo:session): session closed for user root Jul 07 17:11:50 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.682s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:50 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:50 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:50 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:50 devstack sudo[76965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:11:50 devstack sudo[76965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:11:51 devstack sudo[76965]: pam_unix(sudo:session): session closed for user root Jul 07 17:11:51 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.684s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:51 devstack cinder-volume[76146]: INFO cinder.volume.drivers.lvm [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 07 17:11:51 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:51 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:51 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:51 devstack sudo[76975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:11:51 devstack sudo[76975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:11:52 devstack sudo[76975]: pam_unix(sudo:session): session closed for user root Jul 07 17:11:52 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.784s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:52 devstack cinder-volume[76146]: DEBUG cinder.volume.drivers.lvm [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Updating volume stats {{(pid=76146) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 17:11:52 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:52 devstack sudo[77091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 17:11:52 devstack sudo[77091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:11:52 devstack cinder-volume[75971]: DEBUG dbcounter [-] [75971] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75971) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:11:52 devstack sudo[77091]: pam_unix(sudo:session): session closed for user root Jul 07 17:11:52 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.675s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:52 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:52 devstack sudo[77233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:11:52 devstack sudo[77233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:11:53 devstack sudo[77233]: pam_unix(sudo:session): session closed for user root Jul 07 17:11:53 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.614s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:53 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:53 devstack sudo[77236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:11:53 devstack sudo[77236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:11:54 devstack sudo[77236]: pam_unix(sudo:session): session closed for user root Jul 07 17:11:54 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.638s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:54 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:54 devstack sudo[77239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:11:54 devstack sudo[77239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:11:54 devstack sudo[77239]: pam_unix(sudo:session): session closed for user root Jul 07 17:11:54 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.655s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:54 devstack cinder-volume[76146]: INFO cinder.volume.driver [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Driver hasn't implemented _init_vendor_properties() Jul 07 17:11:54 devstack cinder-volume[76146]: DEBUG cinder.volume.driver [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76146) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 07 17:11:54 devstack cinder-volume[76146]: DEBUG oslo_db.sqlalchemy.engines [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76146) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:11:54 devstack cinder-volume[76146]: DEBUG dbcounter [-] [76146] Writer thread running {{(pid=76146) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 17:11:54 devstack cinder-volume[76146]: DEBUG cinder.db.api [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Building query based on filter {{(pid=76146) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 07 17:11:54 devstack cinder-volume[76146]: DEBUG cinder.image.image_utils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76146) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 07 17:11:54 devstack cinder-volume[76146]: INFO cinder.keymgr.migration [None req-0dbe920b-1e78-43ec-8331-34fcb7333455 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 07 17:11:54 devstack cinder-volume[76146]: DEBUG cinder.volume.drivers.lvm [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Updating volume stats {{(pid=76146) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 17:11:54 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:54 devstack sudo[77244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 17:11:54 devstack sudo[77244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:11:55 devstack sudo[77244]: pam_unix(sudo:session): session closed for user root Jul 07 17:11:55 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:55 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:55 devstack sudo[77251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:11:55 devstack sudo[77251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:11:56 devstack sudo[77251]: pam_unix(sudo:session): session closed for user root Jul 07 17:11:56 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.696s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:56 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:56 devstack sudo[77254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:11:56 devstack sudo[77254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:11:56 devstack sudo[77254]: pam_unix(sudo:session): session closed for user root Jul 07 17:11:56 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.730s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:57 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:57 devstack sudo[77294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:11:57 devstack sudo[77294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:11:57 devstack sudo[77294]: pam_unix(sudo:session): session closed for user root Jul 07 17:11:57 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.706s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:57 devstack cinder-volume[76146]: DEBUG cinder.manager [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Notifying Schedulers of capabilities ... {{(pid=76146) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:11:57 devstack cinder-volume[76146]: INFO cinder.volume.manager [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Driver initialization completed successfully. Jul 07 17:11:57 devstack cinder-volume[76146]: INFO cinder.manager [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Initiating service 2 cleanup Jul 07 17:11:57 devstack cinder-volume[76146]: INFO cinder.manager [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Service 2 cleanup completed. Jul 07 17:11:57 devstack cinder-volume[76146]: DEBUG cinder.service [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Creating RPC server for service cinder-volume {{(pid=76146) start /opt/stack/cinder/cinder/service.py:231}} Jul 07 17:11:57 devstack cinder-volume[76146]: DEBUG cinder.service [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76146) start /opt/stack/cinder/cinder/service.py:237}} Jul 07 17:11:57 devstack cinder-volume[76146]: INFO cinder.volume.manager [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 07 17:11:57 devstack cinder-volume[76146]: DEBUG cinder.volume.drivers.lvm [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Updating volume stats {{(pid=76146) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 17:11:57 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:57 devstack sudo[77298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 17:11:57 devstack sudo[77298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:11:58 devstack sudo[77298]: pam_unix(sudo:session): session closed for user root Jul 07 17:11:58 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.739s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:58 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:58 devstack sudo[77301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:11:58 devstack sudo[77301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:11:59 devstack sudo[77301]: pam_unix(sudo:session): session closed for user root Jul 07 17:11:59 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.731s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:59 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:59 devstack sudo[77336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:11:59 devstack sudo[77336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:12:00 devstack sudo[77336]: pam_unix(sudo:session): session closed for user root Jul 07 17:12:00 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.700s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:12:00 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:12:00 devstack sudo[77365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:12:00 devstack sudo[77365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:12:00 devstack sudo[77365]: pam_unix(sudo:session): session closed for user root Jul 07 17:12:00 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.655s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:12:00 devstack cinder-volume[76146]: INFO cinder.volume.manager [None req-3e83436b-4521-4ec6-ad96-542ca55dbc25 None None] Driver post RPC initialization completed successfully. Jul 07 17:12:07 devstack cinder-volume[76146]: DEBUG dbcounter [-] [76146] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76146) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:12:10 devstack cinder-volume[76146]: DEBUG dbcounter [-] [76146] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76146) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:12:12 devstack cinder-volume[76146]: DEBUG oslo_service.periodic_task [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] Running periodic task VolumeManager._thread_info {{(pid=76146) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:12:12 devstack cinder-volume[76146]: DEBUG cinder.volume.manager [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] thread count: 6 {{(pid=76146) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:12:12 devstack cinder-volume[76146]: DEBUG cinder.volume.manager [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] thread info: [<_MainThread(MainThread, started 123313593204864)>, , , , , ] {{(pid=76146) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:13:12 devstack cinder-volume[76146]: DEBUG oslo_service.periodic_task [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76146) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:13:12 devstack cinder-volume[76146]: DEBUG cinder.volume.drivers.lvm [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] Updating volume stats {{(pid=76146) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 17:13:12 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:13:12 devstack sudo[79642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 17:13:12 devstack sudo[79642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:13:13 devstack sudo[79642]: pam_unix(sudo:session): session closed for user root Jul 07 17:13:13 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.611s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:13:13 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:13:13 devstack sudo[79645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:13:13 devstack sudo[79645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:13:13 devstack sudo[79645]: pam_unix(sudo:session): session closed for user root Jul 07 17:13:13 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.627s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:13:13 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:13:14 devstack sudo[79648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:13:14 devstack sudo[79648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:13:14 devstack sudo[79648]: pam_unix(sudo:session): session closed for user root Jul 07 17:13:14 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.603s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:13:14 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:13:14 devstack sudo[79651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:13:14 devstack sudo[79651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:13:15 devstack sudo[79651]: pam_unix(sudo:session): session closed for user root Jul 07 17:13:15 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.611s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:13:15 devstack cinder-volume[76146]: DEBUG cinder.manager [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] Notifying Schedulers of capabilities ... {{(pid=76146) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:13:15 devstack cinder-volume[76146]: DEBUG oslo_service.periodic_task [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] Running periodic task VolumeManager._thread_info {{(pid=76146) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:13:15 devstack cinder-volume[76146]: DEBUG cinder.volume.manager [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] thread count: 6 {{(pid=76146) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:13:15 devstack cinder-volume[76146]: DEBUG cinder.volume.manager [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] thread info: [<_MainThread(MainThread, started 123313593204864)>, , , , , ] {{(pid=76146) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:14:10 devstack cinder-volume[76146]: DEBUG dbcounter [-] [76146] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76146) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:14:12 devstack cinder-volume[76146]: DEBUG oslo_service.periodic_task [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76146) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:14:12 devstack cinder-volume[76146]: DEBUG cinder.volume.drivers.lvm [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] Updating volume stats {{(pid=76146) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 17:14:12 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:14:12 devstack sudo[82643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 17:14:12 devstack sudo[82643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:14:13 devstack sudo[82643]: pam_unix(sudo:session): session closed for user root Jul 07 17:14:13 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.620s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:14:13 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:14:13 devstack sudo[82660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:14:13 devstack sudo[82660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:14:14 devstack sudo[82660]: pam_unix(sudo:session): session closed for user root Jul 07 17:14:14 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.631s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:14:14 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:14:14 devstack sudo[82664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:14:14 devstack sudo[82664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:14:14 devstack sudo[82664]: pam_unix(sudo:session): session closed for user root Jul 07 17:14:14 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.624s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:14:14 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:14:14 devstack sudo[82673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:14:14 devstack sudo[82673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:14:15 devstack sudo[82673]: pam_unix(sudo:session): session closed for user root Jul 07 17:14:15 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.646s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:14:15 devstack cinder-volume[76146]: DEBUG cinder.manager [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] Notifying Schedulers of capabilities ... {{(pid=76146) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:14:15 devstack cinder-volume[76146]: DEBUG oslo_service.periodic_task [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] Running periodic task VolumeManager._thread_info {{(pid=76146) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:14:15 devstack cinder-volume[76146]: DEBUG cinder.volume.manager [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] thread count: 6 {{(pid=76146) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:14:15 devstack cinder-volume[76146]: DEBUG cinder.volume.manager [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] thread info: [<_MainThread(MainThread, started 123313593204864)>, , , , , ] {{(pid=76146) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:15:12 devstack cinder-volume[76146]: DEBUG oslo_service.periodic_task [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76146) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:15:12 devstack cinder-volume[76146]: DEBUG cinder.volume.drivers.lvm [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] Updating volume stats {{(pid=76146) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 17:15:12 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:15:12 devstack sudo[84801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 17:15:12 devstack sudo[84801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:15:13 devstack sudo[84801]: pam_unix(sudo:session): session closed for user root Jul 07 17:15:13 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.649s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:15:13 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:15:13 devstack sudo[84829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:15:13 devstack sudo[84829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:15:14 devstack sudo[84829]: pam_unix(sudo:session): session closed for user root Jul 07 17:15:14 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.637s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:15:14 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:15:14 devstack sudo[84851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:15:14 devstack sudo[84851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:15:14 devstack sudo[84851]: pam_unix(sudo:session): session closed for user root Jul 07 17:15:14 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.652s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:15:14 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:15:14 devstack sudo[84864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:15:14 devstack sudo[84864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:15:15 devstack sudo[84864]: pam_unix(sudo:session): session closed for user root Jul 07 17:15:15 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:15:15 devstack cinder-volume[76146]: DEBUG cinder.manager [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] Notifying Schedulers of capabilities ... {{(pid=76146) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:15:15 devstack cinder-volume[76146]: DEBUG oslo_service.periodic_task [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] Running periodic task VolumeManager._thread_info {{(pid=76146) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:15:15 devstack cinder-volume[76146]: DEBUG cinder.volume.manager [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] thread count: 6 {{(pid=76146) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:15:15 devstack cinder-volume[76146]: DEBUG cinder.volume.manager [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] thread info: [<_MainThread(MainThread, started 123313593204864)>, , , , , ] {{(pid=76146) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:16:10 devstack cinder-volume[76146]: DEBUG dbcounter [-] [76146] Writing DB stats cinder:SELECT=1 {{(pid=76146) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:16:10 devstack cinder-volume[76146]: DEBUG dbcounter [-] [76146] Writing DB stats cinder:UPDATE=1 {{(pid=76146) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:16:12 devstack cinder-volume[76146]: DEBUG oslo_service.periodic_task [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76146) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:16:12 devstack cinder-volume[76146]: DEBUG cinder.volume.drivers.lvm [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] Updating volume stats {{(pid=76146) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 17:16:12 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:16:12 devstack sudo[86047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 17:16:12 devstack sudo[86047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:16:13 devstack sudo[86047]: pam_unix(sudo:session): session closed for user root Jul 07 17:16:13 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.628s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:16:13 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:16:13 devstack sudo[86062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:16:13 devstack sudo[86062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:16:14 devstack sudo[86062]: pam_unix(sudo:session): session closed for user root Jul 07 17:16:14 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.651s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:16:14 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:16:14 devstack sudo[86089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:16:14 devstack sudo[86089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:16:14 devstack sudo[86089]: pam_unix(sudo:session): session closed for user root Jul 07 17:16:14 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.614s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:16:14 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:16:14 devstack sudo[86115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:16:14 devstack sudo[86115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:16:15 devstack sudo[86115]: pam_unix(sudo:session): session closed for user root Jul 07 17:16:15 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.648s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:16:15 devstack cinder-volume[76146]: DEBUG cinder.manager [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] Notifying Schedulers of capabilities ... {{(pid=76146) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:16:15 devstack cinder-volume[76146]: DEBUG oslo_service.periodic_task [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] Running periodic task VolumeManager._thread_info {{(pid=76146) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:16:15 devstack cinder-volume[76146]: DEBUG cinder.volume.manager [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] thread count: 6 {{(pid=76146) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:16:15 devstack cinder-volume[76146]: DEBUG cinder.volume.manager [None req-b9b5f5e6-6fc2-45a4-969d-133801a99ae8 None None] thread info: [<_MainThread(MainThread, started 123313593204864)>, , , , , ] {{(pid=76146) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:16:17 devstack cinder-volume[75971]: INFO oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] Caught SIGTERM, stopping children Jul 07 17:16:17 devstack cinder-volume[75971]: DEBUG oslo_concurrency.lockutils [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] Acquiring lock "singleton_lock" {{(pid=75971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 17:16:17 devstack cinder-volume[75971]: DEBUG oslo_concurrency.lockutils [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] Acquired lock "singleton_lock" {{(pid=75971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 17:16:17 devstack cinder-volume[75971]: DEBUG oslo_concurrency.lockutils [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] Releasing lock "singleton_lock" {{(pid=75971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 17:16:17 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] Stop services. {{(pid=75971) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 07 17:16:17 devstack cinder-volume[75971]: DEBUG oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] Killing children. {{(pid=75971) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 07 17:16:17 devstack cinder-volume[75971]: INFO oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] Waiting on 1 children to exit Jul 07 17:16:17 devstack cinder-volume[76146]: DEBUG oslo_concurrency.lockutils [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] Acquiring lock "singleton_lock" {{(pid=76146) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 17:16:17 devstack cinder-volume[76146]: DEBUG oslo_concurrency.lockutils [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] Acquired lock "singleton_lock" {{(pid=76146) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 17:16:17 devstack cinder-volume[76146]: DEBUG oslo_concurrency.lockutils [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] Releasing lock "singleton_lock" {{(pid=76146) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 17:16:17 devstack cinder-volume[76146]: WARNING amqp [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 17:16:17 devstack cinder-volume[76146]: WARNING amqp [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 17:16:17 devstack cinder-volume[75971]: INFO oslo_service.backend._eventlet.service [None req-e303d3ed-ec7f-4307-9382-db02705a0369 None None] Child 76146 exited with status 0 Jul 07 17:16:18 devstack cinder-volume[86270]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 07 17:16:18 devstack cinder-volume[86270]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 17:16:18 devstack cinder-volume[86270]: we strongly recommend against using it for new projects. Jul 07 17:16:18 devstack cinder-volume[86270]: If you are already using Eventlet, we recommend migrating to a different Jul 07 17:16:18 devstack cinder-volume[86270]: framework. For more detail see Jul 07 17:16:18 devstack cinder-volume[86270]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 17:16:18 devstack cinder-volume[86270]: import eventlet # noqa Jul 07 17:16:20 devstack cinder-volume[86270]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86270) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 17:16:20 devstack cinder-volume[86270]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86270) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 17:16:20 devstack cinder-volume[86270]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86270) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 17:16:20 devstack cinder-volume[86270]: INFO dbcounter [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] Registered counter for database cinder Jul 07 17:16:20 devstack cinder-volume[86270]: DEBUG oslo_db.sqlalchemy.engines [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86270) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG dbcounter [-] [86270] Writer thread running {{(pid=86270) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 17:16:21 devstack cinder-volume[86270]: INFO cinder.rpc [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 07 17:16:21 devstack cinder-volume[86270]: INFO cinder.rpc [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_db.sqlalchemy.engines [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86270) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:16:21 devstack cinder-volume[86270]: INFO cinder.volume.manager [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] Determined volume DB was empty at startup. Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG cinder.volume.manager [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86270) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 07 17:16:21 devstack cinder-volume[86270]: INFO cinder.volume.manager [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 07 17:16:21 devstack cinder-volume[86270]: WARNING stevedore.named [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 17:16:21 devstack cinder-volume[86270]: WARNING castellan.key_manager [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 17:16:21 devstack cinder-volume[86270]: WARNING cinder.keymgr.conf_key_mgr [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 17:16:21 devstack cinder-volume[86270]: INFO cinder.volume.manager [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_db.sqlalchemy.engines [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86270) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:16:21 devstack cinder-volume[86270]: INFO oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] Starting 1 workers Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] Started child 86491 {{(pid=86270) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] Full set of CONF: {{(pid=86270) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] ******************************************************************************** {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] Configuration options gathered from: {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 07 17:16:21 devstack cinder-volume[86491]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] ================================================================================ {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] allow_availability_zone_fallback = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] allow_compression_on_image_upload = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] allowed_direct_url_schemes = [] {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] api_rate_limit = True {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] auth_strategy = keystone {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_availability_zone = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_host = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_name = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_stats_polling_interval = 60 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backup_api_class = cinder.backup.api.API {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backup_name_template = backup-%s {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backup_use_same_host = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backup_use_temp_snapshot = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] chap_password = **** {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] chap_username = {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] cinder_internal_tenant_project_id = 3e9dde6e02074d7c8ee91e8d05da273f {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] cinder_internal_tenant_user_id = fcee88d635fd46f487552730215c0aab {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] cluster = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] compression_format = gzip {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] compute_api_class = cinder.compute.nova.API {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] config_dir = [] {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] config_source = [] {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] control_exchange = openstack {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] debug = True {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] default_availability_zone = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] default_group_type = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] default_volume_type = QuobyteHD {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] disk_geometry = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] driver_client_cert = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] driver_client_cert_key = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] driver_data_namespace = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] driver_ssl_cert_path = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] driver_ssl_cert_verify = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] driver_use_ssl = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] enable_new_services = True {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] enable_unsupported_driver = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] enabled_backends = ['QuobyteHD'] {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] enforce_multipath_for_image_xfer = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] filter_function = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] glance_api_insecure = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] glance_api_servers = ['http://192.168.122.20/image'] {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] glance_api_ssl_compression = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] glance_ca_certificates_file = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] glance_catalog_info = image:glance:publicURL {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] glance_certfile = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] glance_keyfile = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] glance_num_retries = 3 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] glance_request_timeout = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] goodness_function = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] graceful_shutdown_timeout = 5 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] group_api_class = cinder.group.api.API {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] host = devstack {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] image_compress_on_upload = True {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] image_conversion_address_space_limit = 1 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] image_conversion_cpu_limit = 60 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] image_conversion_disable = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] image_upload_use_cinder_backend = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] image_upload_use_internal_tenant = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] image_volume_cache_enabled = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] image_volume_cache_max_count = 0 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] image_volume_cache_max_size_gb = 0 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] init_host_max_objects_retrieval = 0 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] instance_format = [instance: %(uuid)s] {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] iscsi_target_flags = {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] iscsi_write_cache = on {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] iser_helper = tgtadm {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] iser_ip_address = 192.168.122.20 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] iser_port = 3260 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86491]: INFO cinder.volume.manager [None req-322880db-fcae-4bc3-b8e5-0ea5275080bf None None] Starting volume driver QuobyteDriver (1.1.14) Jul 07 17:16:21 devstack cinder-volume[86491]: DEBUG cinder.volume.drivers.remotefs [None req-322880db-fcae-4bc3-b8e5-0ea5275080bf None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86491) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] log_color = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] log_config_append = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] log_dir = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] log_file = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] log_options = True {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] log_rotate_interval = 1 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] log_rotate_interval_type = days {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] log_rotation_type = none {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] max_age = 0 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] max_logfile_count = 30 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] max_logfile_size_mb = 200 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] max_over_subscription_ratio = 20.0 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] message_reap_interval = 86400 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] message_ttl = 2592000 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] migration_create_volume_timeout_secs = 300 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] monkey_patch = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] monkey_patch_modules = [] {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] my_ip = 192.168.122.20 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] no_snapshot_gb_quota = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] num_iser_scan_tries = 3 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] num_shell_tries = 3 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] num_volume_device_scan_tries = 3 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] nvmeof_conn_info_version = 1 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] nvmet_ns_id = 10 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] nvmet_port_id = 1 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] osapi_max_limit = 1000 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] osapi_volume_ext_list = [] {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] osapi_volume_listen = 0.0.0.0 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] osapi_volume_listen_port = 8776 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] osapi_volume_use_ssl = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] osapi_volume_workers = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] per_volume_size_limit = -1 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] periodic_fuzzy_delay = 60 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] periodic_interval = 60 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] project_id_regex = [0-9a-f\-]+ {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] public_endpoint = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] publish_errors = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] quota_backup_gigabytes = 1000 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] quota_backups = 10 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] quota_gigabytes = 1000 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] quota_groups = 10 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] quota_snapshots = 10 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] quota_volumes = 10 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] rate_limit_burst = 0 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] rate_limit_except_level = CRITICAL {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] rate_limit_interval = 0 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] reinit_driver_count = 3 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] replication_device = **** {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] report_discard_supported = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] report_interval = 120 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] reservation_clean_interval = 86400 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] reservation_expire = 86400 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] reserved_image_namespaces = [] {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] reserved_percentage = 0 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] rpc_response_timeout = 120 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] run_external_periodic_tasks = True {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] scst_target_driver = iscsi {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] scst_target_iqn_name = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] service_down_time = 720 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] shell_completion = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] snapshot_name_template = snapshot-%s {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] split_loggers = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] state_path = /opt/stack/data/cinder {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] storage_availability_zone = nova {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] storage_protocol = iSCSI {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] syslog_log_facility = LOG_USER {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] target_helper = lioadm {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] target_ip_address = 192.168.122.20 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] target_port = 3260 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] target_protocol = iscsi {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] target_secondary_ip_addresses = [] {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] trace_flags = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] transfer_api_class = cinder.transfer.api.API {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] transport_url = **** {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] until_refresh = 0 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] use_chap_auth = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] use_default_quota_class = True {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] use_journal = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] use_json = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] use_multipath_for_image_xfer = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] use_stderr = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] use_syslog = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] verify_glance_signatures = enabled {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] volume_api_class = cinder.volume.api.API {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] volume_backend_name = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] volume_clear = zero {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] volume_clear_ionice = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] volume_clear_size = 0 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] volume_copy_bps_limit = 0 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] volume_dd_blocksize = 1M {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] volume_name_template = volume-%s {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] volume_service_inithost_offload = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] volume_usage_audit_period = month {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] zoning_mode = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_concurrency.disable_process_locking = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] keystone_authtoken.auth_section = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] keystone_authtoken.auth_type = password {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] keystone_authtoken.auth_version = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] keystone_authtoken.cache = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] keystone_authtoken.certfile = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] keystone_authtoken.delay_auth_decision = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] keystone_authtoken.http_connect_timeout = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] keystone_authtoken.include_service_catalog = True {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] keystone_authtoken.insecure = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] keystone_authtoken.interface = public {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] keystone_authtoken.keyfile = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] keystone_authtoken.memcache_password = {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86491]: DEBUG cinder.volume.drivers.quobyte [None req-322880db-fcae-4bc3-b8e5-0ea5275080bf None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86491) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 07 17:16:21 devstack cinder-volume[86491]: WARNING cinder.volume.drivers.quobyte [None req-322880db-fcae-4bc3-b8e5-0ea5275080bf None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 07 17:16:21 devstack cinder-volume[86491]: WARNING cinder.volume.drivers.quobyte [None req-322880db-fcae-4bc3-b8e5-0ea5275080bf None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] keystone_authtoken.memcache_username = {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] keystone_authtoken.region_name = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] keystone_authtoken.service_token_roles_required = True {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] keystone_authtoken.service_type = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] keystone_authtoken.token_cache_time = 300 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.20/identity {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86491]: DEBUG oslo_concurrency.processutils [None req-322880db-fcae-4bc3-b8e5-0ea5275080bf None None] Running cmd (subprocess): mount.quobyte {{(pid=86491) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] cache.backend = dogpile.cache.null {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] cache.backend_argument = **** {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] cache.backend_expiration_time = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] cache.config_prefix = cache.oslo {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] cache.debug_cache_backend = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] cache.enable_retry_client = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] cache.enable_socket_keepalive = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] cache.enabled = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] cache.expiration_time = 600 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] cache.hashclient_retry_attempts = 2 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] cache.memcache_dead_retry = 300 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] cache.memcache_pool_maxsize = 10 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] cache.memcache_sasl_enabled = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] cache.password = **** {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] cache.proxies = [] {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] cache.redis_db = 0 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] cache.redis_sentinel_service_name = mymaster {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] cache.redis_server = localhost:6379 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] cache.retry_attempts = 2 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] cache.retry_delay = 0.0 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] cache.socket_keepalive_count = 1 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] cache.socket_keepalive_idle = 1 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] cache.socket_keepalive_interval = 1 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] cache.socket_timeout = 1.0 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] cache.tls_allowed_ciphers = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] cache.tls_cafile = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] cache.tls_certfile = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] cache.tls_enabled = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] cache.tls_keyfile = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] cache.username = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] coordination.backend_url = **** {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] database.asyncio_connection = **** {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] database.asyncio_slave_connection = **** {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] database.backend = sqlalchemy {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] database.connection = **** {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] database.connection_debug = 0 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] database.connection_parameters = {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] database.connection_recycle_time = 3600 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] database.connection_trace = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] database.db_inc_retry_interval = True {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] database.db_max_retries = 20 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] database.db_max_retry_interval = 10 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] database.db_retry_interval = 1 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] database.max_overflow = 50 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] database.max_pool_size = 5 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] database.max_retries = 10 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] database.mysql_wsrep_sync_wait = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] database.pool_timeout = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] database.retry_interval = 10 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] database.slave_connection = **** {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] database.sqlite_synchronous = True {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] database.synchronous_reader = True {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] database.use_db_reconnect = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] profiler.connection_string = messaging:// {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] profiler.enabled = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] profiler.es_doc_type = notification {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] profiler.es_scroll_size = 10000 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] profiler.es_scroll_time = 2m {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] profiler.filter_error_trace = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] profiler.hmac_keys = **** {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] profiler.sentinel_service_name = mymaster {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] profiler.socket_timeout = 0.1 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] profiler.trace_requests = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] profiler.trace_sqlalchemy = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] profiler_jaeger.process_tags = {} {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] profiler_jaeger.service_name_prefix = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] profiler_otlp.service_name_prefix = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_policy.enforce_new_defaults = True {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_policy.enforce_scope = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_policy.policy_default_rule = default {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_policy.policy_file = policy.yaml {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_policy.remote_timeout = 60.0 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] privsep_osbrick.group = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] privsep_osbrick.helper_command = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] privsep_osbrick.user = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] cinder_sys_admin.group = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] cinder_sys_admin.helper_command = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] cinder_sys_admin.user = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] service_user.auth_section = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] service_user.auth_type = password {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] service_user.cafile = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] service_user.certfile = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] service_user.collect_timing = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] service_user.insecure = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] service_user.keyfile = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] service_user.send_service_user_token = True {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] service_user.split_loggers = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] service_user.timeout = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] glance.auth_section = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] glance.auth_type = password {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] glance.certfile = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] glance.collect_timing = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] glance.insecure = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] glance.keyfile = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] glance.region_name = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] glance.split_loggers = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] glance.timeout = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.backend_availability_zone = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.chap_password = **** {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.chap_username = {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.disk_geometry = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.driver_client_cert = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.driver_client_cert_key = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.driver_data_namespace = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.driver_use_ssl = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.enable_unsupported_driver = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.extra_capabilities = {} {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.filter_function = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.goodness_function = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.iscsi_target_flags = {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.iscsi_write_cache = on {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.iser_helper = tgtadm {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.iser_ip_address = 192.168.122.20 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.iser_port = 3260 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.nas_host = {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.nas_login = admin {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.nas_mount_options = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.nas_password = **** {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.nas_private_key = {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack quobyte-client[86492]: Reading configuration file: /etc/quobyte/client.cfg Jul 07 17:16:21 devstack quobyte-client[86492]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.nas_share_path = {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.nas_ssh_port = 22 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.num_shell_tries = 3 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.nvmet_port_id = 1 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.quobyte_client_cfg = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86491]: DEBUG oslo_concurrency.processutils [None req-322880db-fcae-4bc3-b8e5-0ea5275080bf None None] CMD "mount.quobyte" returned: 1 in 0.140s {{(pid=86491) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.quobyte_volume_url = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.replication_device = **** {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.report_discard_supported = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.reserved_percentage = 0 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.scst_target_driver = iscsi {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86491]: DEBUG oslo_concurrency.lockutils [None req-322880db-fcae-4bc3-b8e5-0ea5275080bf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86491) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.scst_target_iqn_name = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.storage_protocol = iSCSI {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.target_helper = tgtadm {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86491]: DEBUG oslo_concurrency.lockutils [None req-322880db-fcae-4bc3-b8e5-0ea5275080bf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86491) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:16:21 devstack cinder-volume[86491]: DEBUG cinder.volume.drivers.quobyte [None req-322880db-fcae-4bc3-b8e5-0ea5275080bf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=86491) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.target_ip_address = 192.168.122.20 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.target_port = 3260 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.target_protocol = iscsi {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.trace_flags = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.unique_fqdn_network = True {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.use_chap_auth = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86491]: INFO cinder.volume.drivers.quobyte [None req-322880db-fcae-4bc3-b8e5-0ea5275080bf None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 ... Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.volume_backend_name = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.volume_clear = zero {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86491]: DEBUG oslo_concurrency.processutils [None req-322880db-fcae-4bc3-b8e5-0ea5275080bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c -c /etc/quobyte/client-cinder.cfg {{(pid=86491) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.volume_clear_ionice = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.volume_clear_size = 0 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_reports.file_event_handler = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_reports.log_dir = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.backend_availability_zone = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.backend_host = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.chap_password = **** {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.chap_username = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.chiscsi_conf = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.disk_geometry = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.driver_client_cert = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.driver_client_cert_key = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.driver_data_namespace = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.driver_use_ssl = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.extra_capabilities = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.filter_function = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.goodness_function = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.iscsi_target_flags = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.iscsi_write_cache = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.iser_helper = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.iser_ip_address = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.iser_port = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.iser_target_prefix = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.nas_host = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.nas_login = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.nas_mount_options = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.nas_password = **** {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.nas_private_key = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.nas_share_path = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.nas_ssh_port = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:21 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.num_shell_tries = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.nvmet_ns_id = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.nvmet_port_id = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.replication_device = **** {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.report_discard_supported = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.reserved_percentage = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.scst_target_driver = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.storage_protocol = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.target_helper = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.target_ip_address = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.target_port = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.target_prefix = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.target_protocol = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.trace_flags = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.unique_fqdn_network = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.use_chap_auth = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.volume_clear = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.volume_clear_ionice = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.volume_clear_size = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] QuobyteHD.volumes_dir = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack sudo[86497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c -c /etc/quobyte/client-cinder.cfg Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack sudo[86497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_messaging_rabbit.ssl = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_messaging_rabbit.ssl_version = {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_messaging_notifications.driver = [] {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_messaging_notifications.retry = -1 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] oslo_messaging_notifications.transport_url = **** {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] key_manager.fixed_key = **** {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] barbican.barbican_api_version = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] barbican.barbican_endpoint = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] barbican.barbican_endpoint_type = public {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] barbican.barbican_region_name = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] barbican.cafile = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] barbican.certfile = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] barbican.collect_timing = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] barbican.insecure = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] barbican.keyfile = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] barbican.number_of_retries = 60 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] barbican.retry_delay = 1 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] barbican.send_service_user_token = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] barbican.split_loggers = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] barbican.timeout = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] barbican.verify_ssl = True {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] barbican.verify_ssl_path = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] barbican_service_user.auth_section = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] barbican_service_user.auth_type = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] barbican_service_user.cafile = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] barbican_service_user.certfile = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] barbican_service_user.collect_timing = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] barbican_service_user.insecure = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] barbican_service_user.keyfile = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] barbican_service_user.split_loggers = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] barbican_service_user.timeout = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] vault.approle_role_id = **** {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] vault.approle_secret_id = **** {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] vault.kv_mountpoint = secret {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] vault.kv_path = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] vault.kv_version = 2 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] vault.namespace = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] vault.root_token_id = **** {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] vault.ssl_ca_crt_file = None {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] vault.timeout = 60.0 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] vault.use_ssl = False {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:22 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] ******************************************************************************** {{(pid=86270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 07 17:16:22 devstack sudo[86497]: pam_unix(sudo:session): session closed for user root Jul 07 17:16:22 devstack cinder-volume[86491]: DEBUG oslo_concurrency.processutils [None req-322880db-fcae-4bc3-b8e5-0ea5275080bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.817s {{(pid=86491) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:16:22 devstack cinder-volume[86491]: INFO cinder.volume.drivers.quobyte [None req-322880db-fcae-4bc3-b8e5-0ea5275080bf None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 succeeded Jul 07 17:16:22 devstack cinder-volume[86491]: DEBUG cinder.volume.drivers.quobyte [None req-322880db-fcae-4bc3-b8e5-0ea5275080bf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=86491) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:16:22 devstack cinder-volume[86491]: DEBUG oslo_concurrency.lockutils [None req-322880db-fcae-4bc3-b8e5-0ea5275080bf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.833s {{(pid=86491) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:16:22 devstack cinder-volume[86491]: DEBUG oslo_concurrency.processutils [None req-322880db-fcae-4bc3-b8e5-0ea5275080bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=86491) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:16:22 devstack sudo[86566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:16:22 devstack sudo[86566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:16:23 devstack sudo[86566]: pam_unix(sudo:session): session closed for user root Jul 07 17:16:23 devstack cinder-volume[86491]: DEBUG oslo_concurrency.processutils [None req-322880db-fcae-4bc3-b8e5-0ea5275080bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.667s {{(pid=86491) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:16:23 devstack cinder-volume[86491]: INFO cinder.volume.driver [None req-322880db-fcae-4bc3-b8e5-0ea5275080bf None None] Driver hasn't implemented _init_vendor_properties() Jul 07 17:16:23 devstack cinder-volume[86491]: DEBUG cinder.volume.driver [None req-322880db-fcae-4bc3-b8e5-0ea5275080bf None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577667236328, 'free_capacity_gb': 1775.7577667236328, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86491) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 07 17:16:23 devstack cinder-volume[86491]: DEBUG oslo_db.sqlalchemy.engines [None req-322880db-fcae-4bc3-b8e5-0ea5275080bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86491) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:16:23 devstack cinder-volume[86491]: DEBUG dbcounter [-] [86491] Writer thread running {{(pid=86491) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 17:16:23 devstack cinder-volume[86491]: DEBUG cinder.db.api [None req-322880db-fcae-4bc3-b8e5-0ea5275080bf None None] Building query based on filter {{(pid=86491) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 07 17:16:23 devstack cinder-volume[86491]: DEBUG cinder.image.image_utils [None req-322880db-fcae-4bc3-b8e5-0ea5275080bf None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86491) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 07 17:16:23 devstack cinder-volume[86491]: INFO cinder.keymgr.migration [None req-1efbad7c-0f02-4a17-98b4-8f7ebc49a153 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 07 17:16:23 devstack cinder-volume[86491]: DEBUG oslo_concurrency.lockutils [None req-322880db-fcae-4bc3-b8e5-0ea5275080bf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86491) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:16:23 devstack cinder-volume[86491]: DEBUG oslo_concurrency.lockutils [None req-322880db-fcae-4bc3-b8e5-0ea5275080bf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86491) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:16:23 devstack cinder-volume[86491]: DEBUG cinder.volume.drivers.quobyte [None req-322880db-fcae-4bc3-b8e5-0ea5275080bf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=86491) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:16:23 devstack cinder-volume[86491]: DEBUG cinder.volume.drivers.quobyte [None req-322880db-fcae-4bc3-b8e5-0ea5275080bf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=86491) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:16:23 devstack cinder-volume[86491]: DEBUG oslo_concurrency.lockutils [None req-322880db-fcae-4bc3-b8e5-0ea5275080bf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86491) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:16:23 devstack cinder-volume[86491]: DEBUG oslo_concurrency.processutils [None req-322880db-fcae-4bc3-b8e5-0ea5275080bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=86491) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:16:23 devstack sudo[86571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:16:23 devstack sudo[86571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:16:24 devstack sudo[86571]: pam_unix(sudo:session): session closed for user root Jul 07 17:16:24 devstack cinder-volume[86491]: DEBUG oslo_concurrency.processutils [None req-322880db-fcae-4bc3-b8e5-0ea5275080bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.810s {{(pid=86491) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:16:24 devstack cinder-volume[86491]: DEBUG cinder.manager [None req-322880db-fcae-4bc3-b8e5-0ea5275080bf None None] Notifying Schedulers of capabilities ... {{(pid=86491) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:16:24 devstack cinder-volume[86491]: INFO cinder.volume.manager [None req-322880db-fcae-4bc3-b8e5-0ea5275080bf None None] Driver initialization completed successfully. Jul 07 17:16:24 devstack cinder-volume[86491]: INFO cinder.manager [None req-322880db-fcae-4bc3-b8e5-0ea5275080bf None None] Initiating service 3 cleanup Jul 07 17:16:24 devstack cinder-volume[86491]: INFO cinder.manager [None req-322880db-fcae-4bc3-b8e5-0ea5275080bf None None] Service 3 cleanup completed. Jul 07 17:16:24 devstack cinder-volume[86491]: DEBUG cinder.service [None req-322880db-fcae-4bc3-b8e5-0ea5275080bf None None] Creating RPC server for service cinder-volume {{(pid=86491) start /opt/stack/cinder/cinder/service.py:231}} Jul 07 17:16:24 devstack cinder-volume[86491]: DEBUG cinder.service [None req-322880db-fcae-4bc3-b8e5-0ea5275080bf None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86491) start /opt/stack/cinder/cinder/service.py:237}} Jul 07 17:16:24 devstack cinder-volume[86491]: INFO cinder.volume.manager [None req-322880db-fcae-4bc3-b8e5-0ea5275080bf None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 07 17:16:24 devstack cinder-volume[86491]: DEBUG oslo_concurrency.lockutils [None req-322880db-fcae-4bc3-b8e5-0ea5275080bf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86491) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:16:24 devstack cinder-volume[86491]: DEBUG oslo_concurrency.lockutils [None req-322880db-fcae-4bc3-b8e5-0ea5275080bf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86491) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:16:24 devstack cinder-volume[86491]: DEBUG cinder.volume.drivers.quobyte [None req-322880db-fcae-4bc3-b8e5-0ea5275080bf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=86491) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:16:24 devstack cinder-volume[86491]: DEBUG cinder.volume.drivers.quobyte [None req-322880db-fcae-4bc3-b8e5-0ea5275080bf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=86491) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:16:24 devstack cinder-volume[86491]: DEBUG oslo_concurrency.lockutils [None req-322880db-fcae-4bc3-b8e5-0ea5275080bf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86491) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:16:24 devstack cinder-volume[86491]: DEBUG oslo_concurrency.processutils [None req-322880db-fcae-4bc3-b8e5-0ea5275080bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=86491) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:16:24 devstack sudo[86601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:16:24 devstack sudo[86601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:16:25 devstack sudo[86601]: pam_unix(sudo:session): session closed for user root Jul 07 17:16:25 devstack cinder-volume[86491]: DEBUG oslo_concurrency.processutils [None req-322880db-fcae-4bc3-b8e5-0ea5275080bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.989s {{(pid=86491) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:16:25 devstack cinder-volume[86491]: INFO cinder.volume.manager [None req-322880db-fcae-4bc3-b8e5-0ea5275080bf None None] Driver post RPC initialization completed successfully. Jul 07 17:16:28 devstack cinder-volume[86491]: DEBUG oslo_concurrency.lockutils [None req-324e31f8-bf53-4750-8b22-09d9d7c0b0a9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86491) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:16:28 devstack cinder-volume[86491]: DEBUG oslo_concurrency.lockutils [None req-324e31f8-bf53-4750-8b22-09d9d7c0b0a9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86491) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:16:28 devstack cinder-volume[86491]: DEBUG cinder.volume.drivers.quobyte [None req-324e31f8-bf53-4750-8b22-09d9d7c0b0a9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=86491) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:16:28 devstack cinder-volume[86491]: DEBUG cinder.volume.drivers.quobyte [None req-324e31f8-bf53-4750-8b22-09d9d7c0b0a9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=86491) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:16:28 devstack cinder-volume[86491]: DEBUG oslo_concurrency.lockutils [None req-324e31f8-bf53-4750-8b22-09d9d7c0b0a9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86491) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:16:28 devstack cinder-volume[86491]: DEBUG oslo_concurrency.processutils [None req-324e31f8-bf53-4750-8b22-09d9d7c0b0a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=86491) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:16:28 devstack sudo[86715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:16:28 devstack sudo[86715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:16:29 devstack sudo[86715]: pam_unix(sudo:session): session closed for user root Jul 07 17:16:29 devstack cinder-volume[86491]: DEBUG oslo_concurrency.processutils [None req-324e31f8-bf53-4750-8b22-09d9d7c0b0a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.586s {{(pid=86491) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:16:29 devstack cinder-volume[86491]: DEBUG cinder.manager [None req-324e31f8-bf53-4750-8b22-09d9d7c0b0a9 None None] Notifying Schedulers of capabilities ... {{(pid=86491) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:16:31 devstack cinder-volume[86270]: INFO oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] Caught SIGTERM, stopping children Jul 07 17:16:31 devstack cinder-volume[86270]: DEBUG oslo_concurrency.lockutils [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] Acquiring lock "singleton_lock" {{(pid=86270) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 17:16:31 devstack cinder-volume[86270]: DEBUG oslo_concurrency.lockutils [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] Acquired lock "singleton_lock" {{(pid=86270) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 17:16:31 devstack cinder-volume[86270]: DEBUG oslo_concurrency.lockutils [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] Releasing lock "singleton_lock" {{(pid=86270) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 17:16:31 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] Stop services. {{(pid=86270) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 07 17:16:31 devstack cinder-volume[86270]: DEBUG oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] Killing children. {{(pid=86270) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 07 17:16:31 devstack cinder-volume[86270]: INFO oslo_service.backend._eventlet.service [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] Waiting on 1 children to exit Jul 07 17:16:34 devstack cinder-volume[86491]: DEBUG oslo_service.periodic_task [None req-0c001046-a355-4ea4-b47c-4b9589a10f9e None None] Running periodic task VolumeManager._thread_info {{(pid=86491) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:16:34 devstack cinder-volume[86491]: DEBUG cinder.volume.manager [None req-0c001046-a355-4ea4-b47c-4b9589a10f9e None None] thread count: 6 {{(pid=86491) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:16:34 devstack cinder-volume[86491]: DEBUG cinder.volume.manager [None req-0c001046-a355-4ea4-b47c-4b9589a10f9e None None] thread info: [<_MainThread(MainThread, started 137946026680448)>, , , , , ] {{(pid=86491) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:16:35 devstack cinder-volume[86491]: DEBUG dbcounter [-] [86491] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86491) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:16:35 devstack cinder-volume[86491]: DEBUG dbcounter [-] [86491] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=86491) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:16:36 devstack cinder-volume[86491]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 07 17:16:36 devstack cinder-volume[86929]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 07 17:16:36 devstack cinder-volume[86929]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 17:16:36 devstack cinder-volume[86929]: we strongly recommend against using it for new projects. Jul 07 17:16:36 devstack cinder-volume[86929]: If you are already using Eventlet, we recommend migrating to a different Jul 07 17:16:36 devstack cinder-volume[86929]: framework. For more detail see Jul 07 17:16:36 devstack cinder-volume[86929]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 17:16:36 devstack cinder-volume[86929]: import eventlet # noqa Jul 07 17:16:37 devstack cinder-volume[86491]: DEBUG oslo_concurrency.lockutils [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] Acquiring lock "singleton_lock" {{(pid=86491) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 17:16:37 devstack cinder-volume[86491]: DEBUG oslo_concurrency.lockutils [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] Acquired lock "singleton_lock" {{(pid=86491) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 17:16:37 devstack cinder-volume[86491]: DEBUG oslo_concurrency.lockutils [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] Releasing lock "singleton_lock" {{(pid=86491) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 17:16:37 devstack cinder-volume[86491]: WARNING amqp [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 17:16:37 devstack cinder-volume[86491]: WARNING amqp [None req-29ef82db-9174-4736-98b4-c8d2e5f78f2d None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 17:16:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86929) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 17:16:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86929) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 17:16:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86929) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 17:16:40 devstack cinder-volume[86929]: INFO dbcounter [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] Registered counter for database cinder Jul 07 17:16:40 devstack cinder-volume[86929]: DEBUG oslo_db.sqlalchemy.engines [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86929) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:16:40 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writer thread running {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 17:16:40 devstack cinder-volume[86929]: INFO cinder.rpc [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 07 17:16:40 devstack cinder-volume[86929]: INFO cinder.rpc [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 07 17:16:40 devstack cinder-volume[86929]: DEBUG oslo_db.sqlalchemy.engines [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86929) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:16:40 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] Determined volume DB was empty at startup. Jul 07 17:16:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86929) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 07 17:16:40 devstack cinder-volume[86929]: WARNING stevedore.named [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 17:16:40 devstack cinder-volume[86929]: WARNING castellan.key_manager [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 17:16:40 devstack cinder-volume[86929]: WARNING cinder.keymgr.conf_key_mgr [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 17:16:40 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 07 17:16:40 devstack cinder-volume[86929]: DEBUG oslo_db.sqlalchemy.engines [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86929) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:16:40 devstack cinder-volume[86929]: INFO oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] Starting 1 workers Jul 07 17:16:40 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] Started child 87233 {{(pid=86929) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 07 17:16:40 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] Full set of CONF: {{(pid=86929) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 07 17:16:40 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] ******************************************************************************** {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 07 17:16:40 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] Configuration options gathered from: {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 07 17:16:40 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 07 17:16:40 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 07 17:16:40 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] ================================================================================ {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 07 17:16:40 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] allow_availability_zone_fallback = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:40 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] allow_compression_on_image_upload = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:40 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] allowed_direct_url_schemes = [] {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:40 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] api_rate_limit = True {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:40 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] auth_strategy = keystone {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_availability_zone = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[87233]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_host = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_name = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_stats_polling_interval = 60 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backup_api_class = cinder.backup.api.API {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backup_name_template = backup-%s {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backup_use_same_host = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backup_use_temp_snapshot = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] chap_password = **** {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] chap_username = {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] cinder_internal_tenant_project_id = 3e9dde6e02074d7c8ee91e8d05da273f {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] cinder_internal_tenant_user_id = fcee88d635fd46f487552730215c0aab {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] cluster = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] compression_format = gzip {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] compute_api_class = cinder.compute.nova.API {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] config_dir = [] {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] config_source = [] {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] control_exchange = openstack {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] debug = True {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] default_availability_zone = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] default_group_type = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] default_volume_type = QuobyteHD {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] disk_geometry = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] driver_client_cert = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] driver_client_cert_key = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] driver_data_namespace = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] driver_ssl_cert_path = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] driver_ssl_cert_verify = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] driver_use_ssl = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] enable_new_services = True {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] enable_unsupported_driver = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] enabled_backends = ['QuobyteHD'] {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] enforce_multipath_for_image_xfer = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] filter_function = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] glance_api_insecure = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] glance_api_servers = ['http://192.168.122.20/image'] {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] glance_api_ssl_compression = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] glance_ca_certificates_file = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] glance_catalog_info = image:glance:publicURL {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] glance_certfile = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] glance_keyfile = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] glance_num_retries = 3 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] glance_request_timeout = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] goodness_function = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] graceful_shutdown_timeout = 5 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] group_api_class = cinder.group.api.API {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] host = devstack {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] image_compress_on_upload = True {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] image_conversion_address_space_limit = 1 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] image_conversion_cpu_limit = 60 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] image_conversion_disable = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] image_upload_use_cinder_backend = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] image_upload_use_internal_tenant = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] image_volume_cache_enabled = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] image_volume_cache_max_count = 0 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] image_volume_cache_max_size_gb = 0 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] init_host_max_objects_retrieval = 0 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] instance_format = [instance: %(uuid)s] {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] iscsi_target_flags = {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] iscsi_write_cache = on {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] iser_helper = tgtadm {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] iser_ip_address = 192.168.122.20 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] iser_port = 3260 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] log_color = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] log_config_append = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] log_dir = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] log_file = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] log_options = True {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] log_rotate_interval = 1 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] log_rotate_interval_type = days {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] log_rotation_type = none {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] max_age = 0 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] max_logfile_count = 30 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] max_logfile_size_mb = 200 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] max_over_subscription_ratio = 20.0 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] message_reap_interval = 86400 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] message_ttl = 2592000 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] migration_create_volume_timeout_secs = 300 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] monkey_patch = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] monkey_patch_modules = [] {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] my_ip = 192.168.122.20 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack quobyte-client[87234]: Reading configuration file: /etc/quobyte/client.cfg Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] no_snapshot_gb_quota = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] num_iser_scan_tries = 3 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] num_shell_tries = 3 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] num_volume_device_scan_tries = 3 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] nvmeof_conn_info_version = 1 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] nvmet_ns_id = 10 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] nvmet_port_id = 1 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack quobyte-client[87234]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] osapi_max_limit = 1000 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] osapi_volume_ext_list = [] {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] osapi_volume_listen = 0.0.0.0 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] osapi_volume_listen_port = 8776 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] osapi_volume_use_ssl = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] osapi_volume_workers = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] per_volume_size_limit = -1 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] periodic_fuzzy_delay = 60 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] periodic_interval = 60 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] project_id_regex = [0-9a-f\-]+ {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] public_endpoint = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] publish_errors = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] quota_backup_gigabytes = 1000 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] quota_backups = 10 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] quota_gigabytes = 1000 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] quota_groups = 10 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] quota_snapshots = 10 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] quota_volumes = 10 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack sudo[87235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] rate_limit_burst = 0 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] rate_limit_except_level = CRITICAL {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] rate_limit_interval = 0 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] reinit_driver_count = 3 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] replication_device = **** {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] report_discard_supported = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] report_interval = 120 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack sudo[87235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:16:41 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-50be8143-7e35-4ac4-a35a-a9ad70b64d93 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] reservation_clean_interval = 86400 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-50be8143-7e35-4ac4-a35a-a9ad70b64d93 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87233) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] reservation_expire = 86400 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] reserved_image_namespaces = [] {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] reserved_percentage = 0 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] rpc_response_timeout = 120 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] run_external_periodic_tasks = True {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] scst_target_driver = iscsi {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] scst_target_iqn_name = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] service_down_time = 720 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] shell_completion = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] snapshot_name_template = snapshot-%s {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] split_loggers = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] state_path = /opt/stack/data/cinder {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] storage_availability_zone = nova {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] storage_protocol = iSCSI {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] syslog_log_facility = LOG_USER {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] target_helper = lioadm {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] target_ip_address = 192.168.122.20 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] target_port = 3260 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] target_protocol = iscsi {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] target_secondary_ip_addresses = [] {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] trace_flags = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] transfer_api_class = cinder.transfer.api.API {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] transport_url = **** {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] until_refresh = 0 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] use_chap_auth = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] use_default_quota_class = True {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] use_journal = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] use_json = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] use_multipath_for_image_xfer = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] use_stderr = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] use_syslog = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] verify_glance_signatures = enabled {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] volume_api_class = cinder.volume.api.API {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] volume_backend_name = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] volume_clear = zero {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] volume_clear_ionice = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] volume_clear_size = 0 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] volume_copy_bps_limit = 0 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] volume_dd_blocksize = 1M {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] volume_name_template = volume-%s {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] volume_service_inithost_offload = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] volume_usage_audit_period = month {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] zoning_mode = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_concurrency.disable_process_locking = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] keystone_authtoken.auth_section = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] keystone_authtoken.auth_type = password {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] keystone_authtoken.auth_version = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] keystone_authtoken.cache = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] keystone_authtoken.certfile = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] keystone_authtoken.delay_auth_decision = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] keystone_authtoken.http_connect_timeout = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] keystone_authtoken.include_service_catalog = True {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] keystone_authtoken.insecure = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] keystone_authtoken.interface = public {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] keystone_authtoken.keyfile = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] keystone_authtoken.memcache_password = {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] keystone_authtoken.memcache_username = {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] keystone_authtoken.region_name = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] keystone_authtoken.service_token_roles_required = True {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] keystone_authtoken.service_type = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] keystone_authtoken.token_cache_time = 300 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.20/identity {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] cache.backend = dogpile.cache.null {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] cache.backend_argument = **** {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] cache.backend_expiration_time = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] cache.config_prefix = cache.oslo {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] cache.debug_cache_backend = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] cache.enable_retry_client = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] cache.enable_socket_keepalive = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] cache.enabled = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] cache.expiration_time = 600 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] cache.hashclient_retry_attempts = 2 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] cache.memcache_dead_retry = 300 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] cache.memcache_pool_maxsize = 10 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] cache.memcache_sasl_enabled = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] cache.password = **** {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] cache.proxies = [] {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] cache.redis_db = 0 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] cache.redis_sentinel_service_name = mymaster {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] cache.redis_server = localhost:6379 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] cache.retry_attempts = 2 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] cache.retry_delay = 0.0 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] cache.socket_keepalive_count = 1 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] cache.socket_keepalive_idle = 1 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] cache.socket_keepalive_interval = 1 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] cache.socket_timeout = 1.0 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] cache.tls_allowed_ciphers = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] cache.tls_cafile = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] cache.tls_certfile = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] cache.tls_enabled = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] cache.tls_keyfile = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] cache.username = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] coordination.backend_url = **** {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] database.asyncio_connection = **** {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] database.asyncio_slave_connection = **** {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] database.backend = sqlalchemy {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] database.connection = **** {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] database.connection_debug = 0 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] database.connection_parameters = {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] database.connection_recycle_time = 3600 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] database.connection_trace = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] database.db_inc_retry_interval = True {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] database.db_max_retries = 20 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] database.db_max_retry_interval = 10 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] database.db_retry_interval = 1 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] database.max_overflow = 50 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] database.max_pool_size = 5 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] database.max_retries = 10 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] database.mysql_wsrep_sync_wait = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] database.pool_timeout = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] database.retry_interval = 10 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] database.slave_connection = **** {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] database.sqlite_synchronous = True {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] database.synchronous_reader = True {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] database.use_db_reconnect = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] profiler.connection_string = messaging:// {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] profiler.enabled = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] profiler.es_doc_type = notification {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] profiler.es_scroll_size = 10000 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] profiler.es_scroll_time = 2m {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] profiler.filter_error_trace = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] profiler.hmac_keys = **** {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] profiler.sentinel_service_name = mymaster {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] profiler.socket_timeout = 0.1 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] profiler.trace_requests = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] profiler.trace_sqlalchemy = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] profiler_jaeger.process_tags = {} {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] profiler_jaeger.service_name_prefix = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] profiler_otlp.service_name_prefix = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_policy.enforce_new_defaults = True {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_policy.enforce_scope = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_policy.policy_default_rule = default {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_policy.policy_file = policy.yaml {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_policy.remote_timeout = 60.0 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] privsep_osbrick.group = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] privsep_osbrick.helper_command = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] privsep_osbrick.user = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] cinder_sys_admin.group = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] cinder_sys_admin.helper_command = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] cinder_sys_admin.user = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] service_user.auth_section = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] service_user.auth_type = password {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] service_user.cafile = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] service_user.certfile = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] service_user.collect_timing = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] service_user.insecure = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] service_user.keyfile = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] service_user.send_service_user_token = True {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] service_user.split_loggers = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] service_user.timeout = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] glance.auth_section = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] glance.auth_type = password {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] glance.certfile = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] glance.collect_timing = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] glance.insecure = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] glance.keyfile = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] glance.region_name = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] glance.split_loggers = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-50be8143-7e35-4ac4-a35a-a9ad70b64d93 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87233) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 07 17:16:41 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.quobyte [None req-50be8143-7e35-4ac4-a35a-a9ad70b64d93 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 07 17:16:41 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.quobyte [None req-50be8143-7e35-4ac4-a35a-a9ad70b64d93 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] glance.timeout = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.backend_availability_zone = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-50be8143-7e35-4ac4-a35a-a9ad70b64d93 None None] Running cmd (subprocess): mount.quobyte {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.chap_password = **** {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.chap_username = {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.disk_geometry = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.driver_client_cert = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.driver_client_cert_key = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.driver_data_namespace = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.driver_use_ssl = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.enable_unsupported_driver = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.extra_capabilities = {} {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.filter_function = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.goodness_function = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.iscsi_target_flags = {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.iscsi_write_cache = on {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.iser_helper = tgtadm {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.iser_ip_address = 192.168.122.20 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.iser_port = 3260 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.nas_host = {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.nas_login = admin {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.nas_mount_options = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.nas_password = **** {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.nas_private_key = {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.nas_share_path = {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.nas_ssh_port = 22 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.num_shell_tries = 3 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.nvmet_port_id = 1 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.quobyte_client_cfg = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.quobyte_volume_url = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.replication_device = **** {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.report_discard_supported = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.reserved_percentage = 0 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.scst_target_driver = iscsi {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.scst_target_iqn_name = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.storage_protocol = iSCSI {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.target_helper = tgtadm {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.target_ip_address = 192.168.122.20 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.target_port = 3260 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.target_protocol = iscsi {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.trace_flags = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.unique_fqdn_network = True {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.use_chap_auth = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.volume_backend_name = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.volume_clear = zero {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.volume_clear_ionice = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.volume_clear_size = 0 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_reports.file_event_handler = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_reports.log_dir = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.backend_availability_zone = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.backend_host = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.chap_password = **** {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.chap_username = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.chiscsi_conf = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.disk_geometry = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.driver_client_cert = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.driver_client_cert_key = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.driver_data_namespace = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.driver_use_ssl = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.extra_capabilities = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.filter_function = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.goodness_function = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.iscsi_target_flags = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.iscsi_write_cache = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.iser_helper = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.iser_ip_address = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.iser_port = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.iser_target_prefix = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.nas_host = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.nas_login = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.nas_mount_options = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.nas_password = **** {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.nas_private_key = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.nas_share_path = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.nas_ssh_port = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.num_shell_tries = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.nvmet_ns_id = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.nvmet_port_id = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-50be8143-7e35-4ac4-a35a-a9ad70b64d93 None None] CMD "mount.quobyte" returned: 1 in 0.061s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.replication_device = **** {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.report_discard_supported = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-50be8143-7e35-4ac4-a35a-a9ad70b64d93 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.reserved_percentage = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.scst_target_driver = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-50be8143-7e35-4ac4-a35a-a9ad70b64d93 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-50be8143-7e35-4ac4-a35a-a9ad70b64d93 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.storage_protocol = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.target_helper = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.target_ip_address = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.target_port = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.target_prefix = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-50be8143-7e35-4ac4-a35a-a9ad70b64d93 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:16:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-50be8143-7e35-4ac4-a35a-a9ad70b64d93 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.target_protocol = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-50be8143-7e35-4ac4-a35a-a9ad70b64d93 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.trace_flags = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.unique_fqdn_network = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.use_chap_auth = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.volume_clear = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.volume_clear_ionice = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.volume_clear_size = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] QuobyteHD.volumes_dir = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_messaging_rabbit.ssl = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_messaging_rabbit.ssl_version = {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_messaging_notifications.driver = [] {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_messaging_notifications.retry = -1 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] oslo_messaging_notifications.transport_url = **** {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] key_manager.fixed_key = **** {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] barbican.barbican_api_version = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] barbican.barbican_endpoint = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] barbican.barbican_endpoint_type = public {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] barbican.barbican_region_name = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] barbican.cafile = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] barbican.certfile = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] barbican.collect_timing = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] barbican.insecure = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] barbican.keyfile = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] barbican.number_of_retries = 60 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] barbican.retry_delay = 1 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] barbican.send_service_user_token = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] barbican.split_loggers = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] barbican.timeout = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] barbican.verify_ssl = True {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] barbican.verify_ssl_path = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] barbican_service_user.auth_section = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] barbican_service_user.auth_type = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] barbican_service_user.cafile = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] barbican_service_user.certfile = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] barbican_service_user.collect_timing = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] barbican_service_user.insecure = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] barbican_service_user.keyfile = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] barbican_service_user.split_loggers = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] barbican_service_user.timeout = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] vault.approle_role_id = **** {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] vault.approle_secret_id = **** {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] vault.kv_mountpoint = secret {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] vault.kv_path = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] vault.kv_version = 2 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] vault.namespace = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] vault.root_token_id = **** {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] vault.ssl_ca_crt_file = None {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] vault.timeout = 60.0 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] vault.use_ssl = False {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_service.backend._eventlet.service [None req-71da0d4c-e397-4925-8985-b67a2b33d4fc None None] ******************************************************************************** {{(pid=86929) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 07 17:16:41 devstack sudo[87235]: pam_unix(sudo:session): session closed for user root Jul 07 17:16:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-50be8143-7e35-4ac4-a35a-a9ad70b64d93 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.613s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:16:41 devstack cinder-volume[87233]: INFO cinder.volume.driver [None req-50be8143-7e35-4ac4-a35a-a9ad70b64d93 None None] Driver hasn't implemented _init_vendor_properties() Jul 07 17:16:41 devstack cinder-volume[87233]: DEBUG cinder.volume.driver [None req-50be8143-7e35-4ac4-a35a-a9ad70b64d93 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577667236328, 'free_capacity_gb': 1775.7577667236328, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87233) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 07 17:16:41 devstack cinder-volume[87233]: DEBUG oslo_db.sqlalchemy.engines [None req-50be8143-7e35-4ac4-a35a-a9ad70b64d93 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87233) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:16:41 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writer thread running {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 17:16:41 devstack cinder-volume[87233]: DEBUG cinder.db.api [None req-50be8143-7e35-4ac4-a35a-a9ad70b64d93 None None] Building query based on filter {{(pid=87233) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 07 17:16:41 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-50be8143-7e35-4ac4-a35a-a9ad70b64d93 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87233) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 07 17:16:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-50be8143-7e35-4ac4-a35a-a9ad70b64d93 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:16:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-50be8143-7e35-4ac4-a35a-a9ad70b64d93 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:16:41 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-50be8143-7e35-4ac4-a35a-a9ad70b64d93 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:16:41 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-50be8143-7e35-4ac4-a35a-a9ad70b64d93 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:16:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-50be8143-7e35-4ac4-a35a-a9ad70b64d93 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:16:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-50be8143-7e35-4ac4-a35a-a9ad70b64d93 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:16:41 devstack cinder-volume[87233]: INFO cinder.keymgr.migration [None req-47a211a8-8311-477a-a604-381a292c6fa3 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 07 17:16:41 devstack sudo[87239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:16:41 devstack sudo[87239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:16:42 devstack sudo[87239]: pam_unix(sudo:session): session closed for user root Jul 07 17:16:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-50be8143-7e35-4ac4-a35a-a9ad70b64d93 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.592s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:16:42 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-50be8143-7e35-4ac4-a35a-a9ad70b64d93 None None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:16:42 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-50be8143-7e35-4ac4-a35a-a9ad70b64d93 None None] Driver initialization completed successfully. Jul 07 17:16:42 devstack cinder-volume[87233]: INFO cinder.manager [None req-50be8143-7e35-4ac4-a35a-a9ad70b64d93 None None] Initiating service 3 cleanup Jul 07 17:16:42 devstack cinder-volume[87233]: INFO cinder.manager [None req-50be8143-7e35-4ac4-a35a-a9ad70b64d93 None None] Service 3 cleanup completed. Jul 07 17:16:42 devstack cinder-volume[87233]: DEBUG cinder.service [None req-50be8143-7e35-4ac4-a35a-a9ad70b64d93 None None] Creating RPC server for service cinder-volume {{(pid=87233) start /opt/stack/cinder/cinder/service.py:231}} Jul 07 17:16:42 devstack cinder-volume[87233]: DEBUG cinder.service [None req-50be8143-7e35-4ac4-a35a-a9ad70b64d93 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87233) start /opt/stack/cinder/cinder/service.py:237}} Jul 07 17:16:42 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-50be8143-7e35-4ac4-a35a-a9ad70b64d93 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 07 17:16:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-50be8143-7e35-4ac4-a35a-a9ad70b64d93 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:16:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-50be8143-7e35-4ac4-a35a-a9ad70b64d93 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:16:42 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-50be8143-7e35-4ac4-a35a-a9ad70b64d93 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:16:42 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-50be8143-7e35-4ac4-a35a-a9ad70b64d93 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:16:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-50be8143-7e35-4ac4-a35a-a9ad70b64d93 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:16:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-50be8143-7e35-4ac4-a35a-a9ad70b64d93 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:16:42 devstack sudo[87273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:16:42 devstack sudo[87273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:16:43 devstack sudo[87273]: pam_unix(sudo:session): session closed for user root Jul 07 17:16:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-50be8143-7e35-4ac4-a35a-a9ad70b64d93 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.628s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:16:43 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-50be8143-7e35-4ac4-a35a-a9ad70b64d93 None None] Driver post RPC initialization completed successfully. Jul 07 17:16:50 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:16:52 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:16:53 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:SELECT=3 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:17:43 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:17:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:17:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:17:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:17:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:17:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:17:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:17:43 devstack sudo[87603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:17:43 devstack sudo[87603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:17:44 devstack sudo[87603]: pam_unix(sudo:session): session closed for user root Jul 07 17:17:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 1.194s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:17:44 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:17:44 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:17:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread count: 6 {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:17:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread info: [<_MainThread(MainThread, started 126077716062336)>, , , , , ] {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:17:56 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd85e5bc-2752-4d4d-848e-c4aad9c7ac30 tempest-DeleteServersTestJSON-1503134396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:17:56 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-cd85e5bc-2752-4d4d-848e-c4aad9c7ac30 tempest-DeleteServersTestJSON-1503134396 None] Flow 'volume_create_manager' (abf51842-2985-4618-9551-b68bd7310be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:17:56 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-cd85e5bc-2752-4d4d-848e-c4aad9c7ac30 tempest-DeleteServersTestJSON-1503134396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9937b425-7432-4eaf-bf78-a7d34593f5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:17:56 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-cd85e5bc-2752-4d4d-848e-c4aad9c7ac30 tempest-DeleteServersTestJSON-1503134396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9937b425-7432-4eaf-bf78-a7d34593f5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-193078893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8961acd4-59e2-4bfd-a8dc-529b68c4ce53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca9eadba43644dc08a210c4269f28b87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:17:56Z,use_quota=True,user_id='1ceb8e00e0dd4065bc03ef352132a38c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:17:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-cd85e5bc-2752-4d4d-848e-c4aad9c7ac30 tempest-DeleteServersTestJSON-1503134396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26e6dc24-9a8a-4b6f-abf4-2ed822cc4090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:17:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-cd85e5bc-2752-4d4d-848e-c4aad9c7ac30 tempest-DeleteServersTestJSON-1503134396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26e6dc24-9a8a-4b6f-abf4-2ed822cc4090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:17:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-cd85e5bc-2752-4d4d-848e-c4aad9c7ac30 tempest-DeleteServersTestJSON-1503134396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33d484db-6ba9-4e77-8015-b70637ed0f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:17:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-cd85e5bc-2752-4d4d-848e-c4aad9c7ac30 tempest-DeleteServersTestJSON-1503134396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33d484db-6ba9-4e77-8015-b70637ed0f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8961acd4-59e2-4bfd-a8dc-529b68c4ce53', 'volume_name': 'volume-8961acd4-59e2-4bfd-a8dc-529b68c4ce53', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:17:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-cd85e5bc-2752-4d4d-848e-c4aad9c7ac30 tempest-DeleteServersTestJSON-1503134396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (992244ae-208b-457c-b34e-79efc5f4361c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:17:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-cd85e5bc-2752-4d4d-848e-c4aad9c7ac30 tempest-DeleteServersTestJSON-1503134396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (992244ae-208b-457c-b34e-79efc5f4361c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:17:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-cd85e5bc-2752-4d4d-848e-c4aad9c7ac30 tempest-DeleteServersTestJSON-1503134396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13fbd1cf-2b85-43d9-bc7c-8b59a22177a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:17:57 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-cd85e5bc-2752-4d4d-848e-c4aad9c7ac30 tempest-DeleteServersTestJSON-1503134396 None] Volume 8961acd4-59e2-4bfd-a8dc-529b68c4ce53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8961acd4-59e2-4bfd-a8dc-529b68c4ce53', 'volume_size': 1} Jul 07 17:17:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-cd85e5bc-2752-4d4d-848e-c4aad9c7ac30 tempest-DeleteServersTestJSON-1503134396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:17:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-cd85e5bc-2752-4d4d-848e-c4aad9c7ac30 tempest-DeleteServersTestJSON-1503134396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:17:57 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-cd85e5bc-2752-4d4d-848e-c4aad9c7ac30 tempest-DeleteServersTestJSON-1503134396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-193078893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8961acd4-59e2-4bfd-a8dc-529b68c4ce53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca9eadba43644dc08a210c4269f28b87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:17:56Z,use_quota=True,user_id='1ceb8e00e0dd4065bc03ef352132a38c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:17:57 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-cd85e5bc-2752-4d4d-848e-c4aad9c7ac30 tempest-DeleteServersTestJSON-1503134396 None] Creating volume 8961acd4-59e2-4bfd-a8dc-529b68c4ce53 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:17:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-cd85e5bc-2752-4d4d-848e-c4aad9c7ac30 tempest-DeleteServersTestJSON-1503134396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:17:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-cd85e5bc-2752-4d4d-848e-c4aad9c7ac30 tempest-DeleteServersTestJSON-1503134396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:17:57 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-cd85e5bc-2752-4d4d-848e-c4aad9c7ac30 tempest-DeleteServersTestJSON-1503134396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:17:57 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-cd85e5bc-2752-4d4d-848e-c4aad9c7ac30 tempest-DeleteServersTestJSON-1503134396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:17:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-cd85e5bc-2752-4d4d-848e-c4aad9c7ac30 tempest-DeleteServersTestJSON-1503134396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:17:57 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-cd85e5bc-2752-4d4d-848e-c4aad9c7ac30 tempest-DeleteServersTestJSON-1503134396 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:17:57 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-cd85e5bc-2752-4d4d-848e-c4aad9c7ac30 tempest-DeleteServersTestJSON-1503134396 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:17:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-cd85e5bc-2752-4d4d-848e-c4aad9c7ac30 tempest-DeleteServersTestJSON-1503134396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8961acd4-59e2-4bfd-a8dc-529b68c4ce53 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:17:57 devstack sudo[87792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8961acd4-59e2-4bfd-a8dc-529b68c4ce53 1073741824 Jul 07 17:17:57 devstack sudo[87792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:18:00 devstack sudo[87792]: pam_unix(sudo:session): session closed for user root Jul 07 17:18:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-cd85e5bc-2752-4d4d-848e-c4aad9c7ac30 tempest-DeleteServersTestJSON-1503134396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8961acd4-59e2-4bfd-a8dc-529b68c4ce53 1073741824" returned: 0 in 2.790s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:18:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-cd85e5bc-2752-4d4d-848e-c4aad9c7ac30 tempest-DeleteServersTestJSON-1503134396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8961acd4-59e2-4bfd-a8dc-529b68c4ce53 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:18:00 devstack sudo[88198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8961acd4-59e2-4bfd-a8dc-529b68c4ce53 Jul 07 17:18:00 devstack sudo[88198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:18:01 devstack sudo[88198]: pam_unix(sudo:session): session closed for user root Jul 07 17:18:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-cd85e5bc-2752-4d4d-848e-c4aad9c7ac30 tempest-DeleteServersTestJSON-1503134396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8961acd4-59e2-4bfd-a8dc-529b68c4ce53" returned: 0 in 1.703s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:18:01 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-cd85e5bc-2752-4d4d-848e-c4aad9c7ac30 tempest-DeleteServersTestJSON-1503134396 None] <== create_volume: return (4704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:18:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-cd85e5bc-2752-4d4d-848e-c4aad9c7ac30 tempest-DeleteServersTestJSON-1503134396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.708s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:18:02 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-cd85e5bc-2752-4d4d-848e-c4aad9c7ac30 tempest-DeleteServersTestJSON-1503134396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13fbd1cf-2b85-43d9-bc7c-8b59a22177a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8961acd4-59e2-4bfd-a8dc-529b68c4ce53', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:18:02 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-cd85e5bc-2752-4d4d-848e-c4aad9c7ac30 tempest-DeleteServersTestJSON-1503134396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba3f540c-b8ee-472f-b88a-41ef0a528776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:18:02 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-cd85e5bc-2752-4d4d-848e-c4aad9c7ac30 tempest-DeleteServersTestJSON-1503134396 None] Volume volume-8961acd4-59e2-4bfd-a8dc-529b68c4ce53 (8961acd4-59e2-4bfd-a8dc-529b68c4ce53): created successfully Jul 07 17:18:02 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-cd85e5bc-2752-4d4d-848e-c4aad9c7ac30 tempest-DeleteServersTestJSON-1503134396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba3f540c-b8ee-472f-b88a-41ef0a528776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:18:02 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-cd85e5bc-2752-4d4d-848e-c4aad9c7ac30 tempest-DeleteServersTestJSON-1503134396 None] Flow 'volume_create_manager' (abf51842-2985-4618-9551-b68bd7310be7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:18:02 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-cd85e5bc-2752-4d4d-848e-c4aad9c7ac30 tempest-DeleteServersTestJSON-1503134396 None] Created volume successfully. Jul 07 17:18:11 devstack cinder-volume[87233]: WARNING py.warnings [req-b5a524d0-2ea6-4756-a79a-d77a1340ccbe req-e98787cd-be10-49b1-89d4-9dd94dac8462 tempest-DeleteServersTestJSON-1503134396 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jul 07 17:18:11 devstack cinder-volume[87233]: .first() Jul 07 17:18:11 devstack cinder-volume[87233]: Jul 07 17:18:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-b5a524d0-2ea6-4756-a79a-d77a1340ccbe req-e98787cd-be10-49b1-89d4-9dd94dac8462 tempest-DeleteServersTestJSON-1503134396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:18:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-b5a524d0-2ea6-4756-a79a-d77a1340ccbe req-e98787cd-be10-49b1-89d4-9dd94dac8462 tempest-DeleteServersTestJSON-1503134396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:18:11 devstack cinder-volume[87233]: INFO oslo.privsep.daemon [req-b5a524d0-2ea6-4756-a79a-d77a1340ccbe req-e98787cd-be10-49b1-89d4-9dd94dac8462 tempest-DeleteServersTestJSON-1503134396 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpog5ekyhc/privsep.sock'] Jul 07 17:18:11 devstack sudo[88352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpog5ekyhc/privsep.sock Jul 07 17:18:11 devstack sudo[88352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:18:12 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:18:12 devstack cinder-volume[87233]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 07 17:18:12 devstack cinder-volume[87233]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 17:18:12 devstack cinder-volume[87233]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 07 17:18:12 devstack cinder-volume[87233]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 17:18:12 devstack cinder-volume[87233]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 07 17:18:12 devstack cinder-volume[87233]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 07 17:18:12 devstack cinder-volume[87233]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 17:18:12 devstack cinder-volume[87233]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 17:18:12 devstack cinder-volume[87233]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 07 17:18:13 devstack cinder-volume[87233]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 07 17:18:13 devstack cinder-volume[87233]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 17:18:13 devstack cinder-volume[87233]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 07 17:18:13 devstack cinder-volume[87233]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 17:18:13 devstack cinder-volume[87233]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 07 17:18:13 devstack cinder-volume[87233]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 07 17:18:13 devstack cinder-volume[87233]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 17:18:13 devstack cinder-volume[87233]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 17:18:13 devstack cinder-volume[87233]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 07 17:18:14 devstack sudo[88352]: pam_unix(sudo:session): session closed for user root Jul 07 17:18:14 devstack cinder-volume[87233]: INFO oslo.privsep.daemon [req-b5a524d0-2ea6-4756-a79a-d77a1340ccbe req-e98787cd-be10-49b1-89d4-9dd94dac8462 tempest-DeleteServersTestJSON-1503134396 None] Spawned new privsep daemon via rootwrap Jul 07 17:18:14 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [req-b5a524d0-2ea6-4756-a79a-d77a1340ccbe req-e98787cd-be10-49b1-89d4-9dd94dac8462 tempest-DeleteServersTestJSON-1503134396 None] Accepted privsep connection to /tmp/tmpog5ekyhc/privsep.sock {{(pid=87233) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 07 17:18:14 devstack cinder-volume[87233]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 07 17:18:14 devstack cinder-volume[87233]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 07 17:18:14 devstack cinder-volume[87233]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 07 17:18:14 devstack cinder-volume[87233]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88360 Jul 07 17:18:14 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9969078e-e6ab-462d-b587-bb86d93fe83c]: (2,) {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:18:14 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab4dbf2-c6bd-48a9-b873-755e678b183a]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:18:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-b5a524d0-2ea6-4756-a79a-d77a1340ccbe req-e98787cd-be10-49b1-89d4-9dd94dac8462 tempest-DeleteServersTestJSON-1503134396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8961acd4-59e2-4bfd-a8dc-529b68c4ce53 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:18:14 devstack sudo[88365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8961acd4-59e2-4bfd-a8dc-529b68c4ce53 Jul 07 17:18:14 devstack sudo[88365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:18:15 devstack sudo[88365]: pam_unix(sudo:session): session closed for user root Jul 07 17:18:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-b5a524d0-2ea6-4756-a79a-d77a1340ccbe req-e98787cd-be10-49b1-89d4-9dd94dac8462 tempest-DeleteServersTestJSON-1503134396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8961acd4-59e2-4bfd-a8dc-529b68c4ce53" returned: 0 in 1.375s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:18:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-b5a524d0-2ea6-4756-a79a-d77a1340ccbe req-e98787cd-be10-49b1-89d4-9dd94dac8462 tempest-DeleteServersTestJSON-1503134396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 4.105s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:18:15 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-b5a524d0-2ea6-4756-a79a-d77a1340ccbe req-e98787cd-be10-49b1-89d4-9dd94dac8462 tempest-DeleteServersTestJSON-1503134396 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7', 'name': 'volume-8961acd4-59e2-4bfd-a8dc-529b68c4ce53', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'da394806-7187-4448-89c8-233faf7e4911', 'enforce_multipath': True} {{(pid=87233) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:18:15 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-b5a524d0-2ea6-4756-a79a-d77a1340ccbe req-e98787cd-be10-49b1-89d4-9dd94dac8462 tempest-DeleteServersTestJSON-1503134396 None] attachment_update completed successfully. Jul 07 17:18:22 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe640f29-b27a-489c-a484-c9277c4a314e tempest-VolumesAdminNegativeTest-1360110517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:18:22 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fe640f29-b27a-489c-a484-c9277c4a314e tempest-VolumesAdminNegativeTest-1360110517 None] Flow 'volume_create_manager' (49d029f4-2266-481c-9596-bd78268a84c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:18:22 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fe640f29-b27a-489c-a484-c9277c4a314e tempest-VolumesAdminNegativeTest-1360110517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b665d25-7914-48c1-8067-cbfa5267cc8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:18:22 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fe640f29-b27a-489c-a484-c9277c4a314e tempest-VolumesAdminNegativeTest-1360110517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b665d25-7914-48c1-8067-cbfa5267cc8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:18:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-996893180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bafc103-9554-45bf-bff1-82fb5ab0e137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2182418eec2b44758cf73f4df98871e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:18:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:18:22Z,use_quota=True,user_id='15ffa36ae3e649168e3887177724f3e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:18:22 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fe640f29-b27a-489c-a484-c9277c4a314e tempest-VolumesAdminNegativeTest-1360110517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dab8c140-8e22-490e-9bc1-185caed20c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:18:22 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fe640f29-b27a-489c-a484-c9277c4a314e tempest-VolumesAdminNegativeTest-1360110517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dab8c140-8e22-490e-9bc1-185caed20c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:18:22 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fe640f29-b27a-489c-a484-c9277c4a314e tempest-VolumesAdminNegativeTest-1360110517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dca8b040-87ab-43aa-8972-f9e281460eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:18:22 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fe640f29-b27a-489c-a484-c9277c4a314e tempest-VolumesAdminNegativeTest-1360110517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dca8b040-87ab-43aa-8972-f9e281460eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bafc103-9554-45bf-bff1-82fb5ab0e137', 'volume_name': 'volume-2bafc103-9554-45bf-bff1-82fb5ab0e137', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:18:22 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fe640f29-b27a-489c-a484-c9277c4a314e tempest-VolumesAdminNegativeTest-1360110517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fabd569-a3b0-4383-b411-5d2478f2bbc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:18:22 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fe640f29-b27a-489c-a484-c9277c4a314e tempest-VolumesAdminNegativeTest-1360110517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fabd569-a3b0-4383-b411-5d2478f2bbc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:18:22 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fe640f29-b27a-489c-a484-c9277c4a314e tempest-VolumesAdminNegativeTest-1360110517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa9ab27f-b045-41a3-a5ff-a85d4f4c3057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:18:22 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-fe640f29-b27a-489c-a484-c9277c4a314e tempest-VolumesAdminNegativeTest-1360110517 None] Volume 2bafc103-9554-45bf-bff1-82fb5ab0e137: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bafc103-9554-45bf-bff1-82fb5ab0e137', 'volume_size': 1} Jul 07 17:18:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-fe640f29-b27a-489c-a484-c9277c4a314e tempest-VolumesAdminNegativeTest-1360110517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:18:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-fe640f29-b27a-489c-a484-c9277c4a314e tempest-VolumesAdminNegativeTest-1360110517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:18:22 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-fe640f29-b27a-489c-a484-c9277c4a314e tempest-VolumesAdminNegativeTest-1360110517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:18:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-996893180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bafc103-9554-45bf-bff1-82fb5ab0e137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2182418eec2b44758cf73f4df98871e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:18:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:18:22Z,use_quota=True,user_id='15ffa36ae3e649168e3887177724f3e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:18:22 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-fe640f29-b27a-489c-a484-c9277c4a314e tempest-VolumesAdminNegativeTest-1360110517 None] Creating volume 2bafc103-9554-45bf-bff1-82fb5ab0e137 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:18:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-fe640f29-b27a-489c-a484-c9277c4a314e tempest-VolumesAdminNegativeTest-1360110517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:18:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-fe640f29-b27a-489c-a484-c9277c4a314e tempest-VolumesAdminNegativeTest-1360110517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:18:22 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-fe640f29-b27a-489c-a484-c9277c4a314e tempest-VolumesAdminNegativeTest-1360110517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:18:22 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-fe640f29-b27a-489c-a484-c9277c4a314e tempest-VolumesAdminNegativeTest-1360110517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:18:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-fe640f29-b27a-489c-a484-c9277c4a314e tempest-VolumesAdminNegativeTest-1360110517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:18:22 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-fe640f29-b27a-489c-a484-c9277c4a314e tempest-VolumesAdminNegativeTest-1360110517 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:18:22 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-fe640f29-b27a-489c-a484-c9277c4a314e tempest-VolumesAdminNegativeTest-1360110517 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:18:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fe640f29-b27a-489c-a484-c9277c4a314e tempest-VolumesAdminNegativeTest-1360110517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2bafc103-9554-45bf-bff1-82fb5ab0e137 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:18:22 devstack sudo[88795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2bafc103-9554-45bf-bff1-82fb5ab0e137 1073741824 Jul 07 17:18:22 devstack sudo[88795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:18:23 devstack sudo[88795]: pam_unix(sudo:session): session closed for user root Jul 07 17:18:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fe640f29-b27a-489c-a484-c9277c4a314e tempest-VolumesAdminNegativeTest-1360110517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2bafc103-9554-45bf-bff1-82fb5ab0e137 1073741824" returned: 0 in 1.343s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:18:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fe640f29-b27a-489c-a484-c9277c4a314e tempest-VolumesAdminNegativeTest-1360110517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2bafc103-9554-45bf-bff1-82fb5ab0e137 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:18:23 devstack sudo[88811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2bafc103-9554-45bf-bff1-82fb5ab0e137 Jul 07 17:18:23 devstack sudo[88811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:18:24 devstack sudo[88811]: pam_unix(sudo:session): session closed for user root Jul 07 17:18:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fe640f29-b27a-489c-a484-c9277c4a314e tempest-VolumesAdminNegativeTest-1360110517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2bafc103-9554-45bf-bff1-82fb5ab0e137" returned: 0 in 1.107s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:18:24 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-fe640f29-b27a-489c-a484-c9277c4a314e tempest-VolumesAdminNegativeTest-1360110517 None] <== create_volume: return (2513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:18:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-fe640f29-b27a-489c-a484-c9277c4a314e tempest-VolumesAdminNegativeTest-1360110517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.517s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:18:24 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fe640f29-b27a-489c-a484-c9277c4a314e tempest-VolumesAdminNegativeTest-1360110517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa9ab27f-b045-41a3-a5ff-a85d4f4c3057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bafc103-9554-45bf-bff1-82fb5ab0e137', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:18:24 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fe640f29-b27a-489c-a484-c9277c4a314e tempest-VolumesAdminNegativeTest-1360110517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d53d79de-141a-4f6b-95d4-8ddf5d8303ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:18:24 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-fe640f29-b27a-489c-a484-c9277c4a314e tempest-VolumesAdminNegativeTest-1360110517 None] Volume volume-2bafc103-9554-45bf-bff1-82fb5ab0e137 (2bafc103-9554-45bf-bff1-82fb5ab0e137): created successfully Jul 07 17:18:24 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fe640f29-b27a-489c-a484-c9277c4a314e tempest-VolumesAdminNegativeTest-1360110517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d53d79de-141a-4f6b-95d4-8ddf5d8303ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:18:24 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fe640f29-b27a-489c-a484-c9277c4a314e tempest-VolumesAdminNegativeTest-1360110517 None] Flow 'volume_create_manager' (49d029f4-2266-481c-9596-bd78268a84c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:18:24 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-fe640f29-b27a-489c-a484-c9277c4a314e tempest-VolumesAdminNegativeTest-1360110517 None] Created volume successfully. Jul 07 17:18:26 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6d3a6859-869f-4257-8d3e-e11bd8edbc3a tempest-VolumesAdminNegativeTest-1360110517 None] Acquiring lock "cinder-2bafc103-9554-45bf-bff1-82fb5ab0e137-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:18:26 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6d3a6859-869f-4257-8d3e-e11bd8edbc3a tempest-VolumesAdminNegativeTest-1360110517 None] Lock "cinder-2bafc103-9554-45bf-bff1-82fb5ab0e137-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:18:26 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6d3a6859-869f-4257-8d3e-e11bd8edbc3a tempest-VolumesAdminNegativeTest-1360110517 None] Acquiring lock "cinder-quobyte-2bafc103-9554-45bf-bff1-82fb5ab0e137" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:18:26 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6d3a6859-869f-4257-8d3e-e11bd8edbc3a tempest-VolumesAdminNegativeTest-1360110517 None] Lock "cinder-quobyte-2bafc103-9554-45bf-bff1-82fb5ab0e137" acquired by "delete_volume" :: waited 0.047s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:18:26 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab7587a-fdc8-4ff2-ad1a-0d70e562e121]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:18:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6d3a6859-869f-4257-8d3e-e11bd8edbc3a tempest-VolumesAdminNegativeTest-1360110517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2bafc103-9554-45bf-bff1-82fb5ab0e137 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:18:26 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-ece93b97-82d8-4119-80f4-9b813c14eecf req-3bb7b537-eed3-4f84-897a-cebcc114302d tempest-DeleteServersTestJSON-1503134396 None] Terminate volume connection completed successfully. Jul 07 17:18:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-ece93b97-82d8-4119-80f4-9b813c14eecf req-3bb7b537-eed3-4f84-897a-cebcc114302d tempest-DeleteServersTestJSON-1503134396 None] Deleting attachment da394806-7187-4448-89c8-233faf7e4911. {{(pid=87233) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:18:26 devstack sudo[88860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2bafc103-9554-45bf-bff1-82fb5ab0e137 Jul 07 17:18:26 devstack sudo[88860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:18:27 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-e90937bd-d9ce-4bf7-86a5-802a8f9f03c8 tempest-ServersNegativeTestJSON-1847641353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:18:27 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e90937bd-d9ce-4bf7-86a5-802a8f9f03c8 tempest-ServersNegativeTestJSON-1847641353 None] Flow 'volume_create_manager' (364150b8-001a-4f2c-a545-e25f0c2020eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:18:27 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e90937bd-d9ce-4bf7-86a5-802a8f9f03c8 tempest-ServersNegativeTestJSON-1847641353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bef3885-7505-47f9-84fe-593d22c02421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:18:27 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e90937bd-d9ce-4bf7-86a5-802a8f9f03c8 tempest-ServersNegativeTestJSON-1847641353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bef3885-7505-47f9-84fe-593d22c02421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1160630974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32cdee86-6536-4256-ae92-efca38bcea9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05801c58efc34449967c4c77a45a2e0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:18:28Z,use_quota=True,user_id='16d5793f04394ed2bea96e8a0a805b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:18:27 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e90937bd-d9ce-4bf7-86a5-802a8f9f03c8 tempest-ServersNegativeTestJSON-1847641353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e99649d0-3a6c-4d7d-a7ce-3f6ce44ceccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:18:27 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e90937bd-d9ce-4bf7-86a5-802a8f9f03c8 tempest-ServersNegativeTestJSON-1847641353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e99649d0-3a6c-4d7d-a7ce-3f6ce44ceccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:18:27 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e90937bd-d9ce-4bf7-86a5-802a8f9f03c8 tempest-ServersNegativeTestJSON-1847641353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e5940fb-110a-47e4-95dd-3f5bdf63745f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:18:27 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e90937bd-d9ce-4bf7-86a5-802a8f9f03c8 tempest-ServersNegativeTestJSON-1847641353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e5940fb-110a-47e4-95dd-3f5bdf63745f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32cdee86-6536-4256-ae92-efca38bcea9b', 'volume_name': 'volume-32cdee86-6536-4256-ae92-efca38bcea9b', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:18:27 devstack sudo[88860]: pam_unix(sudo:session): session closed for user root Jul 07 17:18:27 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e90937bd-d9ce-4bf7-86a5-802a8f9f03c8 tempest-ServersNegativeTestJSON-1847641353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8e22059-abfd-4926-a89b-367f03e606c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:18:27 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e90937bd-d9ce-4bf7-86a5-802a8f9f03c8 tempest-ServersNegativeTestJSON-1847641353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8e22059-abfd-4926-a89b-367f03e606c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:18:27 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e90937bd-d9ce-4bf7-86a5-802a8f9f03c8 tempest-ServersNegativeTestJSON-1847641353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4be5c18a-dfe2-484a-9cb5-0f88053c2910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:18:27 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-e90937bd-d9ce-4bf7-86a5-802a8f9f03c8 tempest-ServersNegativeTestJSON-1847641353 None] Volume 32cdee86-6536-4256-ae92-efca38bcea9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32cdee86-6536-4256-ae92-efca38bcea9b', 'volume_size': 1} Jul 07 17:18:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e90937bd-d9ce-4bf7-86a5-802a8f9f03c8 tempest-ServersNegativeTestJSON-1847641353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:18:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e90937bd-d9ce-4bf7-86a5-802a8f9f03c8 tempest-ServersNegativeTestJSON-1847641353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:18:27 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-e90937bd-d9ce-4bf7-86a5-802a8f9f03c8 tempest-ServersNegativeTestJSON-1847641353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1160630974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32cdee86-6536-4256-ae92-efca38bcea9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05801c58efc34449967c4c77a45a2e0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:18:28Z,use_quota=True,user_id='16d5793f04394ed2bea96e8a0a805b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:18:27 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-e90937bd-d9ce-4bf7-86a5-802a8f9f03c8 tempest-ServersNegativeTestJSON-1847641353 None] Creating volume 32cdee86-6536-4256-ae92-efca38bcea9b {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:18:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e90937bd-d9ce-4bf7-86a5-802a8f9f03c8 tempest-ServersNegativeTestJSON-1847641353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:18:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e90937bd-d9ce-4bf7-86a5-802a8f9f03c8 tempest-ServersNegativeTestJSON-1847641353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:18:27 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-e90937bd-d9ce-4bf7-86a5-802a8f9f03c8 tempest-ServersNegativeTestJSON-1847641353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:18:27 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-e90937bd-d9ce-4bf7-86a5-802a8f9f03c8 tempest-ServersNegativeTestJSON-1847641353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:18:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e90937bd-d9ce-4bf7-86a5-802a8f9f03c8 tempest-ServersNegativeTestJSON-1847641353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:18:27 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-e90937bd-d9ce-4bf7-86a5-802a8f9f03c8 tempest-ServersNegativeTestJSON-1847641353 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:18:27 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-e90937bd-d9ce-4bf7-86a5-802a8f9f03c8 tempest-ServersNegativeTestJSON-1847641353 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:18:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e90937bd-d9ce-4bf7-86a5-802a8f9f03c8 tempest-ServersNegativeTestJSON-1847641353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32cdee86-6536-4256-ae92-efca38bcea9b 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:18:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6d3a6859-869f-4257-8d3e-e11bd8edbc3a tempest-VolumesAdminNegativeTest-1360110517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2bafc103-9554-45bf-bff1-82fb5ab0e137" returned: 0 in 1.392s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:18:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6d3a6859-869f-4257-8d3e-e11bd8edbc3a tempest-VolumesAdminNegativeTest-1360110517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2bafc103-9554-45bf-bff1-82fb5ab0e137 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:18:27 devstack sudo[88868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32cdee86-6536-4256-ae92-efca38bcea9b 1073741824 Jul 07 17:18:27 devstack sudo[88868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:18:27 devstack sudo[88869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2bafc103-9554-45bf-bff1-82fb5ab0e137 Jul 07 17:18:27 devstack sudo[88869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:18:28 devstack sudo[88869]: pam_unix(sudo:session): session closed for user root Jul 07 17:18:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6d3a6859-869f-4257-8d3e-e11bd8edbc3a tempest-VolumesAdminNegativeTest-1360110517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2bafc103-9554-45bf-bff1-82fb5ab0e137" returned: 0 in 1.113s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:18:29 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6d3a6859-869f-4257-8d3e-e11bd8edbc3a tempest-VolumesAdminNegativeTest-1360110517 None] Lock "cinder-quobyte-2bafc103-9554-45bf-bff1-82fb5ab0e137" released by "delete_volume" :: held 2.569s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:18:29 devstack cinder-volume[87233]: WARNING cinder.quota [None req-6d3a6859-869f-4257-8d3e-e11bd8edbc3a tempest-VolumesAdminNegativeTest-1360110517 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:18:29 devstack cinder-volume[87233]: WARNING cinder.quota [None req-6d3a6859-869f-4257-8d3e-e11bd8edbc3a tempest-VolumesAdminNegativeTest-1360110517 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:18:29 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-6d3a6859-869f-4257-8d3e-e11bd8edbc3a tempest-VolumesAdminNegativeTest-1360110517 None] Created reservations ['8c225527-f9ab-4001-ae44-bc8c08bdacc0', 'e80a70c9-72da-4b01-a01d-8b13deaf195e', '278d6a0c-b24e-42df-bae4-b6acea7aa367', 'bfc60c2c-36ab-4f8e-be39-ef7d459681bb'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:18:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-6d3a6859-869f-4257-8d3e-e11bd8edbc3a tempest-VolumesAdminNegativeTest-1360110517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:18:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-6d3a6859-869f-4257-8d3e-e11bd8edbc3a tempest-VolumesAdminNegativeTest-1360110517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:18:29 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-6d3a6859-869f-4257-8d3e-e11bd8edbc3a tempest-VolumesAdminNegativeTest-1360110517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:18:29 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-6d3a6859-869f-4257-8d3e-e11bd8edbc3a tempest-VolumesAdminNegativeTest-1360110517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:18:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-6d3a6859-869f-4257-8d3e-e11bd8edbc3a tempest-VolumesAdminNegativeTest-1360110517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:18:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6d3a6859-869f-4257-8d3e-e11bd8edbc3a tempest-VolumesAdminNegativeTest-1360110517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:18:29 devstack sudo[88877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:18:29 devstack sudo[88877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:18:29 devstack sudo[88868]: pam_unix(sudo:session): session closed for user root Jul 07 17:18:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e90937bd-d9ce-4bf7-86a5-802a8f9f03c8 tempest-ServersNegativeTestJSON-1847641353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32cdee86-6536-4256-ae92-efca38bcea9b 1073741824" returned: 0 in 1.658s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:18:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e90937bd-d9ce-4bf7-86a5-802a8f9f03c8 tempest-ServersNegativeTestJSON-1847641353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32cdee86-6536-4256-ae92-efca38bcea9b {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:18:29 devstack sudo[88880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32cdee86-6536-4256-ae92-efca38bcea9b Jul 07 17:18:29 devstack sudo[88880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:18:30 devstack sudo[88877]: pam_unix(sudo:session): session closed for user root Jul 07 17:18:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6d3a6859-869f-4257-8d3e-e11bd8edbc3a tempest-VolumesAdminNegativeTest-1360110517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 1.277s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:18:30 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-6d3a6859-869f-4257-8d3e-e11bd8edbc3a tempest-VolumesAdminNegativeTest-1360110517 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:18:30 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-6d3a6859-869f-4257-8d3e-e11bd8edbc3a tempest-VolumesAdminNegativeTest-1360110517 None] Deleted volume successfully. Jul 07 17:18:30 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6d3a6859-869f-4257-8d3e-e11bd8edbc3a tempest-VolumesAdminNegativeTest-1360110517 None] Lock "cinder-2bafc103-9554-45bf-bff1-82fb5ab0e137-delete_volume" released by "delete_volume" :: held 4.301s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:18:30 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-4bc87797-a41d-4c89-8e88-609b2bdfc82f tempest-DeleteServersTestJSON-1503134396 None] Acquiring lock "cinder-8961acd4-59e2-4bfd-a8dc-529b68c4ce53-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:18:30 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-4bc87797-a41d-4c89-8e88-609b2bdfc82f tempest-DeleteServersTestJSON-1503134396 None] Lock "cinder-8961acd4-59e2-4bfd-a8dc-529b68c4ce53-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:18:30 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-4bc87797-a41d-4c89-8e88-609b2bdfc82f tempest-DeleteServersTestJSON-1503134396 None] Acquiring lock "cinder-quobyte-8961acd4-59e2-4bfd-a8dc-529b68c4ce53" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:18:30 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-4bc87797-a41d-4c89-8e88-609b2bdfc82f tempest-DeleteServersTestJSON-1503134396 None] Lock "cinder-quobyte-8961acd4-59e2-4bfd-a8dc-529b68c4ce53" acquired by "delete_volume" :: waited 0.024s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:18:30 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08f6dec-79f0-481c-9e0b-56a471fcc29a]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:18:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4bc87797-a41d-4c89-8e88-609b2bdfc82f tempest-DeleteServersTestJSON-1503134396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8961acd4-59e2-4bfd-a8dc-529b68c4ce53 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:18:31 devstack sudo[88880]: pam_unix(sudo:session): session closed for user root Jul 07 17:18:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e90937bd-d9ce-4bf7-86a5-802a8f9f03c8 tempest-ServersNegativeTestJSON-1847641353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32cdee86-6536-4256-ae92-efca38bcea9b" returned: 0 in 1.486s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:18:31 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-e90937bd-d9ce-4bf7-86a5-802a8f9f03c8 tempest-ServersNegativeTestJSON-1847641353 None] <== create_volume: return (3216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:18:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e90937bd-d9ce-4bf7-86a5-802a8f9f03c8 tempest-ServersNegativeTestJSON-1847641353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.221s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:18:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e90937bd-d9ce-4bf7-86a5-802a8f9f03c8 tempest-ServersNegativeTestJSON-1847641353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4be5c18a-dfe2-484a-9cb5-0f88053c2910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32cdee86-6536-4256-ae92-efca38bcea9b', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:18:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e90937bd-d9ce-4bf7-86a5-802a8f9f03c8 tempest-ServersNegativeTestJSON-1847641353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1a95cdf-4310-4e09-88f8-40caf7b67981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:18:31 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-e90937bd-d9ce-4bf7-86a5-802a8f9f03c8 tempest-ServersNegativeTestJSON-1847641353 None] Volume volume-32cdee86-6536-4256-ae92-efca38bcea9b (32cdee86-6536-4256-ae92-efca38bcea9b): created successfully Jul 07 17:18:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e90937bd-d9ce-4bf7-86a5-802a8f9f03c8 tempest-ServersNegativeTestJSON-1847641353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1a95cdf-4310-4e09-88f8-40caf7b67981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:18:31 devstack sudo[88910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8961acd4-59e2-4bfd-a8dc-529b68c4ce53 Jul 07 17:18:31 devstack sudo[88910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:18:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e90937bd-d9ce-4bf7-86a5-802a8f9f03c8 tempest-ServersNegativeTestJSON-1847641353 None] Flow 'volume_create_manager' (364150b8-001a-4f2c-a545-e25f0c2020eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:18:31 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-e90937bd-d9ce-4bf7-86a5-802a8f9f03c8 tempest-ServersNegativeTestJSON-1847641353 None] Created volume successfully. Jul 07 17:18:31 devstack sudo[88910]: pam_unix(sudo:session): session closed for user root Jul 07 17:18:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4bc87797-a41d-4c89-8e88-609b2bdfc82f tempest-DeleteServersTestJSON-1503134396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8961acd4-59e2-4bfd-a8dc-529b68c4ce53" returned: 0 in 0.877s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:18:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4bc87797-a41d-4c89-8e88-609b2bdfc82f tempest-DeleteServersTestJSON-1503134396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8961acd4-59e2-4bfd-a8dc-529b68c4ce53 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:18:31 devstack sudo[88920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8961acd4-59e2-4bfd-a8dc-529b68c4ce53 Jul 07 17:18:31 devstack sudo[88920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:18:32 devstack sudo[88920]: pam_unix(sudo:session): session closed for user root Jul 07 17:18:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4bc87797-a41d-4c89-8e88-609b2bdfc82f tempest-DeleteServersTestJSON-1503134396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8961acd4-59e2-4bfd-a8dc-529b68c4ce53" returned: 0 in 1.020s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:18:32 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-4bc87797-a41d-4c89-8e88-609b2bdfc82f tempest-DeleteServersTestJSON-1503134396 None] Lock "cinder-quobyte-8961acd4-59e2-4bfd-a8dc-529b68c4ce53" released by "delete_volume" :: held 1.965s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:18:32 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-4bc87797-a41d-4c89-8e88-609b2bdfc82f tempest-DeleteServersTestJSON-1503134396 None] Created reservations ['cf595f92-1dc7-4beb-84da-c0f4952d1812', '171f666e-1618-40a1-b57a-ac4f5fed8605', 'f391cbe9-cf16-4a19-833a-da9378b4a355', 'f2d9eacd-1dcf-42ae-9e42-21c4795fd20c'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:18:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4bc87797-a41d-4c89-8e88-609b2bdfc82f tempest-DeleteServersTestJSON-1503134396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:18:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4bc87797-a41d-4c89-8e88-609b2bdfc82f tempest-DeleteServersTestJSON-1503134396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:18:33 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-4bc87797-a41d-4c89-8e88-609b2bdfc82f tempest-DeleteServersTestJSON-1503134396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:18:33 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-4bc87797-a41d-4c89-8e88-609b2bdfc82f tempest-DeleteServersTestJSON-1503134396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:18:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4bc87797-a41d-4c89-8e88-609b2bdfc82f tempest-DeleteServersTestJSON-1503134396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:18:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4bc87797-a41d-4c89-8e88-609b2bdfc82f tempest-DeleteServersTestJSON-1503134396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:18:33 devstack sudo[88938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:18:33 devstack sudo[88938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:18:34 devstack sudo[88938]: pam_unix(sudo:session): session closed for user root Jul 07 17:18:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4bc87797-a41d-4c89-8e88-609b2bdfc82f tempest-DeleteServersTestJSON-1503134396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 1.022s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:18:34 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-4bc87797-a41d-4c89-8e88-609b2bdfc82f tempest-DeleteServersTestJSON-1503134396 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:18:34 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-4bc87797-a41d-4c89-8e88-609b2bdfc82f tempest-DeleteServersTestJSON-1503134396 None] Deleted volume successfully. Jul 07 17:18:34 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-4bc87797-a41d-4c89-8e88-609b2bdfc82f tempest-DeleteServersTestJSON-1503134396 None] Lock "cinder-8961acd4-59e2-4bfd-a8dc-529b68c4ce53-delete_volume" released by "delete_volume" :: held 3.298s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:18:34 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfe5006b-a03d-4c1c-8ce9-3ee24d0087ae tempest-ServersNegativeTestJSON-1847641353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:18:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-dfe5006b-a03d-4c1c-8ce9-3ee24d0087ae tempest-ServersNegativeTestJSON-1847641353 None] Flow 'volume_create_manager' (e93ec4c3-914c-4b76-8120-4d2d0287279a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:18:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-dfe5006b-a03d-4c1c-8ce9-3ee24d0087ae tempest-ServersNegativeTestJSON-1847641353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53ffc8f0-b2fc-4dc0-9a3b-2bdb860ad7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:18:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-dfe5006b-a03d-4c1c-8ce9-3ee24d0087ae tempest-ServersNegativeTestJSON-1847641353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53ffc8f0-b2fc-4dc0-9a3b-2bdb860ad7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2124746842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a81ae565-43a3-4b12-a6a3-abb280750ccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05801c58efc34449967c4c77a45a2e0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:18:34Z,use_quota=True,user_id='16d5793f04394ed2bea96e8a0a805b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:18:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-dfe5006b-a03d-4c1c-8ce9-3ee24d0087ae tempest-ServersNegativeTestJSON-1847641353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8dbefbb-37b6-4822-89ad-73199bada6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:18:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-dfe5006b-a03d-4c1c-8ce9-3ee24d0087ae tempest-ServersNegativeTestJSON-1847641353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8dbefbb-37b6-4822-89ad-73199bada6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:18:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-dfe5006b-a03d-4c1c-8ce9-3ee24d0087ae tempest-ServersNegativeTestJSON-1847641353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5687e7ad-1f98-4128-a6f8-d624cc6ebb9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:18:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-dfe5006b-a03d-4c1c-8ce9-3ee24d0087ae tempest-ServersNegativeTestJSON-1847641353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5687e7ad-1f98-4128-a6f8-d624cc6ebb9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a81ae565-43a3-4b12-a6a3-abb280750ccb', 'volume_name': 'volume-a81ae565-43a3-4b12-a6a3-abb280750ccb', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:18:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-dfe5006b-a03d-4c1c-8ce9-3ee24d0087ae tempest-ServersNegativeTestJSON-1847641353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (099acf5f-6621-4b76-82c5-cc2d735bc9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:18:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-dfe5006b-a03d-4c1c-8ce9-3ee24d0087ae tempest-ServersNegativeTestJSON-1847641353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (099acf5f-6621-4b76-82c5-cc2d735bc9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:18:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-dfe5006b-a03d-4c1c-8ce9-3ee24d0087ae tempest-ServersNegativeTestJSON-1847641353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (300ef0d9-3cae-49ce-9970-7fdc8a266196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:18:34 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-dfe5006b-a03d-4c1c-8ce9-3ee24d0087ae tempest-ServersNegativeTestJSON-1847641353 None] Volume a81ae565-43a3-4b12-a6a3-abb280750ccb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a81ae565-43a3-4b12-a6a3-abb280750ccb', 'volume_size': 1} Jul 07 17:18:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-dfe5006b-a03d-4c1c-8ce9-3ee24d0087ae tempest-ServersNegativeTestJSON-1847641353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:18:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-dfe5006b-a03d-4c1c-8ce9-3ee24d0087ae tempest-ServersNegativeTestJSON-1847641353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:18:34 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-dfe5006b-a03d-4c1c-8ce9-3ee24d0087ae tempest-ServersNegativeTestJSON-1847641353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2124746842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a81ae565-43a3-4b12-a6a3-abb280750ccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05801c58efc34449967c4c77a45a2e0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:18:34Z,use_quota=True,user_id='16d5793f04394ed2bea96e8a0a805b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:18:34 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-dfe5006b-a03d-4c1c-8ce9-3ee24d0087ae tempest-ServersNegativeTestJSON-1847641353 None] Creating volume a81ae565-43a3-4b12-a6a3-abb280750ccb {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:18:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-dfe5006b-a03d-4c1c-8ce9-3ee24d0087ae tempest-ServersNegativeTestJSON-1847641353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:18:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-dfe5006b-a03d-4c1c-8ce9-3ee24d0087ae tempest-ServersNegativeTestJSON-1847641353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:18:34 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-dfe5006b-a03d-4c1c-8ce9-3ee24d0087ae tempest-ServersNegativeTestJSON-1847641353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:18:34 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-dfe5006b-a03d-4c1c-8ce9-3ee24d0087ae tempest-ServersNegativeTestJSON-1847641353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:18:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-dfe5006b-a03d-4c1c-8ce9-3ee24d0087ae tempest-ServersNegativeTestJSON-1847641353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:18:34 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-dfe5006b-a03d-4c1c-8ce9-3ee24d0087ae tempest-ServersNegativeTestJSON-1847641353 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:18:34 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-dfe5006b-a03d-4c1c-8ce9-3ee24d0087ae tempest-ServersNegativeTestJSON-1847641353 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:18:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-dfe5006b-a03d-4c1c-8ce9-3ee24d0087ae tempest-ServersNegativeTestJSON-1847641353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a81ae565-43a3-4b12-a6a3-abb280750ccb 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:18:34 devstack sudo[88946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a81ae565-43a3-4b12-a6a3-abb280750ccb 1073741824 Jul 07 17:18:34 devstack sudo[88946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:18:35 devstack sudo[88946]: pam_unix(sudo:session): session closed for user root Jul 07 17:18:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-dfe5006b-a03d-4c1c-8ce9-3ee24d0087ae tempest-ServersNegativeTestJSON-1847641353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a81ae565-43a3-4b12-a6a3-abb280750ccb 1073741824" returned: 0 in 1.136s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:18:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-dfe5006b-a03d-4c1c-8ce9-3ee24d0087ae tempest-ServersNegativeTestJSON-1847641353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a81ae565-43a3-4b12-a6a3-abb280750ccb {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:18:35 devstack sudo[88953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a81ae565-43a3-4b12-a6a3-abb280750ccb Jul 07 17:18:35 devstack sudo[88953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:18:36 devstack sudo[88953]: pam_unix(sudo:session): session closed for user root Jul 07 17:18:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-dfe5006b-a03d-4c1c-8ce9-3ee24d0087ae tempest-ServersNegativeTestJSON-1847641353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a81ae565-43a3-4b12-a6a3-abb280750ccb" returned: 0 in 0.944s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:18:36 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-dfe5006b-a03d-4c1c-8ce9-3ee24d0087ae tempest-ServersNegativeTestJSON-1847641353 None] <== create_volume: return (2168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:18:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-dfe5006b-a03d-4c1c-8ce9-3ee24d0087ae tempest-ServersNegativeTestJSON-1847641353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.170s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:18:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-dfe5006b-a03d-4c1c-8ce9-3ee24d0087ae tempest-ServersNegativeTestJSON-1847641353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (300ef0d9-3cae-49ce-9970-7fdc8a266196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a81ae565-43a3-4b12-a6a3-abb280750ccb', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:18:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-dfe5006b-a03d-4c1c-8ce9-3ee24d0087ae tempest-ServersNegativeTestJSON-1847641353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28174d24-af06-4081-a434-3b68f9b9f6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:18:36 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-dfe5006b-a03d-4c1c-8ce9-3ee24d0087ae tempest-ServersNegativeTestJSON-1847641353 None] Volume volume-a81ae565-43a3-4b12-a6a3-abb280750ccb (a81ae565-43a3-4b12-a6a3-abb280750ccb): created successfully Jul 07 17:18:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-dfe5006b-a03d-4c1c-8ce9-3ee24d0087ae tempest-ServersNegativeTestJSON-1847641353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28174d24-af06-4081-a434-3b68f9b9f6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:18:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-dfe5006b-a03d-4c1c-8ce9-3ee24d0087ae tempest-ServersNegativeTestJSON-1847641353 None] Flow 'volume_create_manager' (e93ec4c3-914c-4b76-8120-4d2d0287279a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:18:36 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-dfe5006b-a03d-4c1c-8ce9-3ee24d0087ae tempest-ServersNegativeTestJSON-1847641353 None] Created volume successfully. Jul 07 17:18:39 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-981d8d2a-98b9-4bda-9027-bee2cab26adb tempest-ServersNegativeTestJSON-1847641353 None] Acquiring lock "cinder-a81ae565-43a3-4b12-a6a3-abb280750ccb-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:18:39 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-981d8d2a-98b9-4bda-9027-bee2cab26adb tempest-ServersNegativeTestJSON-1847641353 None] Lock "cinder-a81ae565-43a3-4b12-a6a3-abb280750ccb-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:18:39 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-981d8d2a-98b9-4bda-9027-bee2cab26adb tempest-ServersNegativeTestJSON-1847641353 None] Acquiring lock "cinder-quobyte-a81ae565-43a3-4b12-a6a3-abb280750ccb" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:18:39 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-981d8d2a-98b9-4bda-9027-bee2cab26adb tempest-ServersNegativeTestJSON-1847641353 None] Lock "cinder-quobyte-a81ae565-43a3-4b12-a6a3-abb280750ccb" acquired by "delete_volume" :: waited 0.019s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:18:39 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4242c320-54da-46b4-8237-1388f589a009]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:18:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-981d8d2a-98b9-4bda-9027-bee2cab26adb tempest-ServersNegativeTestJSON-1847641353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a81ae565-43a3-4b12-a6a3-abb280750ccb {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:18:39 devstack sudo[88974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a81ae565-43a3-4b12-a6a3-abb280750ccb Jul 07 17:18:39 devstack sudo[88974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:18:40 devstack sudo[88974]: pam_unix(sudo:session): session closed for user root Jul 07 17:18:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-981d8d2a-98b9-4bda-9027-bee2cab26adb tempest-ServersNegativeTestJSON-1847641353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a81ae565-43a3-4b12-a6a3-abb280750ccb" returned: 0 in 1.007s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:18:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-981d8d2a-98b9-4bda-9027-bee2cab26adb tempest-ServersNegativeTestJSON-1847641353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a81ae565-43a3-4b12-a6a3-abb280750ccb {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:18:40 devstack sudo[88980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a81ae565-43a3-4b12-a6a3-abb280750ccb Jul 07 17:18:40 devstack sudo[88980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:18:41 devstack sudo[88980]: pam_unix(sudo:session): session closed for user root Jul 07 17:18:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-981d8d2a-98b9-4bda-9027-bee2cab26adb tempest-ServersNegativeTestJSON-1847641353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a81ae565-43a3-4b12-a6a3-abb280750ccb" returned: 0 in 1.334s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:18:41 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-981d8d2a-98b9-4bda-9027-bee2cab26adb tempest-ServersNegativeTestJSON-1847641353 None] Lock "cinder-quobyte-a81ae565-43a3-4b12-a6a3-abb280750ccb" released by "delete_volume" :: held 2.401s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:18:42 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-981d8d2a-98b9-4bda-9027-bee2cab26adb tempest-ServersNegativeTestJSON-1847641353 None] Created reservations ['5b9be480-6c81-4b66-8cbf-f1e4ffe80bb0', 'b802641d-911e-4d71-95a3-a61098114472', '58d418f5-0af0-44b6-ba40-75854d50c5c5', '82920897-a1da-464c-812d-58c3ac8f3788'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:18:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-981d8d2a-98b9-4bda-9027-bee2cab26adb tempest-ServersNegativeTestJSON-1847641353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:18:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-981d8d2a-98b9-4bda-9027-bee2cab26adb tempest-ServersNegativeTestJSON-1847641353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:18:42 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-981d8d2a-98b9-4bda-9027-bee2cab26adb tempest-ServersNegativeTestJSON-1847641353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:18:42 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-981d8d2a-98b9-4bda-9027-bee2cab26adb tempest-ServersNegativeTestJSON-1847641353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:18:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-981d8d2a-98b9-4bda-9027-bee2cab26adb tempest-ServersNegativeTestJSON-1847641353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:18:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-981d8d2a-98b9-4bda-9027-bee2cab26adb tempest-ServersNegativeTestJSON-1847641353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:18:42 devstack sudo[88990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:18:42 devstack sudo[88990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:18:42 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-972e4004-365f-459e-882c-f830d05b9170 tempest-ServersNegativeTestJSON-1847641353 None] Acquiring lock "cinder-32cdee86-6536-4256-ae92-efca38bcea9b-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:18:42 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-972e4004-365f-459e-882c-f830d05b9170 tempest-ServersNegativeTestJSON-1847641353 None] Lock "cinder-32cdee86-6536-4256-ae92-efca38bcea9b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:18:43 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-972e4004-365f-459e-882c-f830d05b9170 tempest-ServersNegativeTestJSON-1847641353 None] Acquiring lock "cinder-quobyte-32cdee86-6536-4256-ae92-efca38bcea9b" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:18:43 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-972e4004-365f-459e-882c-f830d05b9170 tempest-ServersNegativeTestJSON-1847641353 None] Lock "cinder-quobyte-32cdee86-6536-4256-ae92-efca38bcea9b" acquired by "delete_volume" :: waited 0.024s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:18:43 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[62154a74-db7f-477f-a613-78b085a2d825]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:18:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-972e4004-365f-459e-882c-f830d05b9170 tempest-ServersNegativeTestJSON-1847641353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32cdee86-6536-4256-ae92-efca38bcea9b {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:18:43 devstack sudo[88990]: pam_unix(sudo:session): session closed for user root Jul 07 17:18:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-981d8d2a-98b9-4bda-9027-bee2cab26adb tempest-ServersNegativeTestJSON-1847641353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 1.008s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:18:43 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-981d8d2a-98b9-4bda-9027-bee2cab26adb tempest-ServersNegativeTestJSON-1847641353 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:18:43 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-981d8d2a-98b9-4bda-9027-bee2cab26adb tempest-ServersNegativeTestJSON-1847641353 None] Deleted volume successfully. Jul 07 17:18:43 devstack sudo[88994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32cdee86-6536-4256-ae92-efca38bcea9b Jul 07 17:18:43 devstack sudo[88994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:18:43 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-981d8d2a-98b9-4bda-9027-bee2cab26adb tempest-ServersNegativeTestJSON-1847641353 None] Lock "cinder-a81ae565-43a3-4b12-a6a3-abb280750ccb-delete_volume" released by "delete_volume" :: held 3.836s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:18:43 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:18:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:18:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:18:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:18:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:18:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:18:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:18:43 devstack sudo[88996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:18:43 devstack sudo[88996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:18:44 devstack sudo[88996]: pam_unix(sudo:session): session closed for user root Jul 07 17:18:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.837s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:18:44 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:18:44 devstack sudo[88994]: pam_unix(sudo:session): session closed for user root Jul 07 17:18:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-972e4004-365f-459e-882c-f830d05b9170 tempest-ServersNegativeTestJSON-1847641353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32cdee86-6536-4256-ae92-efca38bcea9b" returned: 0 in 1.083s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:18:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-972e4004-365f-459e-882c-f830d05b9170 tempest-ServersNegativeTestJSON-1847641353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32cdee86-6536-4256-ae92-efca38bcea9b {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:18:44 devstack sudo[89004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32cdee86-6536-4256-ae92-efca38bcea9b Jul 07 17:18:44 devstack sudo[89004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:18:45 devstack sudo[89004]: pam_unix(sudo:session): session closed for user root Jul 07 17:18:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-972e4004-365f-459e-882c-f830d05b9170 tempest-ServersNegativeTestJSON-1847641353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32cdee86-6536-4256-ae92-efca38bcea9b" returned: 0 in 0.879s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:18:45 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-972e4004-365f-459e-882c-f830d05b9170 tempest-ServersNegativeTestJSON-1847641353 None] Lock "cinder-quobyte-32cdee86-6536-4256-ae92-efca38bcea9b" released by "delete_volume" :: held 2.034s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:18:45 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-972e4004-365f-459e-882c-f830d05b9170 tempest-ServersNegativeTestJSON-1847641353 None] Created reservations ['9400944e-8ae9-4b48-8e83-e9dd28b305b7', '4c341a9d-83d6-4375-a051-8a86b235b0a3', 'f3921c53-e30f-42a2-8d45-6db507923151', '1936f35b-bda7-43dd-a1b6-b8ba870b6ae1'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:18:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-972e4004-365f-459e-882c-f830d05b9170 tempest-ServersNegativeTestJSON-1847641353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:18:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-972e4004-365f-459e-882c-f830d05b9170 tempest-ServersNegativeTestJSON-1847641353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:18:45 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-972e4004-365f-459e-882c-f830d05b9170 tempest-ServersNegativeTestJSON-1847641353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:18:45 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-972e4004-365f-459e-882c-f830d05b9170 tempest-ServersNegativeTestJSON-1847641353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:18:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-972e4004-365f-459e-882c-f830d05b9170 tempest-ServersNegativeTestJSON-1847641353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:18:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-972e4004-365f-459e-882c-f830d05b9170 tempest-ServersNegativeTestJSON-1847641353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:18:45 devstack sudo[89009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:18:45 devstack sudo[89009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:18:46 devstack sudo[89009]: pam_unix(sudo:session): session closed for user root Jul 07 17:18:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-972e4004-365f-459e-882c-f830d05b9170 tempest-ServersNegativeTestJSON-1847641353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.816s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:18:46 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-972e4004-365f-459e-882c-f830d05b9170 tempest-ServersNegativeTestJSON-1847641353 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:18:46 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-972e4004-365f-459e-882c-f830d05b9170 tempest-ServersNegativeTestJSON-1847641353 None] Deleted volume successfully. Jul 07 17:18:46 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-972e4004-365f-459e-882c-f830d05b9170 tempest-ServersNegativeTestJSON-1847641353 None] Lock "cinder-32cdee86-6536-4256-ae92-efca38bcea9b-delete_volume" released by "delete_volume" :: held 3.194s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:18:55 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:SELECT=30,cinder:UPDATE=42,cinder:INSERT=12,cinder:DELETE=2 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:18:56 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:SELECT=38,cinder:UPDATE=47,cinder:DELETE=5,cinder:INSERT=7 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:19:26 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-67c5d65d-59fe-4d46-a85d-5a99feb73483 tempest-TaggedAttachmentsTest-571150945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:19:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-67c5d65d-59fe-4d46-a85d-5a99feb73483 tempest-TaggedAttachmentsTest-571150945 None] Flow 'volume_create_manager' (74c0d871-5b5e-4112-990f-4cce720d9742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:19:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-67c5d65d-59fe-4d46-a85d-5a99feb73483 tempest-TaggedAttachmentsTest-571150945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d9bbd2b-cbbd-460e-b43b-be183037e536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:19:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-67c5d65d-59fe-4d46-a85d-5a99feb73483 tempest-TaggedAttachmentsTest-571150945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d9bbd2b-cbbd-460e-b43b-be183037e536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1788093250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=858be2b7-2b7c-45d1-8367-a828e776c81a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b92092c249974bad9e4fc160bf616ee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:19:27Z,use_quota=True,user_id='18af869c03d24633a4dd4fa5570fe9ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:19:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-67c5d65d-59fe-4d46-a85d-5a99feb73483 tempest-TaggedAttachmentsTest-571150945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01327bae-4ac3-4383-a9e0-2a7137484837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:19:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-67c5d65d-59fe-4d46-a85d-5a99feb73483 tempest-TaggedAttachmentsTest-571150945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01327bae-4ac3-4383-a9e0-2a7137484837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:19:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-67c5d65d-59fe-4d46-a85d-5a99feb73483 tempest-TaggedAttachmentsTest-571150945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2e3c841-f668-4911-b45e-aed23a5127a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:19:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-67c5d65d-59fe-4d46-a85d-5a99feb73483 tempest-TaggedAttachmentsTest-571150945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2e3c841-f668-4911-b45e-aed23a5127a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '858be2b7-2b7c-45d1-8367-a828e776c81a', 'volume_name': 'volume-858be2b7-2b7c-45d1-8367-a828e776c81a', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:19:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-67c5d65d-59fe-4d46-a85d-5a99feb73483 tempest-TaggedAttachmentsTest-571150945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25609417-bb95-472e-a2cf-dc78d8ea3c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:19:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-67c5d65d-59fe-4d46-a85d-5a99feb73483 tempest-TaggedAttachmentsTest-571150945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25609417-bb95-472e-a2cf-dc78d8ea3c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:19:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-67c5d65d-59fe-4d46-a85d-5a99feb73483 tempest-TaggedAttachmentsTest-571150945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80d82799-d986-4415-8f33-0e931c1ef033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:19:26 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-67c5d65d-59fe-4d46-a85d-5a99feb73483 tempest-TaggedAttachmentsTest-571150945 None] Volume 858be2b7-2b7c-45d1-8367-a828e776c81a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-858be2b7-2b7c-45d1-8367-a828e776c81a', 'volume_size': 1} Jul 07 17:19:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-67c5d65d-59fe-4d46-a85d-5a99feb73483 tempest-TaggedAttachmentsTest-571150945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:19:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-67c5d65d-59fe-4d46-a85d-5a99feb73483 tempest-TaggedAttachmentsTest-571150945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:19:26 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-67c5d65d-59fe-4d46-a85d-5a99feb73483 tempest-TaggedAttachmentsTest-571150945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1788093250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=858be2b7-2b7c-45d1-8367-a828e776c81a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b92092c249974bad9e4fc160bf616ee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:19:27Z,use_quota=True,user_id='18af869c03d24633a4dd4fa5570fe9ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:19:26 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-67c5d65d-59fe-4d46-a85d-5a99feb73483 tempest-TaggedAttachmentsTest-571150945 None] Creating volume 858be2b7-2b7c-45d1-8367-a828e776c81a {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:19:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-67c5d65d-59fe-4d46-a85d-5a99feb73483 tempest-TaggedAttachmentsTest-571150945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:19:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-67c5d65d-59fe-4d46-a85d-5a99feb73483 tempest-TaggedAttachmentsTest-571150945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:19:26 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-67c5d65d-59fe-4d46-a85d-5a99feb73483 tempest-TaggedAttachmentsTest-571150945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:19:27 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-67c5d65d-59fe-4d46-a85d-5a99feb73483 tempest-TaggedAttachmentsTest-571150945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:19:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-67c5d65d-59fe-4d46-a85d-5a99feb73483 tempest-TaggedAttachmentsTest-571150945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:19:27 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-67c5d65d-59fe-4d46-a85d-5a99feb73483 tempest-TaggedAttachmentsTest-571150945 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:19:27 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-67c5d65d-59fe-4d46-a85d-5a99feb73483 tempest-TaggedAttachmentsTest-571150945 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:19:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-67c5d65d-59fe-4d46-a85d-5a99feb73483 tempest-TaggedAttachmentsTest-571150945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-858be2b7-2b7c-45d1-8367-a828e776c81a 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:19:27 devstack sudo[89326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-858be2b7-2b7c-45d1-8367-a828e776c81a 1073741824 Jul 07 17:19:27 devstack sudo[89326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:19:28 devstack sudo[89326]: pam_unix(sudo:session): session closed for user root Jul 07 17:19:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-67c5d65d-59fe-4d46-a85d-5a99feb73483 tempest-TaggedAttachmentsTest-571150945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-858be2b7-2b7c-45d1-8367-a828e776c81a 1073741824" returned: 0 in 1.454s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:19:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-67c5d65d-59fe-4d46-a85d-5a99feb73483 tempest-TaggedAttachmentsTest-571150945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-858be2b7-2b7c-45d1-8367-a828e776c81a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:19:28 devstack sudo[89334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-858be2b7-2b7c-45d1-8367-a828e776c81a Jul 07 17:19:28 devstack sudo[89334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:19:29 devstack sudo[89334]: pam_unix(sudo:session): session closed for user root Jul 07 17:19:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-67c5d65d-59fe-4d46-a85d-5a99feb73483 tempest-TaggedAttachmentsTest-571150945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-858be2b7-2b7c-45d1-8367-a828e776c81a" returned: 0 in 1.179s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:19:29 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-67c5d65d-59fe-4d46-a85d-5a99feb73483 tempest-TaggedAttachmentsTest-571150945 None] <== create_volume: return (2694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:19:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-67c5d65d-59fe-4d46-a85d-5a99feb73483 tempest-TaggedAttachmentsTest-571150945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.700s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:19:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-67c5d65d-59fe-4d46-a85d-5a99feb73483 tempest-TaggedAttachmentsTest-571150945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80d82799-d986-4415-8f33-0e931c1ef033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-858be2b7-2b7c-45d1-8367-a828e776c81a', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:19:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-67c5d65d-59fe-4d46-a85d-5a99feb73483 tempest-TaggedAttachmentsTest-571150945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecdad870-1039-41c9-bf75-e23584eadffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:19:29 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-67c5d65d-59fe-4d46-a85d-5a99feb73483 tempest-TaggedAttachmentsTest-571150945 None] Volume volume-858be2b7-2b7c-45d1-8367-a828e776c81a (858be2b7-2b7c-45d1-8367-a828e776c81a): created successfully Jul 07 17:19:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-67c5d65d-59fe-4d46-a85d-5a99feb73483 tempest-TaggedAttachmentsTest-571150945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecdad870-1039-41c9-bf75-e23584eadffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:19:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-67c5d65d-59fe-4d46-a85d-5a99feb73483 tempest-TaggedAttachmentsTest-571150945 None] Flow 'volume_create_manager' (74c0d871-5b5e-4112-990f-4cce720d9742) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:19:29 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-67c5d65d-59fe-4d46-a85d-5a99feb73483 tempest-TaggedAttachmentsTest-571150945 None] Created volume successfully. Jul 07 17:19:34 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-b054a63b-b02e-4ca1-b718-65c367f1428b tempest-ServerRescueNegativeTestJSON-1330249889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:19:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b054a63b-b02e-4ca1-b718-65c367f1428b tempest-ServerRescueNegativeTestJSON-1330249889 None] Flow 'volume_create_manager' (19de29fe-0b2f-4eb1-99df-cfa992b2ce7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:19:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b054a63b-b02e-4ca1-b718-65c367f1428b tempest-ServerRescueNegativeTestJSON-1330249889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62aa1278-c31d-4aa6-9075-68fb9e683b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:19:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b054a63b-b02e-4ca1-b718-65c367f1428b tempest-ServerRescueNegativeTestJSON-1330249889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62aa1278-c31d-4aa6-9075-68fb9e683b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-175624115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e93999bf-f277-4f3a-95dc-ef4a341d34ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b7b9329af37476194222115fef0657e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:19:34Z,use_quota=True,user_id='62cebea488f945d3bef1ed129e3aea1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:19:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b054a63b-b02e-4ca1-b718-65c367f1428b tempest-ServerRescueNegativeTestJSON-1330249889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d985bb17-f1d6-413f-bf5e-23d579bb6fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:19:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b054a63b-b02e-4ca1-b718-65c367f1428b tempest-ServerRescueNegativeTestJSON-1330249889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d985bb17-f1d6-413f-bf5e-23d579bb6fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:19:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b054a63b-b02e-4ca1-b718-65c367f1428b tempest-ServerRescueNegativeTestJSON-1330249889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0757a0ed-9f5c-41a5-9dba-7927809ed102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:19:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b054a63b-b02e-4ca1-b718-65c367f1428b tempest-ServerRescueNegativeTestJSON-1330249889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0757a0ed-9f5c-41a5-9dba-7927809ed102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e93999bf-f277-4f3a-95dc-ef4a341d34ca', 'volume_name': 'volume-e93999bf-f277-4f3a-95dc-ef4a341d34ca', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:19:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b054a63b-b02e-4ca1-b718-65c367f1428b tempest-ServerRescueNegativeTestJSON-1330249889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (680a69e6-e678-4bf3-aac3-865d0f85ea49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:19:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b054a63b-b02e-4ca1-b718-65c367f1428b tempest-ServerRescueNegativeTestJSON-1330249889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (680a69e6-e678-4bf3-aac3-865d0f85ea49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:19:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b054a63b-b02e-4ca1-b718-65c367f1428b tempest-ServerRescueNegativeTestJSON-1330249889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cba1d7f-0049-49df-87c4-ab34d87dae2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:19:34 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-b054a63b-b02e-4ca1-b718-65c367f1428b tempest-ServerRescueNegativeTestJSON-1330249889 None] Volume e93999bf-f277-4f3a-95dc-ef4a341d34ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e93999bf-f277-4f3a-95dc-ef4a341d34ca', 'volume_size': 1} Jul 07 17:19:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b054a63b-b02e-4ca1-b718-65c367f1428b tempest-ServerRescueNegativeTestJSON-1330249889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:19:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b054a63b-b02e-4ca1-b718-65c367f1428b tempest-ServerRescueNegativeTestJSON-1330249889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:19:34 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b054a63b-b02e-4ca1-b718-65c367f1428b tempest-ServerRescueNegativeTestJSON-1330249889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-175624115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e93999bf-f277-4f3a-95dc-ef4a341d34ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b7b9329af37476194222115fef0657e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:19:34Z,use_quota=True,user_id='62cebea488f945d3bef1ed129e3aea1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:19:34 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-b054a63b-b02e-4ca1-b718-65c367f1428b tempest-ServerRescueNegativeTestJSON-1330249889 None] Creating volume e93999bf-f277-4f3a-95dc-ef4a341d34ca {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:19:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b054a63b-b02e-4ca1-b718-65c367f1428b tempest-ServerRescueNegativeTestJSON-1330249889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:19:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b054a63b-b02e-4ca1-b718-65c367f1428b tempest-ServerRescueNegativeTestJSON-1330249889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:19:34 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b054a63b-b02e-4ca1-b718-65c367f1428b tempest-ServerRescueNegativeTestJSON-1330249889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:19:34 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b054a63b-b02e-4ca1-b718-65c367f1428b tempest-ServerRescueNegativeTestJSON-1330249889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:19:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b054a63b-b02e-4ca1-b718-65c367f1428b tempest-ServerRescueNegativeTestJSON-1330249889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:19:34 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b054a63b-b02e-4ca1-b718-65c367f1428b tempest-ServerRescueNegativeTestJSON-1330249889 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:19:34 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-b054a63b-b02e-4ca1-b718-65c367f1428b tempest-ServerRescueNegativeTestJSON-1330249889 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:19:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b054a63b-b02e-4ca1-b718-65c367f1428b tempest-ServerRescueNegativeTestJSON-1330249889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e93999bf-f277-4f3a-95dc-ef4a341d34ca 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:19:34 devstack sudo[89363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e93999bf-f277-4f3a-95dc-ef4a341d34ca 1073741824 Jul 07 17:19:34 devstack sudo[89363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:19:35 devstack sudo[89363]: pam_unix(sudo:session): session closed for user root Jul 07 17:19:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b054a63b-b02e-4ca1-b718-65c367f1428b tempest-ServerRescueNegativeTestJSON-1330249889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e93999bf-f277-4f3a-95dc-ef4a341d34ca 1073741824" returned: 0 in 0.964s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:19:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b054a63b-b02e-4ca1-b718-65c367f1428b tempest-ServerRescueNegativeTestJSON-1330249889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e93999bf-f277-4f3a-95dc-ef4a341d34ca {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:19:35 devstack sudo[89370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e93999bf-f277-4f3a-95dc-ef4a341d34ca Jul 07 17:19:35 devstack sudo[89370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:19:36 devstack sudo[89370]: pam_unix(sudo:session): session closed for user root Jul 07 17:19:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b054a63b-b02e-4ca1-b718-65c367f1428b tempest-ServerRescueNegativeTestJSON-1330249889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e93999bf-f277-4f3a-95dc-ef4a341d34ca" returned: 0 in 0.813s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:19:36 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b054a63b-b02e-4ca1-b718-65c367f1428b tempest-ServerRescueNegativeTestJSON-1330249889 None] <== create_volume: return (1842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:19:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b054a63b-b02e-4ca1-b718-65c367f1428b tempest-ServerRescueNegativeTestJSON-1330249889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.846s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:19:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b054a63b-b02e-4ca1-b718-65c367f1428b tempest-ServerRescueNegativeTestJSON-1330249889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cba1d7f-0049-49df-87c4-ab34d87dae2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e93999bf-f277-4f3a-95dc-ef4a341d34ca', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:19:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b054a63b-b02e-4ca1-b718-65c367f1428b tempest-ServerRescueNegativeTestJSON-1330249889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ddac995-7f1c-426b-8175-f9dab50a2b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:19:36 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-b054a63b-b02e-4ca1-b718-65c367f1428b tempest-ServerRescueNegativeTestJSON-1330249889 None] Volume volume-e93999bf-f277-4f3a-95dc-ef4a341d34ca (e93999bf-f277-4f3a-95dc-ef4a341d34ca): created successfully Jul 07 17:19:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b054a63b-b02e-4ca1-b718-65c367f1428b tempest-ServerRescueNegativeTestJSON-1330249889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ddac995-7f1c-426b-8175-f9dab50a2b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:19:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b054a63b-b02e-4ca1-b718-65c367f1428b tempest-ServerRescueNegativeTestJSON-1330249889 None] Flow 'volume_create_manager' (19de29fe-0b2f-4eb1-99df-cfa992b2ce7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:19:36 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-b054a63b-b02e-4ca1-b718-65c367f1428b tempest-ServerRescueNegativeTestJSON-1330249889 None] Created volume successfully. Jul 07 17:19:43 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:19:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:19:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:19:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:19:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:19:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:19:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:19:43 devstack sudo[89402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:19:43 devstack sudo[89402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:19:44 devstack sudo[89402]: pam_unix(sudo:session): session closed for user root Jul 07 17:19:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.775s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:19:44 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:19:44 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:19:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread count: 8 {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:19:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread info: [<_MainThread(MainThread, started 126077716062336)>, , , , , , , ] {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:19:46 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:SELECT=3,cinder:UPDATE=6,cinder:INSERT=2 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:19:46 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:SELECT=5,cinder:UPDATE=6,cinder:DELETE=2 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:20:01 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-537a5fa7-0a00-4488-9e9a-7db88a1ea8fe tempest-ServerRescueNegativeTestJSON-1330249889 None] Acquiring lock "cinder-e93999bf-f277-4f3a-95dc-ef4a341d34ca-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:20:01 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-537a5fa7-0a00-4488-9e9a-7db88a1ea8fe tempest-ServerRescueNegativeTestJSON-1330249889 None] Lock "cinder-e93999bf-f277-4f3a-95dc-ef4a341d34ca-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:20:02 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-537a5fa7-0a00-4488-9e9a-7db88a1ea8fe tempest-ServerRescueNegativeTestJSON-1330249889 None] Acquiring lock "cinder-quobyte-e93999bf-f277-4f3a-95dc-ef4a341d34ca" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:20:02 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-537a5fa7-0a00-4488-9e9a-7db88a1ea8fe tempest-ServerRescueNegativeTestJSON-1330249889 None] Lock "cinder-quobyte-e93999bf-f277-4f3a-95dc-ef4a341d34ca" acquired by "delete_volume" :: waited 0.050s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:20:02 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a242ee43-570c-4478-bf4c-7ae0b81b427f]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:20:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-537a5fa7-0a00-4488-9e9a-7db88a1ea8fe tempest-ServerRescueNegativeTestJSON-1330249889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e93999bf-f277-4f3a-95dc-ef4a341d34ca {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:02 devstack sudo[89768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e93999bf-f277-4f3a-95dc-ef4a341d34ca Jul 07 17:20:02 devstack sudo[89768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:04 devstack sudo[89768]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-537a5fa7-0a00-4488-9e9a-7db88a1ea8fe tempest-ServerRescueNegativeTestJSON-1330249889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e93999bf-f277-4f3a-95dc-ef4a341d34ca" returned: 0 in 1.988s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-537a5fa7-0a00-4488-9e9a-7db88a1ea8fe tempest-ServerRescueNegativeTestJSON-1330249889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e93999bf-f277-4f3a-95dc-ef4a341d34ca {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:04 devstack sudo[89799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e93999bf-f277-4f3a-95dc-ef4a341d34ca Jul 07 17:20:04 devstack sudo[89799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:05 devstack sudo[89799]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-537a5fa7-0a00-4488-9e9a-7db88a1ea8fe tempest-ServerRescueNegativeTestJSON-1330249889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e93999bf-f277-4f3a-95dc-ef4a341d34ca" returned: 0 in 1.331s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:05 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-537a5fa7-0a00-4488-9e9a-7db88a1ea8fe tempest-ServerRescueNegativeTestJSON-1330249889 None] Lock "cinder-quobyte-e93999bf-f277-4f3a-95dc-ef4a341d34ca" released by "delete_volume" :: held 3.478s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:20:05 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-537a5fa7-0a00-4488-9e9a-7db88a1ea8fe tempest-ServerRescueNegativeTestJSON-1330249889 None] Created reservations ['00070b3f-a517-4bf0-9d5b-82acb425e5a1', '713724d2-5b65-4ec5-85b4-f86e4e3b70cc', '96a63719-da55-41ff-9413-5a2aa0b01ba8', '7f354da5-eb67-4e58-82cf-8efcd9257cc7'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:20:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-537a5fa7-0a00-4488-9e9a-7db88a1ea8fe tempest-ServerRescueNegativeTestJSON-1330249889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:20:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-537a5fa7-0a00-4488-9e9a-7db88a1ea8fe tempest-ServerRescueNegativeTestJSON-1330249889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:20:05 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-537a5fa7-0a00-4488-9e9a-7db88a1ea8fe tempest-ServerRescueNegativeTestJSON-1330249889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:20:05 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-537a5fa7-0a00-4488-9e9a-7db88a1ea8fe tempest-ServerRescueNegativeTestJSON-1330249889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:20:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-537a5fa7-0a00-4488-9e9a-7db88a1ea8fe tempest-ServerRescueNegativeTestJSON-1330249889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:20:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-537a5fa7-0a00-4488-9e9a-7db88a1ea8fe tempest-ServerRescueNegativeTestJSON-1330249889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:05 devstack sudo[89804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:20:05 devstack sudo[89804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:07 devstack sudo[89804]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-537a5fa7-0a00-4488-9e9a-7db88a1ea8fe tempest-ServerRescueNegativeTestJSON-1330249889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 1.174s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:07 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-537a5fa7-0a00-4488-9e9a-7db88a1ea8fe tempest-ServerRescueNegativeTestJSON-1330249889 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:20:07 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-537a5fa7-0a00-4488-9e9a-7db88a1ea8fe tempest-ServerRescueNegativeTestJSON-1330249889 None] Deleted volume successfully. Jul 07 17:20:07 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-537a5fa7-0a00-4488-9e9a-7db88a1ea8fe tempest-ServerRescueNegativeTestJSON-1330249889 None] Lock "cinder-e93999bf-f277-4f3a-95dc-ef4a341d34ca-delete_volume" released by "delete_volume" :: held 5.236s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:20:15 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:UPDATE=10,cinder:SELECT=3,cinder:INSERT=1 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:20:17 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:SELECT=7,cinder:INSERT=3,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:20:26 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b7e5bdb-c434-4701-90b2-2d29b995f8a4 tempest-AttachVolumeShelveTestJSON-1359496486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:20:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-1b7e5bdb-c434-4701-90b2-2d29b995f8a4 tempest-AttachVolumeShelveTestJSON-1359496486 None] Flow 'volume_create_manager' (24d829fd-297d-4921-bc83-61882c2c7fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:20:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-1b7e5bdb-c434-4701-90b2-2d29b995f8a4 tempest-AttachVolumeShelveTestJSON-1359496486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee22a6ce-8237-40d9-9931-65155047bd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-1b7e5bdb-c434-4701-90b2-2d29b995f8a4 tempest-AttachVolumeShelveTestJSON-1359496486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee22a6ce-8237-40d9-9931-65155047bd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1521534161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6cc2830-b1ba-4ce6-ae34-a2fc526d3b27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ba6c3fbb7654f8a909561b8d993c95e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:20:26Z,use_quota=True,user_id='bb7fec828f6b4fcc9d20efbf8a3d8ea3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-1b7e5bdb-c434-4701-90b2-2d29b995f8a4 tempest-AttachVolumeShelveTestJSON-1359496486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65fbe371-2153-4efc-aeab-fb28d07903ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-1b7e5bdb-c434-4701-90b2-2d29b995f8a4 tempest-AttachVolumeShelveTestJSON-1359496486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65fbe371-2153-4efc-aeab-fb28d07903ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-1b7e5bdb-c434-4701-90b2-2d29b995f8a4 tempest-AttachVolumeShelveTestJSON-1359496486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (144dbe32-1480-4d7e-b1e6-e294e9435249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-1b7e5bdb-c434-4701-90b2-2d29b995f8a4 tempest-AttachVolumeShelveTestJSON-1359496486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (144dbe32-1480-4d7e-b1e6-e294e9435249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6cc2830-b1ba-4ce6-ae34-a2fc526d3b27', 'volume_name': 'volume-f6cc2830-b1ba-4ce6-ae34-a2fc526d3b27', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-1b7e5bdb-c434-4701-90b2-2d29b995f8a4 tempest-AttachVolumeShelveTestJSON-1359496486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ceaa26d-ac32-41cd-8528-d0ad96afdd2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-1b7e5bdb-c434-4701-90b2-2d29b995f8a4 tempest-AttachVolumeShelveTestJSON-1359496486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ceaa26d-ac32-41cd-8528-d0ad96afdd2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-1b7e5bdb-c434-4701-90b2-2d29b995f8a4 tempest-AttachVolumeShelveTestJSON-1359496486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17475f53-7af7-4fde-a516-79c2412ff338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:26 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-1b7e5bdb-c434-4701-90b2-2d29b995f8a4 tempest-AttachVolumeShelveTestJSON-1359496486 None] Volume f6cc2830-b1ba-4ce6-ae34-a2fc526d3b27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6cc2830-b1ba-4ce6-ae34-a2fc526d3b27', 'volume_size': 1} Jul 07 17:20:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1b7e5bdb-c434-4701-90b2-2d29b995f8a4 tempest-AttachVolumeShelveTestJSON-1359496486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:20:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1b7e5bdb-c434-4701-90b2-2d29b995f8a4 tempest-AttachVolumeShelveTestJSON-1359496486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:20:26 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-1b7e5bdb-c434-4701-90b2-2d29b995f8a4 tempest-AttachVolumeShelveTestJSON-1359496486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1521534161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6cc2830-b1ba-4ce6-ae34-a2fc526d3b27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ba6c3fbb7654f8a909561b8d993c95e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:20:26Z,use_quota=True,user_id='bb7fec828f6b4fcc9d20efbf8a3d8ea3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:20:26 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-1b7e5bdb-c434-4701-90b2-2d29b995f8a4 tempest-AttachVolumeShelveTestJSON-1359496486 None] Creating volume f6cc2830-b1ba-4ce6-ae34-a2fc526d3b27 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:20:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1b7e5bdb-c434-4701-90b2-2d29b995f8a4 tempest-AttachVolumeShelveTestJSON-1359496486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:20:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1b7e5bdb-c434-4701-90b2-2d29b995f8a4 tempest-AttachVolumeShelveTestJSON-1359496486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:20:26 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-1b7e5bdb-c434-4701-90b2-2d29b995f8a4 tempest-AttachVolumeShelveTestJSON-1359496486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:20:26 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-1b7e5bdb-c434-4701-90b2-2d29b995f8a4 tempest-AttachVolumeShelveTestJSON-1359496486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:20:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1b7e5bdb-c434-4701-90b2-2d29b995f8a4 tempest-AttachVolumeShelveTestJSON-1359496486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:20:26 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-1b7e5bdb-c434-4701-90b2-2d29b995f8a4 tempest-AttachVolumeShelveTestJSON-1359496486 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:20:26 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-1b7e5bdb-c434-4701-90b2-2d29b995f8a4 tempest-AttachVolumeShelveTestJSON-1359496486 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:20:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1b7e5bdb-c434-4701-90b2-2d29b995f8a4 tempest-AttachVolumeShelveTestJSON-1359496486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f6cc2830-b1ba-4ce6-ae34-a2fc526d3b27 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:26 devstack sudo[89960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f6cc2830-b1ba-4ce6-ae34-a2fc526d3b27 1073741824 Jul 07 17:20:26 devstack sudo[89960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:27 devstack sudo[89960]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1b7e5bdb-c434-4701-90b2-2d29b995f8a4 tempest-AttachVolumeShelveTestJSON-1359496486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f6cc2830-b1ba-4ce6-ae34-a2fc526d3b27 1073741824" returned: 0 in 0.950s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1b7e5bdb-c434-4701-90b2-2d29b995f8a4 tempest-AttachVolumeShelveTestJSON-1359496486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f6cc2830-b1ba-4ce6-ae34-a2fc526d3b27 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:27 devstack sudo[89966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f6cc2830-b1ba-4ce6-ae34-a2fc526d3b27 Jul 07 17:20:27 devstack sudo[89966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:28 devstack sudo[89966]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1b7e5bdb-c434-4701-90b2-2d29b995f8a4 tempest-AttachVolumeShelveTestJSON-1359496486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f6cc2830-b1ba-4ce6-ae34-a2fc526d3b27" returned: 0 in 0.646s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:28 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-1b7e5bdb-c434-4701-90b2-2d29b995f8a4 tempest-AttachVolumeShelveTestJSON-1359496486 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:20:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1b7e5bdb-c434-4701-90b2-2d29b995f8a4 tempest-AttachVolumeShelveTestJSON-1359496486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:20:28 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-1b7e5bdb-c434-4701-90b2-2d29b995f8a4 tempest-AttachVolumeShelveTestJSON-1359496486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17475f53-7af7-4fde-a516-79c2412ff338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6cc2830-b1ba-4ce6-ae34-a2fc526d3b27', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:28 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-1b7e5bdb-c434-4701-90b2-2d29b995f8a4 tempest-AttachVolumeShelveTestJSON-1359496486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d6f6202-2f42-445c-b1ae-2a132920119d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:28 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-1b7e5bdb-c434-4701-90b2-2d29b995f8a4 tempest-AttachVolumeShelveTestJSON-1359496486 None] Volume volume-f6cc2830-b1ba-4ce6-ae34-a2fc526d3b27 (f6cc2830-b1ba-4ce6-ae34-a2fc526d3b27): created successfully Jul 07 17:20:28 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-1b7e5bdb-c434-4701-90b2-2d29b995f8a4 tempest-AttachVolumeShelveTestJSON-1359496486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d6f6202-2f42-445c-b1ae-2a132920119d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:28 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-1b7e5bdb-c434-4701-90b2-2d29b995f8a4 tempest-AttachVolumeShelveTestJSON-1359496486 None] Flow 'volume_create_manager' (24d829fd-297d-4921-bc83-61882c2c7fb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:20:28 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-1b7e5bdb-c434-4701-90b2-2d29b995f8a4 tempest-AttachVolumeShelveTestJSON-1359496486 None] Created volume successfully. Jul 07 17:20:29 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb5fece4-dadb-46fa-a1aa-1b69198dd612 tempest-VolumesTestJSON-542333855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:20:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bb5fece4-dadb-46fa-a1aa-1b69198dd612 tempest-VolumesTestJSON-542333855 None] Flow 'volume_create_manager' (00ed0b6a-649e-4170-8e16-880651eef7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:20:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bb5fece4-dadb-46fa-a1aa-1b69198dd612 tempest-VolumesTestJSON-542333855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74162a7b-dd89-457b-b249-a26c5d8ae3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bb5fece4-dadb-46fa-a1aa-1b69198dd612 tempest-VolumesTestJSON-542333855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74162a7b-dd89-457b-b249-a26c5d8ae3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1674795561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb670429-1ccc-4967-a90e-dad3e6bd9a2f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cea7f9ecc5534170b16824312b977cd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:20:29Z,use_quota=True,user_id='a00aeeca3d6c429994811cc628e6af61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bb5fece4-dadb-46fa-a1aa-1b69198dd612 tempest-VolumesTestJSON-542333855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcbed805-e623-49fb-8deb-6d4193310ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bb5fece4-dadb-46fa-a1aa-1b69198dd612 tempest-VolumesTestJSON-542333855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcbed805-e623-49fb-8deb-6d4193310ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bb5fece4-dadb-46fa-a1aa-1b69198dd612 tempest-VolumesTestJSON-542333855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (584a03f7-59de-4a32-92ad-c7f4218eaa89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bb5fece4-dadb-46fa-a1aa-1b69198dd612 tempest-VolumesTestJSON-542333855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (584a03f7-59de-4a32-92ad-c7f4218eaa89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb670429-1ccc-4967-a90e-dad3e6bd9a2f', 'volume_name': 'volume-bb670429-1ccc-4967-a90e-dad3e6bd9a2f', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bb5fece4-dadb-46fa-a1aa-1b69198dd612 tempest-VolumesTestJSON-542333855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37780657-e518-4159-89f1-8ad31a8c2755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bb5fece4-dadb-46fa-a1aa-1b69198dd612 tempest-VolumesTestJSON-542333855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37780657-e518-4159-89f1-8ad31a8c2755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bb5fece4-dadb-46fa-a1aa-1b69198dd612 tempest-VolumesTestJSON-542333855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f25f4ce2-978c-4e72-804c-819ac5964795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:29 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-bb5fece4-dadb-46fa-a1aa-1b69198dd612 tempest-VolumesTestJSON-542333855 None] Volume bb670429-1ccc-4967-a90e-dad3e6bd9a2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb670429-1ccc-4967-a90e-dad3e6bd9a2f', 'volume_size': 1} Jul 07 17:20:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bb5fece4-dadb-46fa-a1aa-1b69198dd612 tempest-VolumesTestJSON-542333855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:20:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bb5fece4-dadb-46fa-a1aa-1b69198dd612 tempest-VolumesTestJSON-542333855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:20:29 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bb5fece4-dadb-46fa-a1aa-1b69198dd612 tempest-VolumesTestJSON-542333855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1674795561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb670429-1ccc-4967-a90e-dad3e6bd9a2f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cea7f9ecc5534170b16824312b977cd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:20:29Z,use_quota=True,user_id='a00aeeca3d6c429994811cc628e6af61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:20:29 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-bb5fece4-dadb-46fa-a1aa-1b69198dd612 tempest-VolumesTestJSON-542333855 None] Creating volume bb670429-1ccc-4967-a90e-dad3e6bd9a2f {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:20:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bb5fece4-dadb-46fa-a1aa-1b69198dd612 tempest-VolumesTestJSON-542333855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:20:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bb5fece4-dadb-46fa-a1aa-1b69198dd612 tempest-VolumesTestJSON-542333855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:20:29 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bb5fece4-dadb-46fa-a1aa-1b69198dd612 tempest-VolumesTestJSON-542333855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:20:29 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bb5fece4-dadb-46fa-a1aa-1b69198dd612 tempest-VolumesTestJSON-542333855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:20:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bb5fece4-dadb-46fa-a1aa-1b69198dd612 tempest-VolumesTestJSON-542333855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:20:29 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bb5fece4-dadb-46fa-a1aa-1b69198dd612 tempest-VolumesTestJSON-542333855 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:20:29 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-bb5fece4-dadb-46fa-a1aa-1b69198dd612 tempest-VolumesTestJSON-542333855 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:20:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bb5fece4-dadb-46fa-a1aa-1b69198dd612 tempest-VolumesTestJSON-542333855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bb670429-1ccc-4967-a90e-dad3e6bd9a2f 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:29 devstack sudo[89981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bb670429-1ccc-4967-a90e-dad3e6bd9a2f 1073741824 Jul 07 17:20:29 devstack sudo[89981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:29 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4bbcbb3-a008-40c6-8566-1066a31fde7f tempest-AttachVolumeTestJSON-841000093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:20:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b4bbcbb3-a008-40c6-8566-1066a31fde7f tempest-AttachVolumeTestJSON-841000093 None] Flow 'volume_create_manager' (d6fdeb41-3868-49c4-b84b-d2ba55ea2354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:20:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b4bbcbb3-a008-40c6-8566-1066a31fde7f tempest-AttachVolumeTestJSON-841000093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6d894fc-1895-4f74-920f-13ff148eb4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b4bbcbb3-a008-40c6-8566-1066a31fde7f tempest-AttachVolumeTestJSON-841000093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6d894fc-1895-4f74-920f-13ff148eb4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1266458396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cda4c26-a34f-4437-84cf-97a9d9a8177c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d36fd6a2d1430aa9143c1c4dcb50ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:20:29Z,use_quota=True,user_id='e1b4dbf2f53d49119331b866cdc284c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b4bbcbb3-a008-40c6-8566-1066a31fde7f tempest-AttachVolumeTestJSON-841000093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c605155-21cc-4eb7-bb71-7390967ba962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b4bbcbb3-a008-40c6-8566-1066a31fde7f tempest-AttachVolumeTestJSON-841000093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c605155-21cc-4eb7-bb71-7390967ba962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b4bbcbb3-a008-40c6-8566-1066a31fde7f tempest-AttachVolumeTestJSON-841000093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b94f0ba0-b617-4617-baf9-1e02f4e9d68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b4bbcbb3-a008-40c6-8566-1066a31fde7f tempest-AttachVolumeTestJSON-841000093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b94f0ba0-b617-4617-baf9-1e02f4e9d68c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cda4c26-a34f-4437-84cf-97a9d9a8177c', 'volume_name': 'volume-3cda4c26-a34f-4437-84cf-97a9d9a8177c', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b4bbcbb3-a008-40c6-8566-1066a31fde7f tempest-AttachVolumeTestJSON-841000093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d76531f3-5fcd-4e1d-abb3-6d1aa303093b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b4bbcbb3-a008-40c6-8566-1066a31fde7f tempest-AttachVolumeTestJSON-841000093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d76531f3-5fcd-4e1d-abb3-6d1aa303093b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b4bbcbb3-a008-40c6-8566-1066a31fde7f tempest-AttachVolumeTestJSON-841000093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dd20512-a761-4013-9572-9b4058d84e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:29 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-b4bbcbb3-a008-40c6-8566-1066a31fde7f tempest-AttachVolumeTestJSON-841000093 None] Volume 3cda4c26-a34f-4437-84cf-97a9d9a8177c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cda4c26-a34f-4437-84cf-97a9d9a8177c', 'volume_size': 1} Jul 07 17:20:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b4bbcbb3-a008-40c6-8566-1066a31fde7f tempest-AttachVolumeTestJSON-841000093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:20:30 devstack sudo[89981]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bb5fece4-dadb-46fa-a1aa-1b69198dd612 tempest-VolumesTestJSON-542333855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bb670429-1ccc-4967-a90e-dad3e6bd9a2f 1073741824" returned: 0 in 0.899s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bb5fece4-dadb-46fa-a1aa-1b69198dd612 tempest-VolumesTestJSON-542333855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bb670429-1ccc-4967-a90e-dad3e6bd9a2f {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:30 devstack sudo[89990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bb670429-1ccc-4967-a90e-dad3e6bd9a2f Jul 07 17:20:30 devstack sudo[89990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:31 devstack sudo[89990]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bb5fece4-dadb-46fa-a1aa-1b69198dd612 tempest-VolumesTestJSON-542333855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bb670429-1ccc-4967-a90e-dad3e6bd9a2f" returned: 0 in 0.641s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:31 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bb5fece4-dadb-46fa-a1aa-1b69198dd612 tempest-VolumesTestJSON-542333855 None] <== create_volume: return (1582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:20:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bb5fece4-dadb-46fa-a1aa-1b69198dd612 tempest-VolumesTestJSON-542333855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:20:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b4bbcbb3-a008-40c6-8566-1066a31fde7f tempest-AttachVolumeTestJSON-841000093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.466s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:20:31 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b4bbcbb3-a008-40c6-8566-1066a31fde7f tempest-AttachVolumeTestJSON-841000093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1266458396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cda4c26-a34f-4437-84cf-97a9d9a8177c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d36fd6a2d1430aa9143c1c4dcb50ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:20:29Z,use_quota=True,user_id='e1b4dbf2f53d49119331b866cdc284c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:20:31 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-b4bbcbb3-a008-40c6-8566-1066a31fde7f tempest-AttachVolumeTestJSON-841000093 None] Creating volume 3cda4c26-a34f-4437-84cf-97a9d9a8177c {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:20:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b4bbcbb3-a008-40c6-8566-1066a31fde7f tempest-AttachVolumeTestJSON-841000093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:20:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b4bbcbb3-a008-40c6-8566-1066a31fde7f tempest-AttachVolumeTestJSON-841000093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:20:31 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b4bbcbb3-a008-40c6-8566-1066a31fde7f tempest-AttachVolumeTestJSON-841000093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:20:31 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b4bbcbb3-a008-40c6-8566-1066a31fde7f tempest-AttachVolumeTestJSON-841000093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:20:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b4bbcbb3-a008-40c6-8566-1066a31fde7f tempest-AttachVolumeTestJSON-841000093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:20:31 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b4bbcbb3-a008-40c6-8566-1066a31fde7f tempest-AttachVolumeTestJSON-841000093 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:20:31 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-b4bbcbb3-a008-40c6-8566-1066a31fde7f tempest-AttachVolumeTestJSON-841000093 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:20:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b4bbcbb3-a008-40c6-8566-1066a31fde7f tempest-AttachVolumeTestJSON-841000093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3cda4c26-a34f-4437-84cf-97a9d9a8177c 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:31 devstack sudo[89993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3cda4c26-a34f-4437-84cf-97a9d9a8177c 1073741824 Jul 07 17:20:31 devstack sudo[89993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bb5fece4-dadb-46fa-a1aa-1b69198dd612 tempest-VolumesTestJSON-542333855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f25f4ce2-978c-4e72-804c-819ac5964795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb670429-1ccc-4967-a90e-dad3e6bd9a2f', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bb5fece4-dadb-46fa-a1aa-1b69198dd612 tempest-VolumesTestJSON-542333855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24ef8ab5-1c69-416b-bd6f-1abdb5ec87a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:31 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-bb5fece4-dadb-46fa-a1aa-1b69198dd612 tempest-VolumesTestJSON-542333855 None] Volume volume-bb670429-1ccc-4967-a90e-dad3e6bd9a2f (bb670429-1ccc-4967-a90e-dad3e6bd9a2f): created successfully Jul 07 17:20:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bb5fece4-dadb-46fa-a1aa-1b69198dd612 tempest-VolumesTestJSON-542333855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24ef8ab5-1c69-416b-bd6f-1abdb5ec87a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bb5fece4-dadb-46fa-a1aa-1b69198dd612 tempest-VolumesTestJSON-542333855 None] Flow 'volume_create_manager' (00ed0b6a-649e-4170-8e16-880651eef7b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:20:31 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-bb5fece4-dadb-46fa-a1aa-1b69198dd612 tempest-VolumesTestJSON-542333855 None] Created volume successfully. Jul 07 17:20:31 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-52b126e8-6d3f-47ed-9854-360c61fccb8f tempest-VolumesTestJSON-542333855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:20:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-52b126e8-6d3f-47ed-9854-360c61fccb8f tempest-VolumesTestJSON-542333855 None] Flow 'volume_create_manager' (9b457bce-2a54-422b-aab8-5086f5df0bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:20:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-52b126e8-6d3f-47ed-9854-360c61fccb8f tempest-VolumesTestJSON-542333855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7a4c68b-69f1-4302-8990-9d86b9e2f717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-52b126e8-6d3f-47ed-9854-360c61fccb8f tempest-VolumesTestJSON-542333855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7a4c68b-69f1-4302-8990-9d86b9e2f717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1451240137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24c36bd9-be4e-40d1-a576-2631e006c8d9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cea7f9ecc5534170b16824312b977cd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:20:32Z,use_quota=True,user_id='a00aeeca3d6c429994811cc628e6af61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-52b126e8-6d3f-47ed-9854-360c61fccb8f tempest-VolumesTestJSON-542333855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b775b1ee-7659-40c4-a033-0805c1f5d42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-52b126e8-6d3f-47ed-9854-360c61fccb8f tempest-VolumesTestJSON-542333855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b775b1ee-7659-40c4-a033-0805c1f5d42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-52b126e8-6d3f-47ed-9854-360c61fccb8f tempest-VolumesTestJSON-542333855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36716f31-944c-4062-b731-b8d1e73f6122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-52b126e8-6d3f-47ed-9854-360c61fccb8f tempest-VolumesTestJSON-542333855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36716f31-944c-4062-b731-b8d1e73f6122) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24c36bd9-be4e-40d1-a576-2631e006c8d9', 'volume_name': 'volume-24c36bd9-be4e-40d1-a576-2631e006c8d9', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-52b126e8-6d3f-47ed-9854-360c61fccb8f tempest-VolumesTestJSON-542333855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b03bdfe-7fb6-4786-aebe-7a92532de4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-52b126e8-6d3f-47ed-9854-360c61fccb8f tempest-VolumesTestJSON-542333855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b03bdfe-7fb6-4786-aebe-7a92532de4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-52b126e8-6d3f-47ed-9854-360c61fccb8f tempest-VolumesTestJSON-542333855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbf0b475-e027-4a5c-84bb-46e307ad9779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:31 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-52b126e8-6d3f-47ed-9854-360c61fccb8f tempest-VolumesTestJSON-542333855 None] Volume 24c36bd9-be4e-40d1-a576-2631e006c8d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24c36bd9-be4e-40d1-a576-2631e006c8d9', 'volume_size': 1} Jul 07 17:20:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-52b126e8-6d3f-47ed-9854-360c61fccb8f tempest-VolumesTestJSON-542333855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:20:31 devstack sudo[89993]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b4bbcbb3-a008-40c6-8566-1066a31fde7f tempest-AttachVolumeTestJSON-841000093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3cda4c26-a34f-4437-84cf-97a9d9a8177c 1073741824" returned: 0 in 0.916s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b4bbcbb3-a008-40c6-8566-1066a31fde7f tempest-AttachVolumeTestJSON-841000093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3cda4c26-a34f-4437-84cf-97a9d9a8177c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:32 devstack sudo[90004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3cda4c26-a34f-4437-84cf-97a9d9a8177c Jul 07 17:20:32 devstack sudo[90004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:32 devstack sudo[90004]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b4bbcbb3-a008-40c6-8566-1066a31fde7f tempest-AttachVolumeTestJSON-841000093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3cda4c26-a34f-4437-84cf-97a9d9a8177c" returned: 0 in 0.628s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:32 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b4bbcbb3-a008-40c6-8566-1066a31fde7f tempest-AttachVolumeTestJSON-841000093 None] <== create_volume: return (1581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:20:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b4bbcbb3-a008-40c6-8566-1066a31fde7f tempest-AttachVolumeTestJSON-841000093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:20:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-52b126e8-6d3f-47ed-9854-360c61fccb8f tempest-VolumesTestJSON-542333855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.700s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:20:32 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-52b126e8-6d3f-47ed-9854-360c61fccb8f tempest-VolumesTestJSON-542333855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1451240137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24c36bd9-be4e-40d1-a576-2631e006c8d9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cea7f9ecc5534170b16824312b977cd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:20:32Z,use_quota=True,user_id='a00aeeca3d6c429994811cc628e6af61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:20:32 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-52b126e8-6d3f-47ed-9854-360c61fccb8f tempest-VolumesTestJSON-542333855 None] Creating volume 24c36bd9-be4e-40d1-a576-2631e006c8d9 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:20:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-52b126e8-6d3f-47ed-9854-360c61fccb8f tempest-VolumesTestJSON-542333855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:20:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-52b126e8-6d3f-47ed-9854-360c61fccb8f tempest-VolumesTestJSON-542333855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:20:32 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-52b126e8-6d3f-47ed-9854-360c61fccb8f tempest-VolumesTestJSON-542333855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:20:32 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-52b126e8-6d3f-47ed-9854-360c61fccb8f tempest-VolumesTestJSON-542333855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:20:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-52b126e8-6d3f-47ed-9854-360c61fccb8f tempest-VolumesTestJSON-542333855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:20:32 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-52b126e8-6d3f-47ed-9854-360c61fccb8f tempest-VolumesTestJSON-542333855 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:20:32 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-52b126e8-6d3f-47ed-9854-360c61fccb8f tempest-VolumesTestJSON-542333855 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:20:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-52b126e8-6d3f-47ed-9854-360c61fccb8f tempest-VolumesTestJSON-542333855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-24c36bd9-be4e-40d1-a576-2631e006c8d9 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:32 devstack sudo[90007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-24c36bd9-be4e-40d1-a576-2631e006c8d9 1073741824 Jul 07 17:20:32 devstack sudo[90007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:32 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b4bbcbb3-a008-40c6-8566-1066a31fde7f tempest-AttachVolumeTestJSON-841000093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dd20512-a761-4013-9572-9b4058d84e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cda4c26-a34f-4437-84cf-97a9d9a8177c', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:32 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b4bbcbb3-a008-40c6-8566-1066a31fde7f tempest-AttachVolumeTestJSON-841000093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b7ba93c-2b53-42a5-bb62-da214da9a814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:32 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-b4bbcbb3-a008-40c6-8566-1066a31fde7f tempest-AttachVolumeTestJSON-841000093 None] Volume volume-3cda4c26-a34f-4437-84cf-97a9d9a8177c (3cda4c26-a34f-4437-84cf-97a9d9a8177c): created successfully Jul 07 17:20:32 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b4bbcbb3-a008-40c6-8566-1066a31fde7f tempest-AttachVolumeTestJSON-841000093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b7ba93c-2b53-42a5-bb62-da214da9a814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:32 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b4bbcbb3-a008-40c6-8566-1066a31fde7f tempest-AttachVolumeTestJSON-841000093 None] Flow 'volume_create_manager' (d6fdeb41-3868-49c4-b84b-d2ba55ea2354) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:20:32 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-b4bbcbb3-a008-40c6-8566-1066a31fde7f tempest-AttachVolumeTestJSON-841000093 None] Created volume successfully. Jul 07 17:20:33 devstack sudo[90007]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-52b126e8-6d3f-47ed-9854-360c61fccb8f tempest-VolumesTestJSON-542333855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-24c36bd9-be4e-40d1-a576-2631e006c8d9 1073741824" returned: 0 in 0.829s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-52b126e8-6d3f-47ed-9854-360c61fccb8f tempest-VolumesTestJSON-542333855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-24c36bd9-be4e-40d1-a576-2631e006c8d9 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:33 devstack sudo[90013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-24c36bd9-be4e-40d1-a576-2631e006c8d9 Jul 07 17:20:33 devstack sudo[90013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:34 devstack sudo[90013]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-52b126e8-6d3f-47ed-9854-360c61fccb8f tempest-VolumesTestJSON-542333855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-24c36bd9-be4e-40d1-a576-2631e006c8d9" returned: 0 in 0.730s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:34 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-52b126e8-6d3f-47ed-9854-360c61fccb8f tempest-VolumesTestJSON-542333855 None] <== create_volume: return (1599ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:20:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-52b126e8-6d3f-47ed-9854-360c61fccb8f tempest-VolumesTestJSON-542333855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.602s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:20:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-52b126e8-6d3f-47ed-9854-360c61fccb8f tempest-VolumesTestJSON-542333855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbf0b475-e027-4a5c-84bb-46e307ad9779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24c36bd9-be4e-40d1-a576-2631e006c8d9', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-52b126e8-6d3f-47ed-9854-360c61fccb8f tempest-VolumesTestJSON-542333855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4046da1-70fc-4f91-9cdb-10763a71bc98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:34 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-52b126e8-6d3f-47ed-9854-360c61fccb8f tempest-VolumesTestJSON-542333855 None] Volume volume-24c36bd9-be4e-40d1-a576-2631e006c8d9 (24c36bd9-be4e-40d1-a576-2631e006c8d9): created successfully Jul 07 17:20:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-52b126e8-6d3f-47ed-9854-360c61fccb8f tempest-VolumesTestJSON-542333855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4046da1-70fc-4f91-9cdb-10763a71bc98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-52b126e8-6d3f-47ed-9854-360c61fccb8f tempest-VolumesTestJSON-542333855 None] Flow 'volume_create_manager' (9b457bce-2a54-422b-aab8-5086f5df0bfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:20:34 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-52b126e8-6d3f-47ed-9854-360c61fccb8f tempest-VolumesTestJSON-542333855 None] Created volume successfully. Jul 07 17:20:36 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-354257b0-78dc-44bc-aa5a-bd5a99eae0d7 tempest-VolumesTestJSON-542333855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:20:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-354257b0-78dc-44bc-aa5a-bd5a99eae0d7 tempest-VolumesTestJSON-542333855 None] Flow 'volume_create_manager' (9ecb1792-9e39-48a0-9087-ce4d125428cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:20:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-354257b0-78dc-44bc-aa5a-bd5a99eae0d7 tempest-VolumesTestJSON-542333855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd4ef377-1a52-4259-b0f0-dcf9f317df87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-354257b0-78dc-44bc-aa5a-bd5a99eae0d7 tempest-VolumesTestJSON-542333855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd4ef377-1a52-4259-b0f0-dcf9f317df87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-400826732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf06f4b5-b889-4705-905a-89a96aa96e4f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cea7f9ecc5534170b16824312b977cd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:20:36Z,use_quota=True,user_id='a00aeeca3d6c429994811cc628e6af61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-354257b0-78dc-44bc-aa5a-bd5a99eae0d7 tempest-VolumesTestJSON-542333855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (831e4174-7ad1-4290-9405-9392e4003101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-354257b0-78dc-44bc-aa5a-bd5a99eae0d7 tempest-VolumesTestJSON-542333855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (831e4174-7ad1-4290-9405-9392e4003101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-354257b0-78dc-44bc-aa5a-bd5a99eae0d7 tempest-VolumesTestJSON-542333855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d3ed409-b9b2-46ac-91ee-aa0fb871ad41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-354257b0-78dc-44bc-aa5a-bd5a99eae0d7 tempest-VolumesTestJSON-542333855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d3ed409-b9b2-46ac-91ee-aa0fb871ad41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf06f4b5-b889-4705-905a-89a96aa96e4f', 'volume_name': 'volume-bf06f4b5-b889-4705-905a-89a96aa96e4f', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-354257b0-78dc-44bc-aa5a-bd5a99eae0d7 tempest-VolumesTestJSON-542333855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16eb5117-3d45-45c6-a99b-d9509385a426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-354257b0-78dc-44bc-aa5a-bd5a99eae0d7 tempest-VolumesTestJSON-542333855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16eb5117-3d45-45c6-a99b-d9509385a426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-354257b0-78dc-44bc-aa5a-bd5a99eae0d7 tempest-VolumesTestJSON-542333855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d32c1879-d2c9-4950-8f17-4a0f48802e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:36 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-354257b0-78dc-44bc-aa5a-bd5a99eae0d7 tempest-VolumesTestJSON-542333855 None] Volume bf06f4b5-b889-4705-905a-89a96aa96e4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf06f4b5-b889-4705-905a-89a96aa96e4f', 'volume_size': 1} Jul 07 17:20:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-354257b0-78dc-44bc-aa5a-bd5a99eae0d7 tempest-VolumesTestJSON-542333855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:20:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-354257b0-78dc-44bc-aa5a-bd5a99eae0d7 tempest-VolumesTestJSON-542333855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:20:36 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-354257b0-78dc-44bc-aa5a-bd5a99eae0d7 tempest-VolumesTestJSON-542333855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-400826732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf06f4b5-b889-4705-905a-89a96aa96e4f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cea7f9ecc5534170b16824312b977cd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:20:36Z,use_quota=True,user_id='a00aeeca3d6c429994811cc628e6af61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:20:36 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-354257b0-78dc-44bc-aa5a-bd5a99eae0d7 tempest-VolumesTestJSON-542333855 None] Creating volume bf06f4b5-b889-4705-905a-89a96aa96e4f {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:20:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-354257b0-78dc-44bc-aa5a-bd5a99eae0d7 tempest-VolumesTestJSON-542333855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:20:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-354257b0-78dc-44bc-aa5a-bd5a99eae0d7 tempest-VolumesTestJSON-542333855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:20:36 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-354257b0-78dc-44bc-aa5a-bd5a99eae0d7 tempest-VolumesTestJSON-542333855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:20:36 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-354257b0-78dc-44bc-aa5a-bd5a99eae0d7 tempest-VolumesTestJSON-542333855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:20:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-354257b0-78dc-44bc-aa5a-bd5a99eae0d7 tempest-VolumesTestJSON-542333855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:20:36 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-354257b0-78dc-44bc-aa5a-bd5a99eae0d7 tempest-VolumesTestJSON-542333855 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:20:36 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-354257b0-78dc-44bc-aa5a-bd5a99eae0d7 tempest-VolumesTestJSON-542333855 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:20:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-354257b0-78dc-44bc-aa5a-bd5a99eae0d7 tempest-VolumesTestJSON-542333855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bf06f4b5-b889-4705-905a-89a96aa96e4f 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:36 devstack sudo[90031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bf06f4b5-b889-4705-905a-89a96aa96e4f 1073741824 Jul 07 17:20:36 devstack sudo[90031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-f84f80ac-2de1-46ab-8d22-a9f081c1535c req-2c03cbb1-e012-460d-9536-4e492eb5bdd7 tempest-AttachVolumeTestJSON-841000093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:20:37 devstack sudo[90031]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-354257b0-78dc-44bc-aa5a-bd5a99eae0d7 tempest-VolumesTestJSON-542333855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bf06f4b5-b889-4705-905a-89a96aa96e4f 1073741824" returned: 0 in 0.940s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-354257b0-78dc-44bc-aa5a-bd5a99eae0d7 tempest-VolumesTestJSON-542333855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bf06f4b5-b889-4705-905a-89a96aa96e4f {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:37 devstack sudo[90044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bf06f4b5-b889-4705-905a-89a96aa96e4f Jul 07 17:20:37 devstack sudo[90044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:37 devstack sudo[90044]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-354257b0-78dc-44bc-aa5a-bd5a99eae0d7 tempest-VolumesTestJSON-542333855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bf06f4b5-b889-4705-905a-89a96aa96e4f" returned: 0 in 0.644s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:37 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-354257b0-78dc-44bc-aa5a-bd5a99eae0d7 tempest-VolumesTestJSON-542333855 None] <== create_volume: return (1635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:20:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-354257b0-78dc-44bc-aa5a-bd5a99eae0d7 tempest-VolumesTestJSON-542333855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.637s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:20:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-f84f80ac-2de1-46ab-8d22-a9f081c1535c req-2c03cbb1-e012-460d-9536-4e492eb5bdd7 tempest-AttachVolumeTestJSON-841000093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.315s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:20:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-354257b0-78dc-44bc-aa5a-bd5a99eae0d7 tempest-VolumesTestJSON-542333855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d32c1879-d2c9-4950-8f17-4a0f48802e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf06f4b5-b889-4705-905a-89a96aa96e4f', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-354257b0-78dc-44bc-aa5a-bd5a99eae0d7 tempest-VolumesTestJSON-542333855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (308de911-25ea-4d36-baaa-692fea88456b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:37 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e595eb-6613-4393-abca-e574ef3f9ec1]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:20:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-f84f80ac-2de1-46ab-8d22-a9f081c1535c req-2c03cbb1-e012-460d-9536-4e492eb5bdd7 tempest-AttachVolumeTestJSON-841000093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3cda4c26-a34f-4437-84cf-97a9d9a8177c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:37 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-354257b0-78dc-44bc-aa5a-bd5a99eae0d7 tempest-VolumesTestJSON-542333855 None] Volume volume-bf06f4b5-b889-4705-905a-89a96aa96e4f (bf06f4b5-b889-4705-905a-89a96aa96e4f): created successfully Jul 07 17:20:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-354257b0-78dc-44bc-aa5a-bd5a99eae0d7 tempest-VolumesTestJSON-542333855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (308de911-25ea-4d36-baaa-692fea88456b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-354257b0-78dc-44bc-aa5a-bd5a99eae0d7 tempest-VolumesTestJSON-542333855 None] Flow 'volume_create_manager' (9ecb1792-9e39-48a0-9087-ce4d125428cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:20:37 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-354257b0-78dc-44bc-aa5a-bd5a99eae0d7 tempest-VolumesTestJSON-542333855 None] Created volume successfully. Jul 07 17:20:38 devstack sudo[90047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3cda4c26-a34f-4437-84cf-97a9d9a8177c Jul 07 17:20:38 devstack sudo[90047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:38 devstack sudo[90047]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-f84f80ac-2de1-46ab-8d22-a9f081c1535c req-2c03cbb1-e012-460d-9536-4e492eb5bdd7 tempest-AttachVolumeTestJSON-841000093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3cda4c26-a34f-4437-84cf-97a9d9a8177c" returned: 0 in 0.889s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-f84f80ac-2de1-46ab-8d22-a9f081c1535c req-2c03cbb1-e012-460d-9536-4e492eb5bdd7 tempest-AttachVolumeTestJSON-841000093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.932s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:20:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-f84f80ac-2de1-46ab-8d22-a9f081c1535c req-2c03cbb1-e012-460d-9536-4e492eb5bdd7 tempest-AttachVolumeTestJSON-841000093 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7', 'name': 'volume-3cda4c26-a34f-4437-84cf-97a9d9a8177c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e861ef86-b53e-4106-8c20-1778fabba2aa', 'enforce_multipath': True} {{(pid=87233) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:20:38 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-f84f80ac-2de1-46ab-8d22-a9f081c1535c req-2c03cbb1-e012-460d-9536-4e492eb5bdd7 tempest-AttachVolumeTestJSON-841000093 None] attachment_update completed successfully. Jul 07 17:20:39 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-4517ec1d-46e9-46bb-925b-16986abc80a5 tempest-VolumesTestJSON-542333855 None] Acquiring lock "cinder-bf06f4b5-b889-4705-905a-89a96aa96e4f-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:20:39 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-4517ec1d-46e9-46bb-925b-16986abc80a5 tempest-VolumesTestJSON-542333855 None] Lock "cinder-bf06f4b5-b889-4705-905a-89a96aa96e4f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:20:39 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-4517ec1d-46e9-46bb-925b-16986abc80a5 tempest-VolumesTestJSON-542333855 None] Acquiring lock "cinder-quobyte-bf06f4b5-b889-4705-905a-89a96aa96e4f" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:20:39 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-4517ec1d-46e9-46bb-925b-16986abc80a5 tempest-VolumesTestJSON-542333855 None] Lock "cinder-quobyte-bf06f4b5-b889-4705-905a-89a96aa96e4f" acquired by "delete_volume" :: waited 0.022s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:20:39 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff81e08-201a-43e2-bf65-74963f94b08f]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:20:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4517ec1d-46e9-46bb-925b-16986abc80a5 tempest-VolumesTestJSON-542333855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bf06f4b5-b889-4705-905a-89a96aa96e4f {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:40 devstack sudo[90439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bf06f4b5-b889-4705-905a-89a96aa96e4f Jul 07 17:20:40 devstack sudo[90439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:40 devstack sudo[90439]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4517ec1d-46e9-46bb-925b-16986abc80a5 tempest-VolumesTestJSON-542333855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bf06f4b5-b889-4705-905a-89a96aa96e4f" returned: 0 in 0.866s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4517ec1d-46e9-46bb-925b-16986abc80a5 tempest-VolumesTestJSON-542333855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bf06f4b5-b889-4705-905a-89a96aa96e4f {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:40 devstack sudo[90446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bf06f4b5-b889-4705-905a-89a96aa96e4f Jul 07 17:20:40 devstack sudo[90446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:41 devstack sudo[90446]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4517ec1d-46e9-46bb-925b-16986abc80a5 tempest-VolumesTestJSON-542333855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bf06f4b5-b889-4705-905a-89a96aa96e4f" returned: 0 in 0.709s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:41 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-4517ec1d-46e9-46bb-925b-16986abc80a5 tempest-VolumesTestJSON-542333855 None] Lock "cinder-quobyte-bf06f4b5-b889-4705-905a-89a96aa96e4f" released by "delete_volume" :: held 1.615s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:20:41 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-4517ec1d-46e9-46bb-925b-16986abc80a5 tempest-VolumesTestJSON-542333855 None] Created reservations ['c589a6fb-47d7-44f7-81ea-96c0e13da335', '1102083a-34f8-4635-8209-1d1d60b339fe', 'e657e028-c38a-4e2d-923e-2d1060d933da', '7555e266-fa6c-42d9-a83d-1819e503f146'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:20:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4517ec1d-46e9-46bb-925b-16986abc80a5 tempest-VolumesTestJSON-542333855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:20:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4517ec1d-46e9-46bb-925b-16986abc80a5 tempest-VolumesTestJSON-542333855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:20:41 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-4517ec1d-46e9-46bb-925b-16986abc80a5 tempest-VolumesTestJSON-542333855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:20:41 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-4517ec1d-46e9-46bb-925b-16986abc80a5 tempest-VolumesTestJSON-542333855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:20:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4517ec1d-46e9-46bb-925b-16986abc80a5 tempest-VolumesTestJSON-542333855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:20:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4517ec1d-46e9-46bb-925b-16986abc80a5 tempest-VolumesTestJSON-542333855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:41 devstack sudo[90453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:20:41 devstack sudo[90453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:42 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-02a4ec9e-115b-4665-b024-bff136e9ae68 tempest-VolumesTestJSON-542333855 None] Acquiring lock "cinder-24c36bd9-be4e-40d1-a576-2631e006c8d9-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:20:42 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-02a4ec9e-115b-4665-b024-bff136e9ae68 tempest-VolumesTestJSON-542333855 None] Lock "cinder-24c36bd9-be4e-40d1-a576-2631e006c8d9-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:20:42 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-02a4ec9e-115b-4665-b024-bff136e9ae68 tempest-VolumesTestJSON-542333855 None] Acquiring lock "cinder-quobyte-24c36bd9-be4e-40d1-a576-2631e006c8d9" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:20:42 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-02a4ec9e-115b-4665-b024-bff136e9ae68 tempest-VolumesTestJSON-542333855 None] Lock "cinder-quobyte-24c36bd9-be4e-40d1-a576-2631e006c8d9" acquired by "delete_volume" :: waited 0.025s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:20:42 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6faf5a1-5ceb-402b-bab2-9fc66a62f1cc]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:20:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-02a4ec9e-115b-4665-b024-bff136e9ae68 tempest-VolumesTestJSON-542333855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-24c36bd9-be4e-40d1-a576-2631e006c8d9 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:42 devstack sudo[90470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-24c36bd9-be4e-40d1-a576-2631e006c8d9 Jul 07 17:20:42 devstack sudo[90470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:42 devstack sudo[90453]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4517ec1d-46e9-46bb-925b-16986abc80a5 tempest-VolumesTestJSON-542333855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.909s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:42 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-4517ec1d-46e9-46bb-925b-16986abc80a5 tempest-VolumesTestJSON-542333855 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:20:42 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-4517ec1d-46e9-46bb-925b-16986abc80a5 tempest-VolumesTestJSON-542333855 None] Deleted volume successfully. Jul 07 17:20:42 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-4517ec1d-46e9-46bb-925b-16986abc80a5 tempest-VolumesTestJSON-542333855 None] Lock "cinder-bf06f4b5-b889-4705-905a-89a96aa96e4f-delete_volume" released by "delete_volume" :: held 2.755s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:20:43 devstack sudo[90470]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-02a4ec9e-115b-4665-b024-bff136e9ae68 tempest-VolumesTestJSON-542333855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-24c36bd9-be4e-40d1-a576-2631e006c8d9" returned: 0 in 0.813s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-02a4ec9e-115b-4665-b024-bff136e9ae68 tempest-VolumesTestJSON-542333855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-24c36bd9-be4e-40d1-a576-2631e006c8d9 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:43 devstack sudo[90478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-24c36bd9-be4e-40d1-a576-2631e006c8d9 Jul 07 17:20:43 devstack sudo[90478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:43 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:20:43 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread count: 8 {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:20:43 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread info: [<_MainThread(MainThread, started 126077716062336)>, , , , , , , ] {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:20:44 devstack sudo[90478]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-02a4ec9e-115b-4665-b024-bff136e9ae68 tempest-VolumesTestJSON-542333855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-24c36bd9-be4e-40d1-a576-2631e006c8d9" returned: 0 in 0.927s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:44 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-02a4ec9e-115b-4665-b024-bff136e9ae68 tempest-VolumesTestJSON-542333855 None] Lock "cinder-quobyte-24c36bd9-be4e-40d1-a576-2631e006c8d9" released by "delete_volume" :: held 1.809s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:20:44 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-02a4ec9e-115b-4665-b024-bff136e9ae68 tempest-VolumesTestJSON-542333855 None] Created reservations ['25d2b79f-43ba-48fc-8533-a9aa642d019c', '2913a682-a8e1-4db1-88ee-cc18333f0138', '9941c96c-c66b-4ee9-b385-f51445ed2671', '5f8521d2-03c0-4da1-89b0-b1dce5d0567e'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:20:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-02a4ec9e-115b-4665-b024-bff136e9ae68 tempest-VolumesTestJSON-542333855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:20:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-02a4ec9e-115b-4665-b024-bff136e9ae68 tempest-VolumesTestJSON-542333855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:20:44 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-02a4ec9e-115b-4665-b024-bff136e9ae68 tempest-VolumesTestJSON-542333855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:20:44 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-02a4ec9e-115b-4665-b024-bff136e9ae68 tempest-VolumesTestJSON-542333855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:20:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-02a4ec9e-115b-4665-b024-bff136e9ae68 tempest-VolumesTestJSON-542333855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:20:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-02a4ec9e-115b-4665-b024-bff136e9ae68 tempest-VolumesTestJSON-542333855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:44 devstack sudo[90525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:20:44 devstack sudo[90525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:44 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d09824c9-7130-41f8-9bd4-1082a4daeb6b tempest-VolumesTestJSON-542333855 None] Acquiring lock "cinder-bb670429-1ccc-4967-a90e-dad3e6bd9a2f-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:20:44 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d09824c9-7130-41f8-9bd4-1082a4daeb6b tempest-VolumesTestJSON-542333855 None] Lock "cinder-bb670429-1ccc-4967-a90e-dad3e6bd9a2f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:20:44 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d09824c9-7130-41f8-9bd4-1082a4daeb6b tempest-VolumesTestJSON-542333855 None] Acquiring lock "cinder-quobyte-bb670429-1ccc-4967-a90e-dad3e6bd9a2f" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:20:44 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d09824c9-7130-41f8-9bd4-1082a4daeb6b tempest-VolumesTestJSON-542333855 None] Lock "cinder-quobyte-bb670429-1ccc-4967-a90e-dad3e6bd9a2f" acquired by "delete_volume" :: waited 0.019s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:20:44 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c812a64b-eb39-4585-80ac-afead6005b90]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:20:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d09824c9-7130-41f8-9bd4-1082a4daeb6b tempest-VolumesTestJSON-542333855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bb670429-1ccc-4967-a90e-dad3e6bd9a2f {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:44 devstack sudo[90529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bb670429-1ccc-4967-a90e-dad3e6bd9a2f Jul 07 17:20:44 devstack sudo[90529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:45 devstack sudo[90525]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-02a4ec9e-115b-4665-b024-bff136e9ae68 tempest-VolumesTestJSON-542333855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.962s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:45 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-02a4ec9e-115b-4665-b024-bff136e9ae68 tempest-VolumesTestJSON-542333855 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:20:45 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-02a4ec9e-115b-4665-b024-bff136e9ae68 tempest-VolumesTestJSON-542333855 None] Deleted volume successfully. Jul 07 17:20:45 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-02a4ec9e-115b-4665-b024-bff136e9ae68 tempest-VolumesTestJSON-542333855 None] Lock "cinder-24c36bd9-be4e-40d1-a576-2631e006c8d9-delete_volume" released by "delete_volume" :: held 3.196s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:20:45 devstack sudo[90529]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d09824c9-7130-41f8-9bd4-1082a4daeb6b tempest-VolumesTestJSON-542333855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bb670429-1ccc-4967-a90e-dad3e6bd9a2f" returned: 0 in 0.951s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d09824c9-7130-41f8-9bd4-1082a4daeb6b tempest-VolumesTestJSON-542333855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bb670429-1ccc-4967-a90e-dad3e6bd9a2f {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:45 devstack sudo[90538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bb670429-1ccc-4967-a90e-dad3e6bd9a2f Jul 07 17:20:45 devstack sudo[90538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:45 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-a940279b-96cd-4618-b7d0-cba79b64c939 req-b8602d26-e2f6-4340-bbb4-e33918ca9d13 tempest-AttachVolumeShelveTestJSON-1359496486 None] No connector for attachment f314fe10-309c-4516-8973-7cf6636120bb; skipping storage backend terminate_connection call. {{(pid=87233) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 07 17:20:45 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-a940279b-96cd-4618-b7d0-cba79b64c939 req-b8602d26-e2f6-4340-bbb4-e33918ca9d13 tempest-AttachVolumeShelveTestJSON-1359496486 None] Deleting attachment f314fe10-309c-4516-8973-7cf6636120bb. {{(pid=87233) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:20:46 devstack sudo[90538]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d09824c9-7130-41f8-9bd4-1082a4daeb6b tempest-VolumesTestJSON-542333855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bb670429-1ccc-4967-a90e-dad3e6bd9a2f" returned: 0 in 0.716s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:46 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d09824c9-7130-41f8-9bd4-1082a4daeb6b tempest-VolumesTestJSON-542333855 None] Lock "cinder-quobyte-bb670429-1ccc-4967-a90e-dad3e6bd9a2f" released by "delete_volume" :: held 1.735s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:20:46 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-d09824c9-7130-41f8-9bd4-1082a4daeb6b tempest-VolumesTestJSON-542333855 None] Created reservations ['860a52f6-79aa-45b5-a081-26fc9b826ffa', 'd2d04177-e33b-4f44-81e0-690f577d27ed', '0649e766-633c-463e-a6b7-80c418d8c9f1', '3947a089-60b5-4af8-87a6-8d926618c246'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:20:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d09824c9-7130-41f8-9bd4-1082a4daeb6b tempest-VolumesTestJSON-542333855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:20:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d09824c9-7130-41f8-9bd4-1082a4daeb6b tempest-VolumesTestJSON-542333855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:20:46 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d09824c9-7130-41f8-9bd4-1082a4daeb6b tempest-VolumesTestJSON-542333855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:20:46 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d09824c9-7130-41f8-9bd4-1082a4daeb6b tempest-VolumesTestJSON-542333855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:20:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d09824c9-7130-41f8-9bd4-1082a4daeb6b tempest-VolumesTestJSON-542333855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:20:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d09824c9-7130-41f8-9bd4-1082a4daeb6b tempest-VolumesTestJSON-542333855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:46 devstack sudo[90547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:20:46 devstack sudo[90547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:47 devstack sudo[90547]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d09824c9-7130-41f8-9bd4-1082a4daeb6b tempest-VolumesTestJSON-542333855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 1.091s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:47 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-d09824c9-7130-41f8-9bd4-1082a4daeb6b tempest-VolumesTestJSON-542333855 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:20:47 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-d09824c9-7130-41f8-9bd4-1082a4daeb6b tempest-VolumesTestJSON-542333855 None] Deleted volume successfully. Jul 07 17:20:47 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d09824c9-7130-41f8-9bd4-1082a4daeb6b tempest-VolumesTestJSON-542333855 None] Lock "cinder-bb670429-1ccc-4967-a90e-dad3e6bd9a2f-delete_volume" released by "delete_volume" :: held 3.097s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:20:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-e37a5142-e6ef-4ced-8215-511ba28b2747 req-74c80c98-f3e7-4c41-919e-0e51ac5f1b00 tempest-TaggedAttachmentsTest-571150945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:20:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-e37a5142-e6ef-4ced-8215-511ba28b2747 req-74c80c98-f3e7-4c41-919e-0e51ac5f1b00 tempest-TaggedAttachmentsTest-571150945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:20:50 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c4c3c4-b764-4694-bc8a-fa55938d7fe0]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:20:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-e37a5142-e6ef-4ced-8215-511ba28b2747 req-74c80c98-f3e7-4c41-919e-0e51ac5f1b00 tempest-TaggedAttachmentsTest-571150945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-858be2b7-2b7c-45d1-8367-a828e776c81a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:50 devstack sudo[90589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-858be2b7-2b7c-45d1-8367-a828e776c81a Jul 07 17:20:50 devstack sudo[90589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:51 devstack sudo[90589]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-e37a5142-e6ef-4ced-8215-511ba28b2747 req-74c80c98-f3e7-4c41-919e-0e51ac5f1b00 tempest-TaggedAttachmentsTest-571150945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-858be2b7-2b7c-45d1-8367-a828e776c81a" returned: 0 in 0.944s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-e37a5142-e6ef-4ced-8215-511ba28b2747 req-74c80c98-f3e7-4c41-919e-0e51ac5f1b00 tempest-TaggedAttachmentsTest-571150945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.966s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:20:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-e37a5142-e6ef-4ced-8215-511ba28b2747 req-74c80c98-f3e7-4c41-919e-0e51ac5f1b00 tempest-TaggedAttachmentsTest-571150945 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7', 'name': 'volume-858be2b7-2b7c-45d1-8367-a828e776c81a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3d38aee7-02ee-47c8-97b1-4a0fa299d5e6', 'enforce_multipath': True} {{(pid=87233) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:20:51 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-e37a5142-e6ef-4ced-8215-511ba28b2747 req-74c80c98-f3e7-4c41-919e-0e51ac5f1b00 tempest-TaggedAttachmentsTest-571150945 None] attachment_update completed successfully. Jul 07 17:20:51 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-b485ee3f-2482-4e6b-bdc4-c9d6e9bb30f9 tempest-GroupSnapshotsTest-1142774596 None] Group tempest-GroupSnapshotsTest-Group-2132539997: creating Jul 07 17:20:51 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-b485ee3f-2482-4e6b-bdc4-c9d6e9bb30f9 tempest-GroupSnapshotsTest-1142774596 None] Group tempest-GroupSnapshotsTest-Group-2132539997: created successfully Jul 07 17:20:51 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-b485ee3f-2482-4e6b-bdc4-c9d6e9bb30f9 tempest-GroupSnapshotsTest-1142774596 None] Create group completed successfully. Jul 07 17:20:53 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-194913f3-7035-4b93-b242-30855ab85793 tempest-GroupSnapshotsTest-1142774596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:20:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-194913f3-7035-4b93-b242-30855ab85793 tempest-GroupSnapshotsTest-1142774596 None] Flow 'volume_create_manager' (cf37715f-4a7b-4409-87bb-904ddb227ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:20:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-194913f3-7035-4b93-b242-30855ab85793 tempest-GroupSnapshotsTest-1142774596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6541c135-28dc-4351-9f13-b2ac63c8694d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-194913f3-7035-4b93-b242-30855ab85793 tempest-GroupSnapshotsTest-1142774596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6541c135-28dc-4351-9f13-b2ac63c8694d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2134793048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=79c96f70-a5a7-4f3c-936b-d1a24835ed0e,host='devstack@QuobyteHD#QuobyteHD',id=83ed14aa-1196-4ff2-8f68-8053cd7f7f74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='688fe61f18a44f83a0b94be8baeb6a9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:20:54Z,use_quota=True,user_id='aef3db228fa847e392768b411452dfcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f949ca24-38c2-4c4b-80e2-86091757ba22),volume_type_id=f949ca24-38c2-4c4b-80e2-86091757ba22)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-194913f3-7035-4b93-b242-30855ab85793 tempest-GroupSnapshotsTest-1142774596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf3ead0f-526b-4a08-b101-9395aace8f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-194913f3-7035-4b93-b242-30855ab85793 tempest-GroupSnapshotsTest-1142774596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf3ead0f-526b-4a08-b101-9395aace8f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-194913f3-7035-4b93-b242-30855ab85793 tempest-GroupSnapshotsTest-1142774596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (324ddf2d-785d-4d91-b1cd-1c0565da2bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-194913f3-7035-4b93-b242-30855ab85793 tempest-GroupSnapshotsTest-1142774596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (324ddf2d-785d-4d91-b1cd-1c0565da2bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83ed14aa-1196-4ff2-8f68-8053cd7f7f74', 'volume_name': 'volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-194913f3-7035-4b93-b242-30855ab85793 tempest-GroupSnapshotsTest-1142774596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f9a2d78-5e40-4cb9-bdf8-392172c4b83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-194913f3-7035-4b93-b242-30855ab85793 tempest-GroupSnapshotsTest-1142774596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f9a2d78-5e40-4cb9-bdf8-392172c4b83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-194913f3-7035-4b93-b242-30855ab85793 tempest-GroupSnapshotsTest-1142774596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6694b258-66b3-46ce-8780-5a12711a5b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:53 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-194913f3-7035-4b93-b242-30855ab85793 tempest-GroupSnapshotsTest-1142774596 None] Volume 83ed14aa-1196-4ff2-8f68-8053cd7f7f74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74', 'volume_size': 1} Jul 07 17:20:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-194913f3-7035-4b93-b242-30855ab85793 tempest-GroupSnapshotsTest-1142774596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:20:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-194913f3-7035-4b93-b242-30855ab85793 tempest-GroupSnapshotsTest-1142774596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:20:53 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-194913f3-7035-4b93-b242-30855ab85793 tempest-GroupSnapshotsTest-1142774596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=79c96f70-a5a7-4f3c-936b-d1a24835ed0e,created_at=2026-07-07T15:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2134793048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=79c96f70-a5a7-4f3c-936b-d1a24835ed0e,host='devstack@QuobyteHD#QuobyteHD',id=83ed14aa-1196-4ff2-8f68-8053cd7f7f74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='688fe61f18a44f83a0b94be8baeb6a9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:20:54Z,use_quota=True,user_id='aef3db228fa847e392768b411452dfcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f949ca24-38c2-4c4b-80e2-86091757ba22),volume_type_id=f949ca24-38c2-4c4b-80e2-86091757ba22)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:20:53 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-194913f3-7035-4b93-b242-30855ab85793 tempest-GroupSnapshotsTest-1142774596 None] Creating volume 83ed14aa-1196-4ff2-8f68-8053cd7f7f74 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:20:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-194913f3-7035-4b93-b242-30855ab85793 tempest-GroupSnapshotsTest-1142774596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:20:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-194913f3-7035-4b93-b242-30855ab85793 tempest-GroupSnapshotsTest-1142774596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:20:53 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-194913f3-7035-4b93-b242-30855ab85793 tempest-GroupSnapshotsTest-1142774596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:20:53 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-194913f3-7035-4b93-b242-30855ab85793 tempest-GroupSnapshotsTest-1142774596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:20:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-194913f3-7035-4b93-b242-30855ab85793 tempest-GroupSnapshotsTest-1142774596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:20:53 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-194913f3-7035-4b93-b242-30855ab85793 tempest-GroupSnapshotsTest-1142774596 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:20:53 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-194913f3-7035-4b93-b242-30855ab85793 tempest-GroupSnapshotsTest-1142774596 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:20:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-194913f3-7035-4b93-b242-30855ab85793 tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:53 devstack sudo[90614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74 1073741824 Jul 07 17:20:53 devstack sudo[90614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:54 devstack sudo[90614]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-194913f3-7035-4b93-b242-30855ab85793 tempest-GroupSnapshotsTest-1142774596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74 1073741824" returned: 0 in 0.905s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-194913f3-7035-4b93-b242-30855ab85793 tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:54 devstack sudo[90622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74 Jul 07 17:20:54 devstack sudo[90622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:55 devstack sudo[90622]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-194913f3-7035-4b93-b242-30855ab85793 tempest-GroupSnapshotsTest-1142774596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74" returned: 0 in 0.761s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:55 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-194913f3-7035-4b93-b242-30855ab85793 tempest-GroupSnapshotsTest-1142774596 None] <== create_volume: return (1706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:20:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-194913f3-7035-4b93-b242-30855ab85793 tempest-GroupSnapshotsTest-1142774596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.708s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:20:55 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-194913f3-7035-4b93-b242-30855ab85793 tempest-GroupSnapshotsTest-1142774596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6694b258-66b3-46ce-8780-5a12711a5b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:55 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-194913f3-7035-4b93-b242-30855ab85793 tempest-GroupSnapshotsTest-1142774596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edbdef8a-c5c0-4ca7-ac06-97a57d0c6e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:55 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-194913f3-7035-4b93-b242-30855ab85793 tempest-GroupSnapshotsTest-1142774596 None] Volume volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74 (83ed14aa-1196-4ff2-8f68-8053cd7f7f74): created successfully Jul 07 17:20:55 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-194913f3-7035-4b93-b242-30855ab85793 tempest-GroupSnapshotsTest-1142774596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edbdef8a-c5c0-4ca7-ac06-97a57d0c6e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:55 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-194913f3-7035-4b93-b242-30855ab85793 tempest-GroupSnapshotsTest-1142774596 None] Flow 'volume_create_manager' (cf37715f-4a7b-4409-87bb-904ddb227ee8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:20:55 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-194913f3-7035-4b93-b242-30855ab85793 tempest-GroupSnapshotsTest-1142774596 None] Created volume successfully. Jul 07 17:20:56 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-91b088d9-38a8-42c3-8cf2-e3321a2b428a tempest-GroupSnapshotsTest-1142774596 None] GroupSnapshot f9e4dfff-caf8-447a-9229-0127ffa47dfb: creating. Jul 07 17:20:56 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-91b088d9-38a8-42c3-8cf2-e3321a2b428a tempest-GroupSnapshotsTest-1142774596 None] Group snapshot f9e4dfff-caf8-447a-9229-0127ffa47dfb: creating. {{(pid=87233) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 07 17:20:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-91b088d9-38a8-42c3-8cf2-e3321a2b428a tempest-GroupSnapshotsTest-1142774596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:20:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-91b088d9-38a8-42c3-8cf2-e3321a2b428a tempest-GroupSnapshotsTest-1142774596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:20:56 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-91b088d9-38a8-42c3-8cf2-e3321a2b428a tempest-GroupSnapshotsTest-1142774596 None] Creating offline snapshot 5c37abbc-1e19-454f-b740-d79174ad7509 of volume 83ed14aa-1196-4ff2-8f68-8053cd7f7f74 {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:20:56 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4060bde-a946-48b8-afcf-b48ef5816bb4]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:20:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-91b088d9-38a8-42c3-8cf2-e3321a2b428a tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:56 devstack sudo[90650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74 Jul 07 17:20:56 devstack sudo[90650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:57 devstack sudo[90650]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-91b088d9-38a8-42c3-8cf2-e3321a2b428a tempest-GroupSnapshotsTest-1142774596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74" returned: 0 in 1.105s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-91b088d9-38a8-42c3-8cf2-e3321a2b428a tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74.5c37abbc-1e19-454f-b740-d79174ad7509 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:57 devstack sudo[90717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74.5c37abbc-1e19-454f-b740-d79174ad7509 1G Jul 07 17:20:57 devstack sudo[90717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:57 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-0597af99-7064-463f-b2b0-6d719638ea11 req-7f17c6dc-9dec-4301-91d9-42f0e161b2b8 tempest-TaggedAttachmentsTest-571150945 None] Terminate volume connection completed successfully. Jul 07 17:20:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-0597af99-7064-463f-b2b0-6d719638ea11 req-7f17c6dc-9dec-4301-91d9-42f0e161b2b8 tempest-TaggedAttachmentsTest-571150945 None] Deleting attachment 3d38aee7-02ee-47c8-97b1-4a0fa299d5e6. {{(pid=87233) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:20:59 devstack sudo[90717]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-91b088d9-38a8-42c3-8cf2-e3321a2b428a tempest-GroupSnapshotsTest-1142774596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74.5c37abbc-1e19-454f-b740-d79174ad7509 1G" returned: 0 in 1.393s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-91b088d9-38a8-42c3-8cf2-e3321a2b428a tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74.5c37abbc-1e19-454f-b740-d79174ad7509 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:59 devstack sudo[90738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74.5c37abbc-1e19-454f-b740-d79174ad7509 Jul 07 17:20:59 devstack sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:00 devstack sudo[90738]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-91b088d9-38a8-42c3-8cf2-e3321a2b428a tempest-GroupSnapshotsTest-1142774596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74.5c37abbc-1e19-454f-b740-d79174ad7509" returned: 0 in 1.218s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:00 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-91b088d9-38a8-42c3-8cf2-e3321a2b428a tempest-GroupSnapshotsTest-1142774596 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74.5c37abbc-1e19-454f-b740-d79174ad7509 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:21:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-91b088d9-38a8-42c3-8cf2-e3321a2b428a tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74.5c37abbc-1e19-454f-b740-d79174ad7509 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:00 devstack sudo[90770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74.5c37abbc-1e19-454f-b740-d79174ad7509 Jul 07 17:21:00 devstack sudo[90770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:01 devstack sudo[90770]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-91b088d9-38a8-42c3-8cf2-e3321a2b428a tempest-GroupSnapshotsTest-1142774596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74.5c37abbc-1e19-454f-b740-d79174ad7509" returned: 0 in 1.011s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-91b088d9-38a8-42c3-8cf2-e3321a2b428a tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:01 devstack sudo[90799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74.info Jul 07 17:21:01 devstack sudo[90799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:02 devstack sudo[90799]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-91b088d9-38a8-42c3-8cf2-e3321a2b428a tempest-GroupSnapshotsTest-1142774596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74.info" returned: 0 in 1.159s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:02 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-91b088d9-38a8-42c3-8cf2-e3321a2b428a tempest-GroupSnapshotsTest-1142774596 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:21:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-91b088d9-38a8-42c3-8cf2-e3321a2b428a tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:02 devstack sudo[90820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74.info Jul 07 17:21:02 devstack sudo[90820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:03 devstack sudo[90820]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-91b088d9-38a8-42c3-8cf2-e3321a2b428a tempest-GroupSnapshotsTest-1142774596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74.info" returned: 0 in 0.625s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-91b088d9-38a8-42c3-8cf2-e3321a2b428a tempest-GroupSnapshotsTest-1142774596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.668s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:21:03 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-91b088d9-38a8-42c3-8cf2-e3321a2b428a tempest-GroupSnapshotsTest-1142774596 None] group_snapshot f9e4dfff-caf8-447a-9229-0127ffa47dfb: created successfully Jul 07 17:21:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-2ea7910a-2f69-4694-9af6-2526cb9cbd53 tempest-GroupSnapshotsTest-1142774596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:21:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-2ea7910a-2f69-4694-9af6-2526cb9cbd53 tempest-GroupSnapshotsTest-1142774596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:21:05 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-2ea7910a-2f69-4694-9af6-2526cb9cbd53 tempest-GroupSnapshotsTest-1142774596 None] Acquiring lock "cinder-quobyte-5c37abbc-1e19-454f-b740-d79174ad7509-28c187d3-4b39-44c3-a367-b772df377e86" by "_create_volume_from_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:21:05 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-2ea7910a-2f69-4694-9af6-2526cb9cbd53 tempest-GroupSnapshotsTest-1142774596 None] Lock "cinder-quobyte-5c37abbc-1e19-454f-b740-d79174ad7509-28c187d3-4b39-44c3-a367-b772df377e86" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:21:05 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-2ea7910a-2f69-4694-9af6-2526cb9cbd53 tempest-GroupSnapshotsTest-1142774596 None] Creating volume 28c187d3-4b39-44c3-a367-b772df377e86 from snapshot 5c37abbc-1e19-454f-b740-d79174ad7509 {{(pid=87233) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 17:21:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-2ea7910a-2f69-4694-9af6-2526cb9cbd53 tempest-GroupSnapshotsTest-1142774596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:21:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-2ea7910a-2f69-4694-9af6-2526cb9cbd53 tempest-GroupSnapshotsTest-1142774596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:21:05 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-2ea7910a-2f69-4694-9af6-2526cb9cbd53 tempest-GroupSnapshotsTest-1142774596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:21:05 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-2ea7910a-2f69-4694-9af6-2526cb9cbd53 tempest-GroupSnapshotsTest-1142774596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:21:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-2ea7910a-2f69-4694-9af6-2526cb9cbd53 tempest-GroupSnapshotsTest-1142774596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:21:05 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-2ea7910a-2f69-4694-9af6-2526cb9cbd53 tempest-GroupSnapshotsTest-1142774596 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:21:05 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-2ea7910a-2f69-4694-9af6-2526cb9cbd53 tempest-GroupSnapshotsTest-1142774596 None] Acquiring lock "cinder-quobyte-28c187d3-4b39-44c3-a367-b772df377e86" by "_copy_volume_from_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:21:05 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-2ea7910a-2f69-4694-9af6-2526cb9cbd53 tempest-GroupSnapshotsTest-1142774596 None] Lock "cinder-quobyte-28c187d3-4b39-44c3-a367-b772df377e86" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:21:05 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-2ea7910a-2f69-4694-9af6-2526cb9cbd53 tempest-GroupSnapshotsTest-1142774596 None] snapshot: 5c37abbc-1e19-454f-b740-d79174ad7509, volume: 28c187d3-4b39-44c3-a367-b772df377e86, {{(pid=87233) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 17:21:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-2ea7910a-2f69-4694-9af6-2526cb9cbd53 tempest-GroupSnapshotsTest-1142774596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:21:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-2ea7910a-2f69-4694-9af6-2526cb9cbd53 tempest-GroupSnapshotsTest-1142774596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:21:05 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-2ea7910a-2f69-4694-9af6-2526cb9cbd53 tempest-GroupSnapshotsTest-1142774596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:21:05 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-2ea7910a-2f69-4694-9af6-2526cb9cbd53 tempest-GroupSnapshotsTest-1142774596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:21:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-2ea7910a-2f69-4694-9af6-2526cb9cbd53 tempest-GroupSnapshotsTest-1142774596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:21:05 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb7ef3e-7e3d-4ff4-94dd-8dc6f9d8bfa1]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:21:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2ea7910a-2f69-4694-9af6-2526cb9cbd53 tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74.5c37abbc-1e19-454f-b740-d79174ad7509 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:05 devstack sudo[90872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74.5c37abbc-1e19-454f-b740-d79174ad7509 Jul 07 17:21:05 devstack sudo[90872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:06 devstack sudo[90872]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2ea7910a-2f69-4694-9af6-2526cb9cbd53 tempest-GroupSnapshotsTest-1142774596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74.5c37abbc-1e19-454f-b740-d79174ad7509" returned: 0 in 0.753s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:06 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-2ea7910a-2f69-4694-9af6-2526cb9cbd53 tempest-GroupSnapshotsTest-1142774596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:21:06 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-2ea7910a-2f69-4694-9af6-2526cb9cbd53 tempest-GroupSnapshotsTest-1142774596 None] will copy from snapshot at /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74 {{(pid=87233) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 17:21:06 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-2ea7910a-2f69-4694-9af6-2526cb9cbd53 tempest-GroupSnapshotsTest-1142774596 None] Creating direct copy from snapshot {{(pid=87233) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 17:21:06 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6c25ee-f262-465c-92f4-994a5d7816cd]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:21:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2ea7910a-2f69-4694-9af6-2526cb9cbd53 tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:06 devstack sudo[90877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74 Jul 07 17:21:06 devstack sudo[90877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:07 devstack sudo[90877]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2ea7910a-2f69-4694-9af6-2526cb9cbd53 tempest-GroupSnapshotsTest-1142774596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74" returned: 0 in 1.389s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:07 devstack cinder-volume[87233]: DEBUG cinder.utils [None req-2ea7910a-2f69-4694-9af6-2526cb9cbd53 tempest-GroupSnapshotsTest-1142774596 None] Path /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-28c187d3-4b39-44c3-a367-b772df377e86 not found in is_blk_device check {{(pid=87233) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 17:21:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2ea7910a-2f69-4694-9af6-2526cb9cbd53 tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-28c187d3-4b39-44c3-a367-b772df377e86 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:07 devstack sudo[90930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-28c187d3-4b39-44c3-a367-b772df377e86 Jul 07 17:21:07 devstack sudo[90930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:15 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:SELECT=44,cinder:UPDATE=52,cinder:INSERT=12,cinder:DELETE=2 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:21:15 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:UPDATE=45,cinder:SELECT=57,cinder:DELETE=7,cinder:INSERT=7 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:21:15 devstack sudo[90930]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2ea7910a-2f69-4694-9af6-2526cb9cbd53 tempest-GroupSnapshotsTest-1142774596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-28c187d3-4b39-44c3-a367-b772df377e86" returned: 0 in 8.235s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:15 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07f6bcd-5893-479c-988f-b5671c32cedb]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:21:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2ea7910a-2f69-4694-9af6-2526cb9cbd53 tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:16 devstack sudo[91012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74 Jul 07 17:21:16 devstack sudo[91012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:16 devstack sudo[91012]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2ea7910a-2f69-4694-9af6-2526cb9cbd53 tempest-GroupSnapshotsTest-1142774596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74" returned: 0 in 1.051s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:16 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-2ea7910a-2f69-4694-9af6-2526cb9cbd53 tempest-GroupSnapshotsTest-1142774596 None] Image conversion details: src /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74, size 1024.00 MB, duration 8.24 sec, destination /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-28c187d3-4b39-44c3-a367-b772df377e86 {{(pid=87233) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:21:16 devstack cinder-volume[87233]: INFO cinder.image.image_utils [None req-2ea7910a-2f69-4694-9af6-2526cb9cbd53 tempest-GroupSnapshotsTest-1142774596 None] Converted 1024.00 MB image at 124.30 MB/s Jul 07 17:21:16 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-2ea7910a-2f69-4694-9af6-2526cb9cbd53 tempest-GroupSnapshotsTest-1142774596 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-28c187d3-4b39-44c3-a367-b772df377e86 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:21:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2ea7910a-2f69-4694-9af6-2526cb9cbd53 tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-28c187d3-4b39-44c3-a367-b772df377e86 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:16 devstack sudo[91019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-28c187d3-4b39-44c3-a367-b772df377e86 Jul 07 17:21:16 devstack sudo[91019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:17 devstack sudo[91019]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2ea7910a-2f69-4694-9af6-2526cb9cbd53 tempest-GroupSnapshotsTest-1142774596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-28c187d3-4b39-44c3-a367-b772df377e86" returned: 0 in 0.617s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:17 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-2ea7910a-2f69-4694-9af6-2526cb9cbd53 tempest-GroupSnapshotsTest-1142774596 None] Lock "cinder-quobyte-28c187d3-4b39-44c3-a367-b772df377e86" released by "_copy_volume_from_snapshot" :: held 12.155s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:21:17 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-2ea7910a-2f69-4694-9af6-2526cb9cbd53 tempest-GroupSnapshotsTest-1142774596 None] Lock "cinder-quobyte-5c37abbc-1e19-454f-b740-d79174ad7509-28c187d3-4b39-44c3-a367-b772df377e86" released by "_create_volume_from_snapshot" :: held 12.185s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:21:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-2ea7910a-2f69-4694-9af6-2526cb9cbd53 tempest-GroupSnapshotsTest-1142774596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.204s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:21:17 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-2ea7910a-2f69-4694-9af6-2526cb9cbd53 tempest-GroupSnapshotsTest-1142774596 None] Create group from source-snapshot-f9e4dfff-caf8-447a-9229-0127ffa47dfb completed successfully. Jul 07 17:21:19 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-54e872ea-8d7f-438f-aa9a-b3c01b63e698 tempest-GroupSnapshotsTest-1142774596 None] Acquiring lock "cinder-quobyte-28c187d3-4b39-44c3-a367-b772df377e86" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:21:19 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-54e872ea-8d7f-438f-aa9a-b3c01b63e698 tempest-GroupSnapshotsTest-1142774596 None] Lock "cinder-quobyte-28c187d3-4b39-44c3-a367-b772df377e86" acquired by "delete_volume" :: waited 0.018s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:21:19 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9bc2b30-3959-49a0-8a80-de887d1cc5b4]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:21:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-54e872ea-8d7f-438f-aa9a-b3c01b63e698 tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-28c187d3-4b39-44c3-a367-b772df377e86 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:19 devstack sudo[91022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-28c187d3-4b39-44c3-a367-b772df377e86 Jul 07 17:21:19 devstack sudo[91022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:19 devstack sudo[91022]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-54e872ea-8d7f-438f-aa9a-b3c01b63e698 tempest-GroupSnapshotsTest-1142774596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-28c187d3-4b39-44c3-a367-b772df377e86" returned: 0 in 0.793s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-54e872ea-8d7f-438f-aa9a-b3c01b63e698 tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-28c187d3-4b39-44c3-a367-b772df377e86 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:19 devstack sudo[91031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-28c187d3-4b39-44c3-a367-b772df377e86 Jul 07 17:21:19 devstack sudo[91031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:20 devstack sudo[91031]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-54e872ea-8d7f-438f-aa9a-b3c01b63e698 tempest-GroupSnapshotsTest-1142774596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-28c187d3-4b39-44c3-a367-b772df377e86" returned: 0 in 0.696s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:20 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-54e872ea-8d7f-438f-aa9a-b3c01b63e698 tempest-GroupSnapshotsTest-1142774596 None] Lock "cinder-quobyte-28c187d3-4b39-44c3-a367-b772df377e86" released by "delete_volume" :: held 1.528s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:21:20 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-54e872ea-8d7f-438f-aa9a-b3c01b63e698 tempest-GroupSnapshotsTest-1142774596 None] Created reservations ['494ab0ea-8862-4fa0-8f52-54ecda636cc5'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:21:20 devstack cinder-volume[87233]: WARNING cinder.quota [None req-54e872ea-8d7f-438f-aa9a-b3c01b63e698 tempest-GroupSnapshotsTest-1142774596 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-892038246 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-892038246, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:21:20 devstack cinder-volume[87233]: WARNING cinder.quota [None req-54e872ea-8d7f-438f-aa9a-b3c01b63e698 tempest-GroupSnapshotsTest-1142774596 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-892038246 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-892038246, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:21:20 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-54e872ea-8d7f-438f-aa9a-b3c01b63e698 tempest-GroupSnapshotsTest-1142774596 None] Created reservations ['39ad5b71-70ab-49eb-9ed0-4a248696927f', '7868ca2c-6957-44e9-ab24-b5e8e69b2f88', 'c8c1c568-d55c-4229-bc40-4e28b9819349', 'fb9ae400-dc37-4d31-b069-628375651e59'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:21:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-54e872ea-8d7f-438f-aa9a-b3c01b63e698 tempest-GroupSnapshotsTest-1142774596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:21:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-54e872ea-8d7f-438f-aa9a-b3c01b63e698 tempest-GroupSnapshotsTest-1142774596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:21:20 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-54e872ea-8d7f-438f-aa9a-b3c01b63e698 tempest-GroupSnapshotsTest-1142774596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:21:20 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-54e872ea-8d7f-438f-aa9a-b3c01b63e698 tempest-GroupSnapshotsTest-1142774596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:21:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-54e872ea-8d7f-438f-aa9a-b3c01b63e698 tempest-GroupSnapshotsTest-1142774596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:21:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-54e872ea-8d7f-438f-aa9a-b3c01b63e698 tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:20 devstack sudo[91037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:21:20 devstack sudo[91037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:21 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-d009b536-9009-4bf5-b62c-7bee5ccbb85e tempest-GroupSnapshotsTest-1142774596 None] group_snapshot f9e4dfff-caf8-447a-9229-0127ffa47dfb: deleting Jul 07 17:21:21 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d009b536-9009-4bf5-b62c-7bee5ccbb85e tempest-GroupSnapshotsTest-1142774596 None] group_snapshot f9e4dfff-caf8-447a-9229-0127ffa47dfb: deleting {{(pid=87233) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 07 17:21:21 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d009b536-9009-4bf5-b62c-7bee5ccbb85e tempest-GroupSnapshotsTest-1142774596 None] Acquiring lock "cinder-quobyte-83ed14aa-1196-4ff2-8f68-8053cd7f7f74" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:21:21 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d009b536-9009-4bf5-b62c-7bee5ccbb85e tempest-GroupSnapshotsTest-1142774596 None] Lock "cinder-quobyte-83ed14aa-1196-4ff2-8f68-8053cd7f7f74" acquired by "delete_snapshot" :: waited 0.089s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:21:21 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d009b536-9009-4bf5-b62c-7bee5ccbb85e tempest-GroupSnapshotsTest-1142774596 None] Acquiring lock "cinder-quobyte-5c37abbc-1e19-454f-b740-d79174ad7509" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:21:21 devstack sudo[91037]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:21 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d009b536-9009-4bf5-b62c-7bee5ccbb85e tempest-GroupSnapshotsTest-1142774596 None] Lock "cinder-quobyte-5c37abbc-1e19-454f-b740-d79174ad7509" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:21:21 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-d009b536-9009-4bf5-b62c-7bee5ccbb85e tempest-GroupSnapshotsTest-1142774596 None] Deleting offline snapshot 5c37abbc-1e19-454f-b740-d79174ad7509 of volume 83ed14aa-1196-4ff2-8f68-8053cd7f7f74 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:21:22 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-d009b536-9009-4bf5-b62c-7bee5ccbb85e tempest-GroupSnapshotsTest-1142774596 None] snapshot_file for this snap is: volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74.5c37abbc-1e19-454f-b740-d79174ad7509 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:21:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-54e872ea-8d7f-438f-aa9a-b3c01b63e698 tempest-GroupSnapshotsTest-1142774596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 1.170s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:22 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-54e872ea-8d7f-438f-aa9a-b3c01b63e698 tempest-GroupSnapshotsTest-1142774596 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:21:22 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-54e872ea-8d7f-438f-aa9a-b3c01b63e698 tempest-GroupSnapshotsTest-1142774596 None] Delete group completed successfully. Jul 07 17:21:22 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ba7a59-8db8-4857-8b70-cfab07a97bb5]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:21:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d009b536-9009-4bf5-b62c-7bee5ccbb85e tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74.5c37abbc-1e19-454f-b740-d79174ad7509 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:22 devstack sudo[91041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74.5c37abbc-1e19-454f-b740-d79174ad7509 Jul 07 17:21:22 devstack sudo[91041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:23 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-72e65443-a957-40e7-a510-214a0383c3e2 tempest-TaggedAttachmentsTest-571150945 None] Acquiring lock "cinder-858be2b7-2b7c-45d1-8367-a828e776c81a-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:21:23 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-72e65443-a957-40e7-a510-214a0383c3e2 tempest-TaggedAttachmentsTest-571150945 None] Lock "cinder-858be2b7-2b7c-45d1-8367-a828e776c81a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:21:23 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-72e65443-a957-40e7-a510-214a0383c3e2 tempest-TaggedAttachmentsTest-571150945 None] Acquiring lock "cinder-quobyte-858be2b7-2b7c-45d1-8367-a828e776c81a" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:21:23 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-72e65443-a957-40e7-a510-214a0383c3e2 tempest-TaggedAttachmentsTest-571150945 None] Lock "cinder-quobyte-858be2b7-2b7c-45d1-8367-a828e776c81a" acquired by "delete_volume" :: waited 0.018s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:21:23 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5bcaa0-045a-4eb4-802d-102ff4997de6]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:21:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-72e65443-a957-40e7-a510-214a0383c3e2 tempest-TaggedAttachmentsTest-571150945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-858be2b7-2b7c-45d1-8367-a828e776c81a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:23 devstack sudo[91041]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d009b536-9009-4bf5-b62c-7bee5ccbb85e tempest-GroupSnapshotsTest-1142774596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74.5c37abbc-1e19-454f-b740-d79174ad7509" returned: 0 in 1.191s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:23 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-d009b536-9009-4bf5-b62c-7bee5ccbb85e tempest-GroupSnapshotsTest-1142774596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:21:23 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd38c37-3cd8-4015-aa39-e80012197634]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:21:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d009b536-9009-4bf5-b62c-7bee5ccbb85e tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:23 devstack sudo[91047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-858be2b7-2b7c-45d1-8367-a828e776c81a Jul 07 17:21:23 devstack sudo[91047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:23 devstack sudo[91050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74 Jul 07 17:21:23 devstack sudo[91050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:23 devstack sudo[91047]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-72e65443-a957-40e7-a510-214a0383c3e2 tempest-TaggedAttachmentsTest-571150945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-858be2b7-2b7c-45d1-8367-a828e776c81a" returned: 0 in 0.787s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-72e65443-a957-40e7-a510-214a0383c3e2 tempest-TaggedAttachmentsTest-571150945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-858be2b7-2b7c-45d1-8367-a828e776c81a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:24 devstack sudo[91063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-858be2b7-2b7c-45d1-8367-a828e776c81a Jul 07 17:21:24 devstack sudo[91063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:24 devstack sudo[91050]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d009b536-9009-4bf5-b62c-7bee5ccbb85e tempest-GroupSnapshotsTest-1142774596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74" returned: 0 in 0.823s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d009b536-9009-4bf5-b62c-7bee5ccbb85e tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74.5c37abbc-1e19-454f-b740-d79174ad7509 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:24 devstack sudo[91068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74.5c37abbc-1e19-454f-b740-d79174ad7509 Jul 07 17:21:24 devstack sudo[91068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:24 devstack sudo[91063]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-72e65443-a957-40e7-a510-214a0383c3e2 tempest-TaggedAttachmentsTest-571150945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-858be2b7-2b7c-45d1-8367-a828e776c81a" returned: 0 in 0.778s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:24 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-72e65443-a957-40e7-a510-214a0383c3e2 tempest-TaggedAttachmentsTest-571150945 None] Lock "cinder-quobyte-858be2b7-2b7c-45d1-8367-a828e776c81a" released by "delete_volume" :: held 1.635s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:21:24 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-72e65443-a957-40e7-a510-214a0383c3e2 tempest-TaggedAttachmentsTest-571150945 None] Created reservations ['7839c925-53ed-4e5c-82cf-a6e8217d0e53', '028c1366-711a-49d0-8a03-ae3a7f61b5ce', '3750b188-7b15-42e0-85ea-ac48a964d8b3', 'a52957b2-a699-4a7b-bef1-7b90bca96181'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:21:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-72e65443-a957-40e7-a510-214a0383c3e2 tempest-TaggedAttachmentsTest-571150945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:21:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-72e65443-a957-40e7-a510-214a0383c3e2 tempest-TaggedAttachmentsTest-571150945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:21:24 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-72e65443-a957-40e7-a510-214a0383c3e2 tempest-TaggedAttachmentsTest-571150945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:21:24 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-72e65443-a957-40e7-a510-214a0383c3e2 tempest-TaggedAttachmentsTest-571150945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:21:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-72e65443-a957-40e7-a510-214a0383c3e2 tempest-TaggedAttachmentsTest-571150945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:21:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-72e65443-a957-40e7-a510-214a0383c3e2 tempest-TaggedAttachmentsTest-571150945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:24 devstack sudo[91076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:21:24 devstack sudo[91076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:24 devstack sudo[91068]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d009b536-9009-4bf5-b62c-7bee5ccbb85e tempest-GroupSnapshotsTest-1142774596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74.5c37abbc-1e19-454f-b740-d79174ad7509" returned: 0 in 0.855s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d009b536-9009-4bf5-b62c-7bee5ccbb85e tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74.5c37abbc-1e19-454f-b740-d79174ad7509 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:24 devstack sudo[91078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74.5c37abbc-1e19-454f-b740-d79174ad7509 Jul 07 17:21:24 devstack sudo[91078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:25 devstack sudo[91076]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-72e65443-a957-40e7-a510-214a0383c3e2 tempest-TaggedAttachmentsTest-571150945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.706s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:25 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-72e65443-a957-40e7-a510-214a0383c3e2 tempest-TaggedAttachmentsTest-571150945 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:21:25 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-72e65443-a957-40e7-a510-214a0383c3e2 tempest-TaggedAttachmentsTest-571150945 None] Deleted volume successfully. Jul 07 17:21:25 devstack sudo[91078]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d009b536-9009-4bf5-b62c-7bee5ccbb85e tempest-GroupSnapshotsTest-1142774596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74.5c37abbc-1e19-454f-b740-d79174ad7509" returned: 0 in 0.688s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:25 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d009b536-9009-4bf5-b62c-7bee5ccbb85e tempest-GroupSnapshotsTest-1142774596 None] Lock "cinder-quobyte-5c37abbc-1e19-454f-b740-d79174ad7509" released by "_delete_snapshot" :: held 3.736s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:21:25 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-72e65443-a957-40e7-a510-214a0383c3e2 tempest-TaggedAttachmentsTest-571150945 None] Lock "cinder-858be2b7-2b7c-45d1-8367-a828e776c81a-delete_volume" released by "delete_volume" :: held 2.608s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:21:25 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d009b536-9009-4bf5-b62c-7bee5ccbb85e tempest-GroupSnapshotsTest-1142774596 None] Lock "cinder-quobyte-83ed14aa-1196-4ff2-8f68-8053cd7f7f74" released by "delete_snapshot" :: held 3.782s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:21:25 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-3344fb85-b725-4854-ba9a-b63865081353 req-c362d122-c20f-4822-b7e0-0fced2c6c3e9 tempest-AttachVolumeTestJSON-841000093 None] Terminate volume connection completed successfully. Jul 07 17:21:25 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-3344fb85-b725-4854-ba9a-b63865081353 req-c362d122-c20f-4822-b7e0-0fced2c6c3e9 tempest-AttachVolumeTestJSON-841000093 None] Deleting attachment e861ef86-b53e-4106-8c20-1778fabba2aa. {{(pid=87233) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:21:25 devstack cinder-volume[87233]: WARNING cinder.quota [None req-d009b536-9009-4bf5-b62c-7bee5ccbb85e tempest-GroupSnapshotsTest-1142774596 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-892038246 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-892038246, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:21:25 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-d009b536-9009-4bf5-b62c-7bee5ccbb85e tempest-GroupSnapshotsTest-1142774596 None] Created reservations ['03f67916-3c32-4345-90ff-e3ddc6ef69e0', 'dde24a36-b409-440e-97d8-b058a23108ba', '587ab285-59ae-4a07-888f-29ead1db94c6', '4c64eb23-d7d0-411e-8981-5628a9d17ee3'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:21:25 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-d009b536-9009-4bf5-b62c-7bee5ccbb85e tempest-GroupSnapshotsTest-1142774596 None] group_snapshot f9e4dfff-caf8-447a-9229-0127ffa47dfb: deleted successfully Jul 07 17:21:26 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0bde8a09-27b5-4a5b-ae53-c649963655b6 tempest-GroupSnapshotsTest-1142774596 None] Acquiring lock "cinder-quobyte-83ed14aa-1196-4ff2-8f68-8053cd7f7f74" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:21:26 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0bde8a09-27b5-4a5b-ae53-c649963655b6 tempest-GroupSnapshotsTest-1142774596 None] Lock "cinder-quobyte-83ed14aa-1196-4ff2-8f68-8053cd7f7f74" acquired by "delete_volume" :: waited 0.017s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:21:26 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b352f3-46f2-43a1-8641-904ab3ac6959]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:21:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0bde8a09-27b5-4a5b-ae53-c649963655b6 tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:26 devstack sudo[91086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74 Jul 07 17:21:26 devstack sudo[91086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:27 devstack sudo[91086]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0bde8a09-27b5-4a5b-ae53-c649963655b6 tempest-GroupSnapshotsTest-1142774596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74" returned: 0 in 0.895s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0bde8a09-27b5-4a5b-ae53-c649963655b6 tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:27 devstack sudo[91092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74 Jul 07 17:21:27 devstack sudo[91092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:28 devstack sudo[91092]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0bde8a09-27b5-4a5b-ae53-c649963655b6 tempest-GroupSnapshotsTest-1142774596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83ed14aa-1196-4ff2-8f68-8053cd7f7f74" returned: 0 in 0.742s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:28 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0bde8a09-27b5-4a5b-ae53-c649963655b6 tempest-GroupSnapshotsTest-1142774596 None] Lock "cinder-quobyte-83ed14aa-1196-4ff2-8f68-8053cd7f7f74" released by "delete_volume" :: held 1.739s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:21:28 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-0bde8a09-27b5-4a5b-ae53-c649963655b6 tempest-GroupSnapshotsTest-1142774596 None] Created reservations ['4e7d4021-800a-4314-a038-702c8beef1f7'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:21:28 devstack cinder-volume[87233]: WARNING cinder.db.api [None req-0bde8a09-27b5-4a5b-ae53-c649963655b6 tempest-GroupSnapshotsTest-1142774596 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-892038246'] Jul 07 17:21:28 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-0bde8a09-27b5-4a5b-ae53-c649963655b6 tempest-GroupSnapshotsTest-1142774596 None] Created reservations ['80b6ae28-49a1-40f5-ab07-5743f9ed0170', '81dde355-3c3d-438f-b9e8-87a78326cc93', 'aad5f56d-988f-4354-98c9-e22c872a0eb3', '739047dc-9661-43e5-89e3-9189acd7d235'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:21:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0bde8a09-27b5-4a5b-ae53-c649963655b6 tempest-GroupSnapshotsTest-1142774596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:21:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0bde8a09-27b5-4a5b-ae53-c649963655b6 tempest-GroupSnapshotsTest-1142774596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:21:28 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-0bde8a09-27b5-4a5b-ae53-c649963655b6 tempest-GroupSnapshotsTest-1142774596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:21:28 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-0bde8a09-27b5-4a5b-ae53-c649963655b6 tempest-GroupSnapshotsTest-1142774596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:21:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0bde8a09-27b5-4a5b-ae53-c649963655b6 tempest-GroupSnapshotsTest-1142774596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:21:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0bde8a09-27b5-4a5b-ae53-c649963655b6 tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:28 devstack sudo[91099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:21:28 devstack sudo[91099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:29 devstack sudo[91099]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0bde8a09-27b5-4a5b-ae53-c649963655b6 tempest-GroupSnapshotsTest-1142774596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.691s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:29 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-0bde8a09-27b5-4a5b-ae53-c649963655b6 tempest-GroupSnapshotsTest-1142774596 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:21:29 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-0bde8a09-27b5-4a5b-ae53-c649963655b6 tempest-GroupSnapshotsTest-1142774596 None] Delete group completed successfully. Jul 07 17:21:29 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-43f32198-2e6e-4c6b-b86d-51a3155b0a65 tempest-GroupSnapshotsTest-1142774596 None] Group tempest-GroupSnapshotsTest-Group-1156062505: creating Jul 07 17:21:29 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-43f32198-2e6e-4c6b-b86d-51a3155b0a65 tempest-GroupSnapshotsTest-1142774596 None] Group tempest-GroupSnapshotsTest-Group-1156062505: created successfully Jul 07 17:21:29 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-43f32198-2e6e-4c6b-b86d-51a3155b0a65 tempest-GroupSnapshotsTest-1142774596 None] Create group completed successfully. Jul 07 17:21:31 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-a82edbd7-9ee9-49ad-81e9-0e59e252663d tempest-GroupSnapshotsTest-1142774596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:21:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a82edbd7-9ee9-49ad-81e9-0e59e252663d tempest-GroupSnapshotsTest-1142774596 None] Flow 'volume_create_manager' (3aeefbb0-9ef9-4065-b3e0-ca78a0d82652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:21:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a82edbd7-9ee9-49ad-81e9-0e59e252663d tempest-GroupSnapshotsTest-1142774596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e66e245-fb37-4717-bda8-66e8293ab5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a82edbd7-9ee9-49ad-81e9-0e59e252663d tempest-GroupSnapshotsTest-1142774596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e66e245-fb37-4717-bda8-66e8293ab5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2115887082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=23009ef9-d704-4358-b65c-a46706a76b4b,host='devstack@QuobyteHD#QuobyteHD',id=8535e0b4-8622-4661-99b0-900538c9b651,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='688fe61f18a44f83a0b94be8baeb6a9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:21:32Z,use_quota=True,user_id='aef3db228fa847e392768b411452dfcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(264f7191-3eb2-4276-99b3-abfcb9ca648c),volume_type_id=264f7191-3eb2-4276-99b3-abfcb9ca648c)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a82edbd7-9ee9-49ad-81e9-0e59e252663d tempest-GroupSnapshotsTest-1142774596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66005335-a24d-4390-a205-b78d051886a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a82edbd7-9ee9-49ad-81e9-0e59e252663d tempest-GroupSnapshotsTest-1142774596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66005335-a24d-4390-a205-b78d051886a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a82edbd7-9ee9-49ad-81e9-0e59e252663d tempest-GroupSnapshotsTest-1142774596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b849c49a-5618-4298-9080-cf7fa87bcd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a82edbd7-9ee9-49ad-81e9-0e59e252663d tempest-GroupSnapshotsTest-1142774596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b849c49a-5618-4298-9080-cf7fa87bcd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8535e0b4-8622-4661-99b0-900538c9b651', 'volume_name': 'volume-8535e0b4-8622-4661-99b0-900538c9b651', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a82edbd7-9ee9-49ad-81e9-0e59e252663d tempest-GroupSnapshotsTest-1142774596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00b16e66-6966-43ef-91a7-2f57538b7ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a82edbd7-9ee9-49ad-81e9-0e59e252663d tempest-GroupSnapshotsTest-1142774596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00b16e66-6966-43ef-91a7-2f57538b7ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a82edbd7-9ee9-49ad-81e9-0e59e252663d tempest-GroupSnapshotsTest-1142774596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a2b3bba-76cd-4c50-a24f-6d0542b00e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:31 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-a82edbd7-9ee9-49ad-81e9-0e59e252663d tempest-GroupSnapshotsTest-1142774596 None] Volume 8535e0b4-8622-4661-99b0-900538c9b651: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8535e0b4-8622-4661-99b0-900538c9b651', 'volume_size': 1} Jul 07 17:21:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a82edbd7-9ee9-49ad-81e9-0e59e252663d tempest-GroupSnapshotsTest-1142774596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:21:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a82edbd7-9ee9-49ad-81e9-0e59e252663d tempest-GroupSnapshotsTest-1142774596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:21:31 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-a82edbd7-9ee9-49ad-81e9-0e59e252663d tempest-GroupSnapshotsTest-1142774596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=23009ef9-d704-4358-b65c-a46706a76b4b,created_at=2026-07-07T15:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2115887082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=23009ef9-d704-4358-b65c-a46706a76b4b,host='devstack@QuobyteHD#QuobyteHD',id=8535e0b4-8622-4661-99b0-900538c9b651,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='688fe61f18a44f83a0b94be8baeb6a9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:21:32Z,use_quota=True,user_id='aef3db228fa847e392768b411452dfcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(264f7191-3eb2-4276-99b3-abfcb9ca648c),volume_type_id=264f7191-3eb2-4276-99b3-abfcb9ca648c)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:21:31 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-a82edbd7-9ee9-49ad-81e9-0e59e252663d tempest-GroupSnapshotsTest-1142774596 None] Creating volume 8535e0b4-8622-4661-99b0-900538c9b651 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:21:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a82edbd7-9ee9-49ad-81e9-0e59e252663d tempest-GroupSnapshotsTest-1142774596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:21:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a82edbd7-9ee9-49ad-81e9-0e59e252663d tempest-GroupSnapshotsTest-1142774596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:21:31 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-a82edbd7-9ee9-49ad-81e9-0e59e252663d tempest-GroupSnapshotsTest-1142774596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:21:31 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-a82edbd7-9ee9-49ad-81e9-0e59e252663d tempest-GroupSnapshotsTest-1142774596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:21:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a82edbd7-9ee9-49ad-81e9-0e59e252663d tempest-GroupSnapshotsTest-1142774596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:21:31 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-a82edbd7-9ee9-49ad-81e9-0e59e252663d tempest-GroupSnapshotsTest-1142774596 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:21:31 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-a82edbd7-9ee9-49ad-81e9-0e59e252663d tempest-GroupSnapshotsTest-1142774596 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:21:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a82edbd7-9ee9-49ad-81e9-0e59e252663d tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8535e0b4-8622-4661-99b0-900538c9b651 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:31 devstack sudo[91106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8535e0b4-8622-4661-99b0-900538c9b651 1073741824 Jul 07 17:21:31 devstack sudo[91106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:32 devstack sudo[91106]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a82edbd7-9ee9-49ad-81e9-0e59e252663d tempest-GroupSnapshotsTest-1142774596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8535e0b4-8622-4661-99b0-900538c9b651 1073741824" returned: 0 in 1.047s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a82edbd7-9ee9-49ad-81e9-0e59e252663d tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8535e0b4-8622-4661-99b0-900538c9b651 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:32 devstack sudo[91112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8535e0b4-8622-4661-99b0-900538c9b651 Jul 07 17:21:32 devstack sudo[91112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:33 devstack sudo[91112]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a82edbd7-9ee9-49ad-81e9-0e59e252663d tempest-GroupSnapshotsTest-1142774596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8535e0b4-8622-4661-99b0-900538c9b651" returned: 0 in 0.675s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:33 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-a82edbd7-9ee9-49ad-81e9-0e59e252663d tempest-GroupSnapshotsTest-1142774596 None] <== create_volume: return (1812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:21:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a82edbd7-9ee9-49ad-81e9-0e59e252663d tempest-GroupSnapshotsTest-1142774596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.814s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:21:33 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a82edbd7-9ee9-49ad-81e9-0e59e252663d tempest-GroupSnapshotsTest-1142774596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a2b3bba-76cd-4c50-a24f-6d0542b00e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8535e0b4-8622-4661-99b0-900538c9b651', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:33 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a82edbd7-9ee9-49ad-81e9-0e59e252663d tempest-GroupSnapshotsTest-1142774596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5f9ee37-2b0a-49db-88c4-c3970473379b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:33 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-a82edbd7-9ee9-49ad-81e9-0e59e252663d tempest-GroupSnapshotsTest-1142774596 None] Volume volume-8535e0b4-8622-4661-99b0-900538c9b651 (8535e0b4-8622-4661-99b0-900538c9b651): created successfully Jul 07 17:21:33 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a82edbd7-9ee9-49ad-81e9-0e59e252663d tempest-GroupSnapshotsTest-1142774596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5f9ee37-2b0a-49db-88c4-c3970473379b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:33 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a82edbd7-9ee9-49ad-81e9-0e59e252663d tempest-GroupSnapshotsTest-1142774596 None] Flow 'volume_create_manager' (3aeefbb0-9ef9-4065-b3e0-ca78a0d82652) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:21:33 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-a82edbd7-9ee9-49ad-81e9-0e59e252663d tempest-GroupSnapshotsTest-1142774596 None] Created volume successfully. Jul 07 17:21:34 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-c68fcb79-15b8-4891-943c-ffd4743c4daf tempest-GroupSnapshotsTest-1142774596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:21:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c68fcb79-15b8-4891-943c-ffd4743c4daf tempest-GroupSnapshotsTest-1142774596 None] Flow 'volume_create_manager' (0307fdac-53c1-4f1c-be94-ca717ac95dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:21:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c68fcb79-15b8-4891-943c-ffd4743c4daf tempest-GroupSnapshotsTest-1142774596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c9f62a3-4087-411a-8506-6ff6fa18504b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c68fcb79-15b8-4891-943c-ffd4743c4daf tempest-GroupSnapshotsTest-1142774596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c9f62a3-4087-411a-8506-6ff6fa18504b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:21:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1029651578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=23009ef9-d704-4358-b65c-a46706a76b4b,host='devstack@QuobyteHD#QuobyteHD',id=859ade0f-fdb0-4b71-9aca-3cd4a7e8864f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='688fe61f18a44f83a0b94be8baeb6a9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:21:35Z,use_quota=True,user_id='aef3db228fa847e392768b411452dfcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(264f7191-3eb2-4276-99b3-abfcb9ca648c),volume_type_id=264f7191-3eb2-4276-99b3-abfcb9ca648c)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c68fcb79-15b8-4891-943c-ffd4743c4daf tempest-GroupSnapshotsTest-1142774596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6fd9edd-08bf-443c-b6b6-6c4e4bea7b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c68fcb79-15b8-4891-943c-ffd4743c4daf tempest-GroupSnapshotsTest-1142774596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6fd9edd-08bf-443c-b6b6-6c4e4bea7b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c68fcb79-15b8-4891-943c-ffd4743c4daf tempest-GroupSnapshotsTest-1142774596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7243fa7b-c90c-4d3f-b228-535e5ff85e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c68fcb79-15b8-4891-943c-ffd4743c4daf tempest-GroupSnapshotsTest-1142774596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7243fa7b-c90c-4d3f-b228-535e5ff85e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '859ade0f-fdb0-4b71-9aca-3cd4a7e8864f', 'volume_name': 'volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c68fcb79-15b8-4891-943c-ffd4743c4daf tempest-GroupSnapshotsTest-1142774596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb9a7670-740c-4697-ab6b-b103b5018577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c68fcb79-15b8-4891-943c-ffd4743c4daf tempest-GroupSnapshotsTest-1142774596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb9a7670-740c-4697-ab6b-b103b5018577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c68fcb79-15b8-4891-943c-ffd4743c4daf tempest-GroupSnapshotsTest-1142774596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8494d169-bf74-4cff-809f-827f9d3f3d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:34 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-c68fcb79-15b8-4891-943c-ffd4743c4daf tempest-GroupSnapshotsTest-1142774596 None] Volume 859ade0f-fdb0-4b71-9aca-3cd4a7e8864f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f', 'volume_size': 1} Jul 07 17:21:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c68fcb79-15b8-4891-943c-ffd4743c4daf tempest-GroupSnapshotsTest-1142774596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:21:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c68fcb79-15b8-4891-943c-ffd4743c4daf tempest-GroupSnapshotsTest-1142774596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:21:34 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c68fcb79-15b8-4891-943c-ffd4743c4daf tempest-GroupSnapshotsTest-1142774596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=23009ef9-d704-4358-b65c-a46706a76b4b,created_at=2026-07-07T15:21:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1029651578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=23009ef9-d704-4358-b65c-a46706a76b4b,host='devstack@QuobyteHD#QuobyteHD',id=859ade0f-fdb0-4b71-9aca-3cd4a7e8864f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='688fe61f18a44f83a0b94be8baeb6a9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:21:35Z,use_quota=True,user_id='aef3db228fa847e392768b411452dfcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(264f7191-3eb2-4276-99b3-abfcb9ca648c),volume_type_id=264f7191-3eb2-4276-99b3-abfcb9ca648c)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:21:34 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-c68fcb79-15b8-4891-943c-ffd4743c4daf tempest-GroupSnapshotsTest-1142774596 None] Creating volume 859ade0f-fdb0-4b71-9aca-3cd4a7e8864f {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:21:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c68fcb79-15b8-4891-943c-ffd4743c4daf tempest-GroupSnapshotsTest-1142774596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:21:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c68fcb79-15b8-4891-943c-ffd4743c4daf tempest-GroupSnapshotsTest-1142774596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:21:34 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c68fcb79-15b8-4891-943c-ffd4743c4daf tempest-GroupSnapshotsTest-1142774596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:21:34 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c68fcb79-15b8-4891-943c-ffd4743c4daf tempest-GroupSnapshotsTest-1142774596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:21:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c68fcb79-15b8-4891-943c-ffd4743c4daf tempest-GroupSnapshotsTest-1142774596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:21:34 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c68fcb79-15b8-4891-943c-ffd4743c4daf tempest-GroupSnapshotsTest-1142774596 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:21:34 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-c68fcb79-15b8-4891-943c-ffd4743c4daf tempest-GroupSnapshotsTest-1142774596 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:21:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c68fcb79-15b8-4891-943c-ffd4743c4daf tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:34 devstack sudo[91117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f 1073741824 Jul 07 17:21:34 devstack sudo[91117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:36 devstack sudo[91117]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c68fcb79-15b8-4891-943c-ffd4743c4daf tempest-GroupSnapshotsTest-1142774596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f 1073741824" returned: 0 in 1.311s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c68fcb79-15b8-4891-943c-ffd4743c4daf tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:36 devstack sudo[91144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f Jul 07 17:21:36 devstack sudo[91144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:36 devstack sudo[91144]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c68fcb79-15b8-4891-943c-ffd4743c4daf tempest-GroupSnapshotsTest-1142774596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f" returned: 0 in 0.763s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:36 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c68fcb79-15b8-4891-943c-ffd4743c4daf tempest-GroupSnapshotsTest-1142774596 None] <== create_volume: return (2136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:21:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c68fcb79-15b8-4891-943c-ffd4743c4daf tempest-GroupSnapshotsTest-1142774596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.138s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:21:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c68fcb79-15b8-4891-943c-ffd4743c4daf tempest-GroupSnapshotsTest-1142774596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8494d169-bf74-4cff-809f-827f9d3f3d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c68fcb79-15b8-4891-943c-ffd4743c4daf tempest-GroupSnapshotsTest-1142774596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (617bd5bd-6500-46fc-95b7-6aa0bf7db2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:36 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-c68fcb79-15b8-4891-943c-ffd4743c4daf tempest-GroupSnapshotsTest-1142774596 None] Volume volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f (859ade0f-fdb0-4b71-9aca-3cd4a7e8864f): created successfully Jul 07 17:21:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c68fcb79-15b8-4891-943c-ffd4743c4daf tempest-GroupSnapshotsTest-1142774596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (617bd5bd-6500-46fc-95b7-6aa0bf7db2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c68fcb79-15b8-4891-943c-ffd4743c4daf tempest-GroupSnapshotsTest-1142774596 None] Flow 'volume_create_manager' (0307fdac-53c1-4f1c-be94-ca717ac95dd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:21:36 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-c68fcb79-15b8-4891-943c-ffd4743c4daf tempest-GroupSnapshotsTest-1142774596 None] Created volume successfully. Jul 07 17:21:37 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-79b58aec-c56c-417e-b753-7761e3616f59 tempest-GroupSnapshotsTest-1142774596 None] Update group completed successfully. Jul 07 17:21:38 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-140f2adf-4913-48ce-a5d3-b697e670fcb1 tempest-GroupSnapshotsTest-1142774596 None] Update group completed successfully. Jul 07 17:21:40 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-648129f5-c8d4-4809-916d-b3557bb418d5 tempest-GroupSnapshotsTest-1142774596 None] Update group completed successfully. Jul 07 17:21:41 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-59cc9ea7-13f8-4031-be9d-acf23ce49a61 tempest-GroupSnapshotsTest-1142774596 None] Update group completed successfully. Jul 07 17:21:43 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-1d914000-81e0-4a1f-909e-8b6e600b4d05 tempest-GroupSnapshotsTest-1142774596 None] GroupSnapshot 2a48cc26-f369-4471-836f-3eaaf6cec824: creating. Jul 07 17:21:43 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-1d914000-81e0-4a1f-909e-8b6e600b4d05 tempest-GroupSnapshotsTest-1142774596 None] Group snapshot 2a48cc26-f369-4471-836f-3eaaf6cec824: creating. {{(pid=87233) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 07 17:21:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1d914000-81e0-4a1f-909e-8b6e600b4d05 tempest-GroupSnapshotsTest-1142774596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:21:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1d914000-81e0-4a1f-909e-8b6e600b4d05 tempest-GroupSnapshotsTest-1142774596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:21:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-1d914000-81e0-4a1f-909e-8b6e600b4d05 tempest-GroupSnapshotsTest-1142774596 None] Creating offline snapshot 22aa9831-da27-42a7-b47b-9d204d882975 of volume 8535e0b4-8622-4661-99b0-900538c9b651 {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:21:43 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d873196-c09d-4967-ac6f-60a469110d3c]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:21:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1d914000-81e0-4a1f-909e-8b6e600b4d05 tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8535e0b4-8622-4661-99b0-900538c9b651 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:43 devstack sudo[91261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8535e0b4-8622-4661-99b0-900538c9b651 Jul 07 17:21:43 devstack sudo[91261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:43 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:21:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:21:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:21:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:21:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:21:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:21:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:43 devstack sudo[91263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:21:43 devstack sudo[91263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:44 devstack sudo[91261]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1d914000-81e0-4a1f-909e-8b6e600b4d05 tempest-GroupSnapshotsTest-1142774596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8535e0b4-8622-4661-99b0-900538c9b651" returned: 0 in 1.250s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1d914000-81e0-4a1f-909e-8b6e600b4d05 tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8535e0b4-8622-4661-99b0-900538c9b651,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8535e0b4-8622-4661-99b0-900538c9b651.22aa9831-da27-42a7-b47b-9d204d882975 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:44 devstack sudo[91269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8535e0b4-8622-4661-99b0-900538c9b651,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8535e0b4-8622-4661-99b0-900538c9b651.22aa9831-da27-42a7-b47b-9d204d882975 1G Jul 07 17:21:44 devstack sudo[91269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:44 devstack sudo[91263]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 1.185s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:44 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:21:44 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:21:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread count: 8 {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:21:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread info: [<_MainThread(MainThread, started 126077716062336)>, , , , , , , ] {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:21:45 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3be76083-9da2-4a4d-aaf6-424eb75c56c2 tempest-AttachVolumeShelveTestJSON-1359496486 None] Acquiring lock "cinder-f6cc2830-b1ba-4ce6-ae34-a2fc526d3b27-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:21:45 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3be76083-9da2-4a4d-aaf6-424eb75c56c2 tempest-AttachVolumeShelveTestJSON-1359496486 None] Lock "cinder-f6cc2830-b1ba-4ce6-ae34-a2fc526d3b27-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:21:45 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3be76083-9da2-4a4d-aaf6-424eb75c56c2 tempest-AttachVolumeShelveTestJSON-1359496486 None] Acquiring lock "cinder-quobyte-f6cc2830-b1ba-4ce6-ae34-a2fc526d3b27" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:21:45 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3be76083-9da2-4a4d-aaf6-424eb75c56c2 tempest-AttachVolumeShelveTestJSON-1359496486 None] Lock "cinder-quobyte-f6cc2830-b1ba-4ce6-ae34-a2fc526d3b27" acquired by "delete_volume" :: waited 0.027s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:21:45 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f073e32c-6bc0-4235-b6f8-30332949e625]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:21:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3be76083-9da2-4a4d-aaf6-424eb75c56c2 tempest-AttachVolumeShelveTestJSON-1359496486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f6cc2830-b1ba-4ce6-ae34-a2fc526d3b27 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:45 devstack sudo[91274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f6cc2830-b1ba-4ce6-ae34-a2fc526d3b27 Jul 07 17:21:45 devstack sudo[91274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:45 devstack sudo[91269]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1d914000-81e0-4a1f-909e-8b6e600b4d05 tempest-GroupSnapshotsTest-1142774596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8535e0b4-8622-4661-99b0-900538c9b651,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8535e0b4-8622-4661-99b0-900538c9b651.22aa9831-da27-42a7-b47b-9d204d882975 1G" returned: 0 in 1.063s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1d914000-81e0-4a1f-909e-8b6e600b4d05 tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8535e0b4-8622-4661-99b0-900538c9b651 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8535e0b4-8622-4661-99b0-900538c9b651.22aa9831-da27-42a7-b47b-9d204d882975 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:45 devstack sudo[91276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8535e0b4-8622-4661-99b0-900538c9b651 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8535e0b4-8622-4661-99b0-900538c9b651.22aa9831-da27-42a7-b47b-9d204d882975 Jul 07 17:21:45 devstack sudo[91276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:46 devstack sudo[91274]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3be76083-9da2-4a4d-aaf6-424eb75c56c2 tempest-AttachVolumeShelveTestJSON-1359496486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f6cc2830-b1ba-4ce6-ae34-a2fc526d3b27" returned: 0 in 1.258s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3be76083-9da2-4a4d-aaf6-424eb75c56c2 tempest-AttachVolumeShelveTestJSON-1359496486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f6cc2830-b1ba-4ce6-ae34-a2fc526d3b27 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:46 devstack sudo[91286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f6cc2830-b1ba-4ce6-ae34-a2fc526d3b27 Jul 07 17:21:46 devstack sudo[91286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:46 devstack sudo[91276]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1d914000-81e0-4a1f-909e-8b6e600b4d05 tempest-GroupSnapshotsTest-1142774596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8535e0b4-8622-4661-99b0-900538c9b651 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8535e0b4-8622-4661-99b0-900538c9b651.22aa9831-da27-42a7-b47b-9d204d882975" returned: 0 in 1.098s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:46 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-1d914000-81e0-4a1f-909e-8b6e600b4d05 tempest-GroupSnapshotsTest-1142774596 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8535e0b4-8622-4661-99b0-900538c9b651.22aa9831-da27-42a7-b47b-9d204d882975 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:21:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1d914000-81e0-4a1f-909e-8b6e600b4d05 tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8535e0b4-8622-4661-99b0-900538c9b651.22aa9831-da27-42a7-b47b-9d204d882975 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:46 devstack sudo[91288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8535e0b4-8622-4661-99b0-900538c9b651.22aa9831-da27-42a7-b47b-9d204d882975 Jul 07 17:21:46 devstack sudo[91288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:47 devstack sudo[91288]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1d914000-81e0-4a1f-909e-8b6e600b4d05 tempest-GroupSnapshotsTest-1142774596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8535e0b4-8622-4661-99b0-900538c9b651.22aa9831-da27-42a7-b47b-9d204d882975" returned: 0 in 0.858s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:47 devstack sudo[91286]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3be76083-9da2-4a4d-aaf6-424eb75c56c2 tempest-AttachVolumeShelveTestJSON-1359496486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f6cc2830-b1ba-4ce6-ae34-a2fc526d3b27" returned: 0 in 0.976s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1d914000-81e0-4a1f-909e-8b6e600b4d05 tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8535e0b4-8622-4661-99b0-900538c9b651.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:47 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3be76083-9da2-4a4d-aaf6-424eb75c56c2 tempest-AttachVolumeShelveTestJSON-1359496486 None] Lock "cinder-quobyte-f6cc2830-b1ba-4ce6-ae34-a2fc526d3b27" released by "delete_volume" :: held 2.336s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:21:47 devstack sudo[91292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8535e0b4-8622-4661-99b0-900538c9b651.info Jul 07 17:21:47 devstack sudo[91292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:47 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-3be76083-9da2-4a4d-aaf6-424eb75c56c2 tempest-AttachVolumeShelveTestJSON-1359496486 None] Created reservations ['dbb0189c-e27f-4727-b2c3-1e4cabb95a59', 'de6e4c18-dab6-4acd-b1f7-14a98bbc5540', '4a185f86-669e-4e39-ab19-e7810f9adae6', '37dd7401-05b4-48c3-9cf7-e8549e5b91f4'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:21:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-3be76083-9da2-4a4d-aaf6-424eb75c56c2 tempest-AttachVolumeShelveTestJSON-1359496486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:21:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-3be76083-9da2-4a4d-aaf6-424eb75c56c2 tempest-AttachVolumeShelveTestJSON-1359496486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:21:47 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-3be76083-9da2-4a4d-aaf6-424eb75c56c2 tempest-AttachVolumeShelveTestJSON-1359496486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:21:47 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-3be76083-9da2-4a4d-aaf6-424eb75c56c2 tempest-AttachVolumeShelveTestJSON-1359496486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:21:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-3be76083-9da2-4a4d-aaf6-424eb75c56c2 tempest-AttachVolumeShelveTestJSON-1359496486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:21:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3be76083-9da2-4a4d-aaf6-424eb75c56c2 tempest-AttachVolumeShelveTestJSON-1359496486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:47 devstack sudo[91294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:21:47 devstack sudo[91294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:48 devstack sudo[91294]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3be76083-9da2-4a4d-aaf6-424eb75c56c2 tempest-AttachVolumeShelveTestJSON-1359496486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.700s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:48 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-3be76083-9da2-4a4d-aaf6-424eb75c56c2 tempest-AttachVolumeShelveTestJSON-1359496486 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:21:48 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-3be76083-9da2-4a4d-aaf6-424eb75c56c2 tempest-AttachVolumeShelveTestJSON-1359496486 None] Deleted volume successfully. Jul 07 17:21:48 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3be76083-9da2-4a4d-aaf6-424eb75c56c2 tempest-AttachVolumeShelveTestJSON-1359496486 None] Lock "cinder-f6cc2830-b1ba-4ce6-ae34-a2fc526d3b27-delete_volume" released by "delete_volume" :: held 3.333s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:21:48 devstack sudo[91292]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1d914000-81e0-4a1f-909e-8b6e600b4d05 tempest-GroupSnapshotsTest-1142774596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8535e0b4-8622-4661-99b0-900538c9b651.info" returned: 0 in 0.984s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:48 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-1d914000-81e0-4a1f-909e-8b6e600b4d05 tempest-GroupSnapshotsTest-1142774596 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8535e0b4-8622-4661-99b0-900538c9b651.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:21:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1d914000-81e0-4a1f-909e-8b6e600b4d05 tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8535e0b4-8622-4661-99b0-900538c9b651.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:48 devstack sudo[91298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8535e0b4-8622-4661-99b0-900538c9b651.info Jul 07 17:21:48 devstack sudo[91298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:49 devstack sudo[91298]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1d914000-81e0-4a1f-909e-8b6e600b4d05 tempest-GroupSnapshotsTest-1142774596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8535e0b4-8622-4661-99b0-900538c9b651.info" returned: 0 in 0.763s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1d914000-81e0-4a1f-909e-8b6e600b4d05 tempest-GroupSnapshotsTest-1142774596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.177s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:21:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1d914000-81e0-4a1f-909e-8b6e600b4d05 tempest-GroupSnapshotsTest-1142774596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:21:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1d914000-81e0-4a1f-909e-8b6e600b4d05 tempest-GroupSnapshotsTest-1142774596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:21:49 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-1d914000-81e0-4a1f-909e-8b6e600b4d05 tempest-GroupSnapshotsTest-1142774596 None] Creating offline snapshot 485b95b9-9d6f-48b3-8b31-ff5046376003 of volume 859ade0f-fdb0-4b71-9aca-3cd4a7e8864f {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:21:49 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8283176-647a-476d-9e5c-adaf2a2d08ff]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:21:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1d914000-81e0-4a1f-909e-8b6e600b4d05 tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:49 devstack sudo[91301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f Jul 07 17:21:49 devstack sudo[91301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:50 devstack sudo[91301]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1d914000-81e0-4a1f-909e-8b6e600b4d05 tempest-GroupSnapshotsTest-1142774596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f" returned: 0 in 1.163s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1d914000-81e0-4a1f-909e-8b6e600b4d05 tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f.485b95b9-9d6f-48b3-8b31-ff5046376003 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:50 devstack sudo[91307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f.485b95b9-9d6f-48b3-8b31-ff5046376003 1G Jul 07 17:21:50 devstack sudo[91307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:51 devstack sudo[91307]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1d914000-81e0-4a1f-909e-8b6e600b4d05 tempest-GroupSnapshotsTest-1142774596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f.485b95b9-9d6f-48b3-8b31-ff5046376003 1G" returned: 0 in 1.254s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1d914000-81e0-4a1f-909e-8b6e600b4d05 tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f.485b95b9-9d6f-48b3-8b31-ff5046376003 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:51 devstack sudo[91317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f.485b95b9-9d6f-48b3-8b31-ff5046376003 Jul 07 17:21:51 devstack sudo[91317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:52 devstack sudo[91317]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1d914000-81e0-4a1f-909e-8b6e600b4d05 tempest-GroupSnapshotsTest-1142774596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f.485b95b9-9d6f-48b3-8b31-ff5046376003" returned: 0 in 1.039s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:52 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-1d914000-81e0-4a1f-909e-8b6e600b4d05 tempest-GroupSnapshotsTest-1142774596 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f.485b95b9-9d6f-48b3-8b31-ff5046376003 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:21:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1d914000-81e0-4a1f-909e-8b6e600b4d05 tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f.485b95b9-9d6f-48b3-8b31-ff5046376003 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:52 devstack sudo[91323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f.485b95b9-9d6f-48b3-8b31-ff5046376003 Jul 07 17:21:52 devstack sudo[91323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:53 devstack sudo[91323]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1d914000-81e0-4a1f-909e-8b6e600b4d05 tempest-GroupSnapshotsTest-1142774596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f.485b95b9-9d6f-48b3-8b31-ff5046376003" returned: 0 in 0.764s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1d914000-81e0-4a1f-909e-8b6e600b4d05 tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:53 devstack sudo[91326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f.info Jul 07 17:21:53 devstack sudo[91326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:54 devstack sudo[91326]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1d914000-81e0-4a1f-909e-8b6e600b4d05 tempest-GroupSnapshotsTest-1142774596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f.info" returned: 0 in 0.867s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:54 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-1d914000-81e0-4a1f-909e-8b6e600b4d05 tempest-GroupSnapshotsTest-1142774596 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:21:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1d914000-81e0-4a1f-909e-8b6e600b4d05 tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:54 devstack sudo[91330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f.info Jul 07 17:21:54 devstack sudo[91330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:55 devstack sudo[91330]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1d914000-81e0-4a1f-909e-8b6e600b4d05 tempest-GroupSnapshotsTest-1142774596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f.info" returned: 0 in 0.686s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1d914000-81e0-4a1f-909e-8b6e600b4d05 tempest-GroupSnapshotsTest-1142774596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.921s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:21:55 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-1d914000-81e0-4a1f-909e-8b6e600b4d05 tempest-GroupSnapshotsTest-1142774596 None] group_snapshot 2a48cc26-f369-4471-836f-3eaaf6cec824: created successfully Jul 07 17:21:56 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-077f79b4-e10a-4aa6-a74c-e7899edbdbda tempest-GroupSnapshotsTest-1142774596 None] group_snapshot 2a48cc26-f369-4471-836f-3eaaf6cec824: deleting Jul 07 17:21:56 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-077f79b4-e10a-4aa6-a74c-e7899edbdbda tempest-GroupSnapshotsTest-1142774596 None] group_snapshot 2a48cc26-f369-4471-836f-3eaaf6cec824: deleting {{(pid=87233) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 07 17:21:56 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-077f79b4-e10a-4aa6-a74c-e7899edbdbda tempest-GroupSnapshotsTest-1142774596 None] Acquiring lock "cinder-quobyte-8535e0b4-8622-4661-99b0-900538c9b651" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:21:56 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-077f79b4-e10a-4aa6-a74c-e7899edbdbda tempest-GroupSnapshotsTest-1142774596 None] Lock "cinder-quobyte-8535e0b4-8622-4661-99b0-900538c9b651" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:21:56 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-077f79b4-e10a-4aa6-a74c-e7899edbdbda tempest-GroupSnapshotsTest-1142774596 None] Acquiring lock "cinder-quobyte-22aa9831-da27-42a7-b47b-9d204d882975" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:21:56 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-077f79b4-e10a-4aa6-a74c-e7899edbdbda tempest-GroupSnapshotsTest-1142774596 None] Lock "cinder-quobyte-22aa9831-da27-42a7-b47b-9d204d882975" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:21:56 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-077f79b4-e10a-4aa6-a74c-e7899edbdbda tempest-GroupSnapshotsTest-1142774596 None] Deleting offline snapshot 22aa9831-da27-42a7-b47b-9d204d882975 of volume 8535e0b4-8622-4661-99b0-900538c9b651 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:21:56 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-077f79b4-e10a-4aa6-a74c-e7899edbdbda tempest-GroupSnapshotsTest-1142774596 None] snapshot_file for this snap is: volume-8535e0b4-8622-4661-99b0-900538c9b651.22aa9831-da27-42a7-b47b-9d204d882975 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:21:56 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d339a0e6-d52a-4abc-977b-e1ce912840ad]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:21:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-077f79b4-e10a-4aa6-a74c-e7899edbdbda tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8535e0b4-8622-4661-99b0-900538c9b651.22aa9831-da27-42a7-b47b-9d204d882975 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:56 devstack sudo[91333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8535e0b4-8622-4661-99b0-900538c9b651.22aa9831-da27-42a7-b47b-9d204d882975 Jul 07 17:21:56 devstack sudo[91333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:57 devstack sudo[91333]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-077f79b4-e10a-4aa6-a74c-e7899edbdbda tempest-GroupSnapshotsTest-1142774596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8535e0b4-8622-4661-99b0-900538c9b651.22aa9831-da27-42a7-b47b-9d204d882975" returned: 0 in 0.878s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:57 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-077f79b4-e10a-4aa6-a74c-e7899edbdbda tempest-GroupSnapshotsTest-1142774596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8535e0b4-8622-4661-99b0-900538c9b651(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:21:57 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de45ff2-7cc4-433c-9ce4-e5be388153d2]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:21:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-077f79b4-e10a-4aa6-a74c-e7899edbdbda tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8535e0b4-8622-4661-99b0-900538c9b651 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:57 devstack sudo[91338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8535e0b4-8622-4661-99b0-900538c9b651 Jul 07 17:21:57 devstack sudo[91338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:58 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-078ba05e-b0bd-42ea-a598-8bba7e4a257a tempest-GroupsV314Test-785834081 None] Group tempest-GroupsV314Test-Group-1196439351: creating Jul 07 17:21:58 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-078ba05e-b0bd-42ea-a598-8bba7e4a257a tempest-GroupsV314Test-785834081 None] Group tempest-GroupsV314Test-Group-1196439351: created successfully Jul 07 17:21:58 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-078ba05e-b0bd-42ea-a598-8bba7e4a257a tempest-GroupsV314Test-785834081 None] Create group completed successfully. Jul 07 17:21:58 devstack sudo[91338]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-077f79b4-e10a-4aa6-a74c-e7899edbdbda tempest-GroupSnapshotsTest-1142774596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8535e0b4-8622-4661-99b0-900538c9b651" returned: 0 in 0.915s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-077f79b4-e10a-4aa6-a74c-e7899edbdbda tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8535e0b4-8622-4661-99b0-900538c9b651.22aa9831-da27-42a7-b47b-9d204d882975 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:58 devstack sudo[91344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8535e0b4-8622-4661-99b0-900538c9b651.22aa9831-da27-42a7-b47b-9d204d882975 Jul 07 17:21:58 devstack sudo[91344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:58 devstack sudo[91344]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-077f79b4-e10a-4aa6-a74c-e7899edbdbda tempest-GroupSnapshotsTest-1142774596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8535e0b4-8622-4661-99b0-900538c9b651.22aa9831-da27-42a7-b47b-9d204d882975" returned: 0 in 0.844s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-077f79b4-e10a-4aa6-a74c-e7899edbdbda tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8535e0b4-8622-4661-99b0-900538c9b651.22aa9831-da27-42a7-b47b-9d204d882975 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:59 devstack sudo[91353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8535e0b4-8622-4661-99b0-900538c9b651.22aa9831-da27-42a7-b47b-9d204d882975 Jul 07 17:21:59 devstack sudo[91353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:59 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-0762aec9-58b9-413b-b344-5901c3ec57ad tempest-GroupsV314Test-785834081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:21:59 devstack sudo[91353]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0762aec9-58b9-413b-b344-5901c3ec57ad tempest-GroupsV314Test-785834081 None] Flow 'volume_create_manager' (54de25f3-36c7-4aa7-93c6-5720f12d529c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:21:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0762aec9-58b9-413b-b344-5901c3ec57ad tempest-GroupsV314Test-785834081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (714fc6f9-f7f0-439f-af9a-935f694d96dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-077f79b4-e10a-4aa6-a74c-e7899edbdbda tempest-GroupSnapshotsTest-1142774596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8535e0b4-8622-4661-99b0-900538c9b651.22aa9831-da27-42a7-b47b-9d204d882975" returned: 0 in 0.799s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0762aec9-58b9-413b-b344-5901c3ec57ad tempest-GroupsV314Test-785834081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (714fc6f9-f7f0-439f-af9a-935f694d96dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1468264959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b29db6d7-8ce1-44b6-a221-3cd5bd539821,host='devstack@QuobyteHD#QuobyteHD',id=e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a17d6bdf749b462aa4253aedd5d34029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:22:00Z,use_quota=True,user_id='7e13b7f4cc7c4766b5fa9c37bdd0da39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d519b1e1-6b83-4888-8c08-079017ff9ba2),volume_type_id=d519b1e1-6b83-4888-8c08-079017ff9ba2)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0762aec9-58b9-413b-b344-5901c3ec57ad tempest-GroupsV314Test-785834081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c4b4caa-34e5-4bd6-9c36-94710ec70c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0762aec9-58b9-413b-b344-5901c3ec57ad tempest-GroupsV314Test-785834081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c4b4caa-34e5-4bd6-9c36-94710ec70c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0762aec9-58b9-413b-b344-5901c3ec57ad tempest-GroupsV314Test-785834081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0392b297-b854-4723-b0dc-388190769726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0762aec9-58b9-413b-b344-5901c3ec57ad tempest-GroupsV314Test-785834081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0392b297-b854-4723-b0dc-388190769726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e', 'volume_name': 'volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0762aec9-58b9-413b-b344-5901c3ec57ad tempest-GroupsV314Test-785834081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (028567ad-2684-43ca-9750-4a02e45f7e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0762aec9-58b9-413b-b344-5901c3ec57ad tempest-GroupsV314Test-785834081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (028567ad-2684-43ca-9750-4a02e45f7e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0762aec9-58b9-413b-b344-5901c3ec57ad tempest-GroupsV314Test-785834081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15afd4dd-3a64-4504-952e-d6edc11a877f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:59 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-0762aec9-58b9-413b-b344-5901c3ec57ad tempest-GroupsV314Test-785834081 None] Volume e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e', 'volume_size': 1} Jul 07 17:21:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0762aec9-58b9-413b-b344-5901c3ec57ad tempest-GroupsV314Test-785834081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:21:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0762aec9-58b9-413b-b344-5901c3ec57ad tempest-GroupsV314Test-785834081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:21:59 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-0762aec9-58b9-413b-b344-5901c3ec57ad tempest-GroupsV314Test-785834081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b29db6d7-8ce1-44b6-a221-3cd5bd539821,created_at=2026-07-07T15:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1468264959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b29db6d7-8ce1-44b6-a221-3cd5bd539821,host='devstack@QuobyteHD#QuobyteHD',id=e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a17d6bdf749b462aa4253aedd5d34029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:22:00Z,use_quota=True,user_id='7e13b7f4cc7c4766b5fa9c37bdd0da39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d519b1e1-6b83-4888-8c08-079017ff9ba2),volume_type_id=d519b1e1-6b83-4888-8c08-079017ff9ba2)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:21:59 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-0762aec9-58b9-413b-b344-5901c3ec57ad tempest-GroupsV314Test-785834081 None] Creating volume e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:21:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0762aec9-58b9-413b-b344-5901c3ec57ad tempest-GroupsV314Test-785834081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:21:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0762aec9-58b9-413b-b344-5901c3ec57ad tempest-GroupsV314Test-785834081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:21:59 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-0762aec9-58b9-413b-b344-5901c3ec57ad tempest-GroupsV314Test-785834081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:21:59 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-0762aec9-58b9-413b-b344-5901c3ec57ad tempest-GroupsV314Test-785834081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:21:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0762aec9-58b9-413b-b344-5901c3ec57ad tempest-GroupsV314Test-785834081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:21:59 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-0762aec9-58b9-413b-b344-5901c3ec57ad tempest-GroupsV314Test-785834081 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:21:59 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-0762aec9-58b9-413b-b344-5901c3ec57ad tempest-GroupsV314Test-785834081 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:21:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0762aec9-58b9-413b-b344-5901c3ec57ad tempest-GroupsV314Test-785834081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:59 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-077f79b4-e10a-4aa6-a74c-e7899edbdbda tempest-GroupSnapshotsTest-1142774596 None] Lock "cinder-quobyte-22aa9831-da27-42a7-b47b-9d204d882975" released by "_delete_snapshot" :: held 3.628s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:21:59 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-077f79b4-e10a-4aa6-a74c-e7899edbdbda tempest-GroupSnapshotsTest-1142774596 None] Lock "cinder-quobyte-8535e0b4-8622-4661-99b0-900538c9b651" released by "delete_snapshot" :: held 3.660s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:21:59 devstack sudo[91359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e 1073741824 Jul 07 17:21:59 devstack sudo[91359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:59 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-077f79b4-e10a-4aa6-a74c-e7899edbdbda tempest-GroupSnapshotsTest-1142774596 None] Acquiring lock "cinder-quobyte-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:21:59 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-077f79b4-e10a-4aa6-a74c-e7899edbdbda tempest-GroupSnapshotsTest-1142774596 None] Lock "cinder-quobyte-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:21:59 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-077f79b4-e10a-4aa6-a74c-e7899edbdbda tempest-GroupSnapshotsTest-1142774596 None] Acquiring lock "cinder-quobyte-485b95b9-9d6f-48b3-8b31-ff5046376003" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:21:59 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-077f79b4-e10a-4aa6-a74c-e7899edbdbda tempest-GroupSnapshotsTest-1142774596 None] Lock "cinder-quobyte-485b95b9-9d6f-48b3-8b31-ff5046376003" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:21:59 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-077f79b4-e10a-4aa6-a74c-e7899edbdbda tempest-GroupSnapshotsTest-1142774596 None] Deleting offline snapshot 485b95b9-9d6f-48b3-8b31-ff5046376003 of volume 859ade0f-fdb0-4b71-9aca-3cd4a7e8864f {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:21:59 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-077f79b4-e10a-4aa6-a74c-e7899edbdbda tempest-GroupSnapshotsTest-1142774596 None] snapshot_file for this snap is: volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f.485b95b9-9d6f-48b3-8b31-ff5046376003 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:21:59 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[234d85d0-546f-4be4-a9cf-e0a2d07e2809]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:21:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-077f79b4-e10a-4aa6-a74c-e7899edbdbda tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f.485b95b9-9d6f-48b3-8b31-ff5046376003 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:00 devstack sudo[91361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f.485b95b9-9d6f-48b3-8b31-ff5046376003 Jul 07 17:22:00 devstack sudo[91361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:00 devstack sudo[91359]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0762aec9-58b9-413b-b344-5901c3ec57ad tempest-GroupsV314Test-785834081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e 1073741824" returned: 0 in 0.835s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0762aec9-58b9-413b-b344-5901c3ec57ad tempest-GroupsV314Test-785834081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:00 devstack sudo[91361]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:00 devstack sudo[91369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e Jul 07 17:22:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-077f79b4-e10a-4aa6-a74c-e7899edbdbda tempest-GroupSnapshotsTest-1142774596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f.485b95b9-9d6f-48b3-8b31-ff5046376003" returned: 0 in 0.806s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:00 devstack sudo[91369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:00 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-077f79b4-e10a-4aa6-a74c-e7899edbdbda tempest-GroupSnapshotsTest-1142774596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:22:00 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7082fcc-9416-482a-a924-b76bcc0c91c5]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:22:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-077f79b4-e10a-4aa6-a74c-e7899edbdbda tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:00 devstack sudo[91371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f Jul 07 17:22:00 devstack sudo[91371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:01 devstack sudo[91369]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0762aec9-58b9-413b-b344-5901c3ec57ad tempest-GroupsV314Test-785834081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e" returned: 0 in 0.639s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:01 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-0762aec9-58b9-413b-b344-5901c3ec57ad tempest-GroupsV314Test-785834081 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:22:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0762aec9-58b9-413b-b344-5901c3ec57ad tempest-GroupsV314Test-785834081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:01 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0762aec9-58b9-413b-b344-5901c3ec57ad tempest-GroupsV314Test-785834081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15afd4dd-3a64-4504-952e-d6edc11a877f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:01 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0762aec9-58b9-413b-b344-5901c3ec57ad tempest-GroupsV314Test-785834081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf9e1807-0e3f-43a3-9e33-19c536a0a5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:01 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-0762aec9-58b9-413b-b344-5901c3ec57ad tempest-GroupsV314Test-785834081 None] Volume volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e (e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e): created successfully Jul 07 17:22:01 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0762aec9-58b9-413b-b344-5901c3ec57ad tempest-GroupsV314Test-785834081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf9e1807-0e3f-43a3-9e33-19c536a0a5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:01 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0762aec9-58b9-413b-b344-5901c3ec57ad tempest-GroupsV314Test-785834081 None] Flow 'volume_create_manager' (54de25f3-36c7-4aa7-93c6-5720f12d529c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:22:01 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-0762aec9-58b9-413b-b344-5901c3ec57ad tempest-GroupsV314Test-785834081 None] Created volume successfully. Jul 07 17:22:01 devstack sudo[91371]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-077f79b4-e10a-4aa6-a74c-e7899edbdbda tempest-GroupSnapshotsTest-1142774596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f" returned: 0 in 0.847s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-077f79b4-e10a-4aa6-a74c-e7899edbdbda tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f.485b95b9-9d6f-48b3-8b31-ff5046376003 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:01 devstack sudo[91377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f.485b95b9-9d6f-48b3-8b31-ff5046376003 Jul 07 17:22:01 devstack sudo[91377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:02 devstack sudo[91377]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-077f79b4-e10a-4aa6-a74c-e7899edbdbda tempest-GroupSnapshotsTest-1142774596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f.485b95b9-9d6f-48b3-8b31-ff5046376003" returned: 0 in 0.730s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-077f79b4-e10a-4aa6-a74c-e7899edbdbda tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f.485b95b9-9d6f-48b3-8b31-ff5046376003 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:02 devstack sudo[91383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f.485b95b9-9d6f-48b3-8b31-ff5046376003 Jul 07 17:22:02 devstack sudo[91383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:03 devstack sudo[91383]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-077f79b4-e10a-4aa6-a74c-e7899edbdbda tempest-GroupSnapshotsTest-1142774596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f.485b95b9-9d6f-48b3-8b31-ff5046376003" returned: 0 in 0.769s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:03 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-077f79b4-e10a-4aa6-a74c-e7899edbdbda tempest-GroupSnapshotsTest-1142774596 None] Lock "cinder-quobyte-485b95b9-9d6f-48b3-8b31-ff5046376003" released by "_delete_snapshot" :: held 3.265s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:22:03 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-077f79b4-e10a-4aa6-a74c-e7899edbdbda tempest-GroupSnapshotsTest-1142774596 None] Lock "cinder-quobyte-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f" released by "delete_snapshot" :: held 3.292s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:22:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:03 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] Cloning volume e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e to volume 5c2a3442-9000-4292-8b6c-455a1217df73 Jul 07 17:22:03 devstack cinder-volume[87233]: WARNING cinder.quota [None req-077f79b4-e10a-4aa6-a74c-e7899edbdbda tempest-GroupSnapshotsTest-1142774596 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1427492199 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1427492199, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:22:03 devstack cinder-volume[87233]: WARNING cinder.quota [None req-077f79b4-e10a-4aa6-a74c-e7899edbdbda tempest-GroupSnapshotsTest-1142774596 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1427492199 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1427492199, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:22:03 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] Creating offline snapshot 89a5cc85-1ef0-4344-b7ec-e383b0e525d8 of volume e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:22:03 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[94519f51-5c31-4917-a2bd-09fca307705f]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:22:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:03 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-077f79b4-e10a-4aa6-a74c-e7899edbdbda tempest-GroupSnapshotsTest-1142774596 None] Created reservations ['2283a216-797b-4edd-935d-9bb081607b6c', '26533da2-595f-4f45-8e6e-a6ecbcf416cb', 'd1af24ec-518f-4e73-8620-83bcd84240d7', '135f1f18-4ec9-4bd8-ab97-b2473d41024d'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:22:03 devstack sudo[91390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e Jul 07 17:22:03 devstack sudo[91390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:03 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-077f79b4-e10a-4aa6-a74c-e7899edbdbda tempest-GroupSnapshotsTest-1142774596 None] Created reservations ['d0bb722b-6b21-4da6-a75d-3eeafb891afb', '1ad59640-de0e-4c85-bd4b-fcc8269abf3c', '9ea0172e-3dac-4ba2-a350-624d34b40c42', '16372913-e8da-4810-81d7-1d180d8546fe'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:22:03 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-077f79b4-e10a-4aa6-a74c-e7899edbdbda tempest-GroupSnapshotsTest-1142774596 None] group_snapshot 2a48cc26-f369-4471-836f-3eaaf6cec824: deleted successfully Jul 07 17:22:04 devstack sudo[91390]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e" returned: 0 in 1.070s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e.89a5cc85-1ef0-4344-b7ec-e383b0e525d8 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:04 devstack sudo[91397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e.89a5cc85-1ef0-4344-b7ec-e383b0e525d8 1G Jul 07 17:22:04 devstack sudo[91397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:04 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9e38442a-97d8-47dc-903f-7a8aa1017149 tempest-GroupSnapshotsTest-1142774596 None] Acquiring lock "cinder-quobyte-8535e0b4-8622-4661-99b0-900538c9b651" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:22:04 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9e38442a-97d8-47dc-903f-7a8aa1017149 tempest-GroupSnapshotsTest-1142774596 None] Lock "cinder-quobyte-8535e0b4-8622-4661-99b0-900538c9b651" acquired by "delete_volume" :: waited 0.015s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:22:04 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f200fb-6ced-4631-aa30-d10d6df74418]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:22:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9e38442a-97d8-47dc-903f-7a8aa1017149 tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8535e0b4-8622-4661-99b0-900538c9b651 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:04 devstack sudo[91403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8535e0b4-8622-4661-99b0-900538c9b651 Jul 07 17:22:04 devstack sudo[91403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:05 devstack sudo[91397]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e.89a5cc85-1ef0-4344-b7ec-e383b0e525d8 1G" returned: 0 in 1.370s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e.89a5cc85-1ef0-4344-b7ec-e383b0e525d8 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:05 devstack sudo[91471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e.89a5cc85-1ef0-4344-b7ec-e383b0e525d8 Jul 07 17:22:05 devstack sudo[91471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:06 devstack sudo[91403]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9e38442a-97d8-47dc-903f-7a8aa1017149 tempest-GroupSnapshotsTest-1142774596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8535e0b4-8622-4661-99b0-900538c9b651" returned: 0 in 1.426s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9e38442a-97d8-47dc-903f-7a8aa1017149 tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8535e0b4-8622-4661-99b0-900538c9b651 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:06 devstack sudo[91480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8535e0b4-8622-4661-99b0-900538c9b651 Jul 07 17:22:06 devstack sudo[91480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:07 devstack sudo[91471]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e.89a5cc85-1ef0-4344-b7ec-e383b0e525d8" returned: 0 in 1.141s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:07 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e.89a5cc85-1ef0-4344-b7ec-e383b0e525d8 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:22:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e.89a5cc85-1ef0-4344-b7ec-e383b0e525d8 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:07 devstack sudo[91492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e.89a5cc85-1ef0-4344-b7ec-e383b0e525d8 Jul 07 17:22:07 devstack sudo[91492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:07 devstack sudo[91480]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9e38442a-97d8-47dc-903f-7a8aa1017149 tempest-GroupSnapshotsTest-1142774596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8535e0b4-8622-4661-99b0-900538c9b651" returned: 0 in 1.002s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:07 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9e38442a-97d8-47dc-903f-7a8aa1017149 tempest-GroupSnapshotsTest-1142774596 None] Lock "cinder-quobyte-8535e0b4-8622-4661-99b0-900538c9b651" released by "delete_volume" :: held 2.525s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:22:07 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9e38442a-97d8-47dc-903f-7a8aa1017149 tempest-GroupSnapshotsTest-1142774596 None] Acquiring lock "cinder-quobyte-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:22:07 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9e38442a-97d8-47dc-903f-7a8aa1017149 tempest-GroupSnapshotsTest-1142774596 None] Lock "cinder-quobyte-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f" acquired by "delete_volume" :: waited 0.015s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:22:07 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a716d1-2437-483f-b3e0-7c84dab20536]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:22:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9e38442a-97d8-47dc-903f-7a8aa1017149 tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:07 devstack sudo[91494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f Jul 07 17:22:07 devstack sudo[91494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:07 devstack sudo[91492]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e.89a5cc85-1ef0-4344-b7ec-e383b0e525d8" returned: 0 in 0.820s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:07 devstack sudo[91498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e.info Jul 07 17:22:07 devstack sudo[91498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:08 devstack sudo[91494]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9e38442a-97d8-47dc-903f-7a8aa1017149 tempest-GroupSnapshotsTest-1142774596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f" returned: 0 in 0.893s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9e38442a-97d8-47dc-903f-7a8aa1017149 tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:08 devstack sudo[91504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f Jul 07 17:22:08 devstack sudo[91504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:08 devstack sudo[91498]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e.info" returned: 0 in 0.751s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:08 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:22:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:08 devstack sudo[91507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e.info Jul 07 17:22:08 devstack sudo[91507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:08 devstack sudo[91504]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9e38442a-97d8-47dc-903f-7a8aa1017149 tempest-GroupSnapshotsTest-1142774596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f" returned: 0 in 0.759s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:08 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9e38442a-97d8-47dc-903f-7a8aa1017149 tempest-GroupSnapshotsTest-1142774596 None] Lock "cinder-quobyte-859ade0f-fdb0-4b71-9aca-3cd4a7e8864f" released by "delete_volume" :: held 1.726s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:22:09 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-9e38442a-97d8-47dc-903f-7a8aa1017149 tempest-GroupSnapshotsTest-1142774596 None] Created reservations ['81ab1134-e015-44cb-bbf4-5574906edcd2'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:22:09 devstack cinder-volume[87233]: WARNING cinder.quota [None req-9e38442a-97d8-47dc-903f-7a8aa1017149 tempest-GroupSnapshotsTest-1142774596 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1427492199 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1427492199, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:22:09 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-9e38442a-97d8-47dc-903f-7a8aa1017149 tempest-GroupSnapshotsTest-1142774596 None] Created reservations ['41b1fdd5-5b66-497c-b11c-39330acc35e9', '270ad581-806f-4014-9629-f6a660b827b6', 'fcdae5b1-5b7e-4bf5-8563-65bfaeeafa3a', '5e062652-5f1c-4625-8ec9-953e7c0697bc'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:22:09 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-9e38442a-97d8-47dc-903f-7a8aa1017149 tempest-GroupSnapshotsTest-1142774596 None] Created reservations ['2728eaac-0962-4943-bfd5-23c8b3e8bbae', '207fb5b0-bad8-4b44-8815-c186bd845006', '07409a85-bc27-40a9-905b-ac2b48ab85c9', 'a77e621a-c789-4773-9fff-9091c9677595'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:22:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9e38442a-97d8-47dc-903f-7a8aa1017149 tempest-GroupSnapshotsTest-1142774596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9e38442a-97d8-47dc-903f-7a8aa1017149 tempest-GroupSnapshotsTest-1142774596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:09 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-9e38442a-97d8-47dc-903f-7a8aa1017149 tempest-GroupSnapshotsTest-1142774596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:22:09 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-9e38442a-97d8-47dc-903f-7a8aa1017149 tempest-GroupSnapshotsTest-1142774596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:22:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9e38442a-97d8-47dc-903f-7a8aa1017149 tempest-GroupSnapshotsTest-1142774596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9e38442a-97d8-47dc-903f-7a8aa1017149 tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:09 devstack sudo[91511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:22:09 devstack sudo[91511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:09 devstack sudo[91507]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e.info" returned: 0 in 0.766s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:09 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] Acquiring lock "cinder-quobyte-5c2a3442-9000-4292-8b6c-455a1217df73" by "_copy_volume_from_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:22:09 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] Lock "cinder-quobyte-5c2a3442-9000-4292-8b6c-455a1217df73" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:22:09 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] snapshot: 89a5cc85-1ef0-4344-b7ec-e383b0e525d8, volume: 5c2a3442-9000-4292-8b6c-455a1217df73, {{(pid=87233) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 17:22:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:09 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:22:09 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:22:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:09 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[979e0100-d9fe-4f79-8142-d96291832909]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:22:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e.89a5cc85-1ef0-4344-b7ec-e383b0e525d8 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:09 devstack sudo[91513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e.89a5cc85-1ef0-4344-b7ec-e383b0e525d8 Jul 07 17:22:09 devstack sudo[91513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:10 devstack sudo[91511]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9e38442a-97d8-47dc-903f-7a8aa1017149 tempest-GroupSnapshotsTest-1142774596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.833s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:10 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-9e38442a-97d8-47dc-903f-7a8aa1017149 tempest-GroupSnapshotsTest-1142774596 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:22:10 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-9e38442a-97d8-47dc-903f-7a8aa1017149 tempest-GroupSnapshotsTest-1142774596 None] Delete group completed successfully. Jul 07 17:22:10 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-833fe515-ee27-48bd-95f5-e99279dfc208 tempest-GroupSnapshotsTest-1142774596 None] Group tempest-GroupSnapshotsTest-Group-338948973: creating Jul 07 17:22:10 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-833fe515-ee27-48bd-95f5-e99279dfc208 tempest-GroupSnapshotsTest-1142774596 None] Group tempest-GroupSnapshotsTest-Group-338948973: created successfully Jul 07 17:22:10 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-833fe515-ee27-48bd-95f5-e99279dfc208 tempest-GroupSnapshotsTest-1142774596 None] Create group completed successfully. Jul 07 17:22:10 devstack sudo[91513]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e.89a5cc85-1ef0-4344-b7ec-e383b0e525d8" returned: 0 in 1.155s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:10 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:22:10 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] will copy from snapshot at /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e {{(pid=87233) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 17:22:10 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] Creating direct copy from snapshot {{(pid=87233) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 17:22:10 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[753c6f09-2a15-4784-b83b-706968f44159]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:22:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:10 devstack sudo[91558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e Jul 07 17:22:10 devstack sudo[91558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:11 devstack sudo[91558]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e" returned: 0 in 0.895s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:11 devstack cinder-volume[87233]: DEBUG cinder.utils [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] Path /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c2a3442-9000-4292-8b6c-455a1217df73 not found in is_blk_device check {{(pid=87233) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 17:22:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c2a3442-9000-4292-8b6c-455a1217df73 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:11 devstack sudo[91572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c2a3442-9000-4292-8b6c-455a1217df73 Jul 07 17:22:11 devstack sudo[91572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:12 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-452a747e-7570-4459-b6c6-673478e5add3 tempest-GroupSnapshotsTest-1142774596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:22:12 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-452a747e-7570-4459-b6c6-673478e5add3 tempest-GroupSnapshotsTest-1142774596 None] Flow 'volume_create_manager' (d6a091ba-57c3-4116-a263-d91450f273d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:22:12 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-452a747e-7570-4459-b6c6-673478e5add3 tempest-GroupSnapshotsTest-1142774596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9bffe82-a0bf-4634-bf9a-ae8b80263b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:12 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-452a747e-7570-4459-b6c6-673478e5add3 tempest-GroupSnapshotsTest-1142774596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9bffe82-a0bf-4634-bf9a-ae8b80263b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-786475322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cba0d411-4d96-42f2-ac5d-30241c3232c0,host='devstack@QuobyteHD#QuobyteHD',id=d7425f66-28d4-4338-ae20-aa1b931b9162,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='688fe61f18a44f83a0b94be8baeb6a9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:22:12Z,use_quota=True,user_id='aef3db228fa847e392768b411452dfcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7a466eb-668b-4ca2-a67e-75dad0c5a53b),volume_type_id=b7a466eb-668b-4ca2-a67e-75dad0c5a53b)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:12 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-452a747e-7570-4459-b6c6-673478e5add3 tempest-GroupSnapshotsTest-1142774596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (443a737d-9263-43c5-b6d8-044b29920be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:12 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-452a747e-7570-4459-b6c6-673478e5add3 tempest-GroupSnapshotsTest-1142774596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (443a737d-9263-43c5-b6d8-044b29920be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:12 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-452a747e-7570-4459-b6c6-673478e5add3 tempest-GroupSnapshotsTest-1142774596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c7d8bbc-9978-44dc-832a-ca03febeefc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:12 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-452a747e-7570-4459-b6c6-673478e5add3 tempest-GroupSnapshotsTest-1142774596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c7d8bbc-9978-44dc-832a-ca03febeefc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7425f66-28d4-4338-ae20-aa1b931b9162', 'volume_name': 'volume-d7425f66-28d4-4338-ae20-aa1b931b9162', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:12 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-452a747e-7570-4459-b6c6-673478e5add3 tempest-GroupSnapshotsTest-1142774596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aed6fa23-0e8a-4289-8778-1fef3719d48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:12 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-452a747e-7570-4459-b6c6-673478e5add3 tempest-GroupSnapshotsTest-1142774596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aed6fa23-0e8a-4289-8778-1fef3719d48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:12 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-452a747e-7570-4459-b6c6-673478e5add3 tempest-GroupSnapshotsTest-1142774596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10024309-1dab-493a-b8e3-4a88d95f0342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:12 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-452a747e-7570-4459-b6c6-673478e5add3 tempest-GroupSnapshotsTest-1142774596 None] Volume d7425f66-28d4-4338-ae20-aa1b931b9162: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7425f66-28d4-4338-ae20-aa1b931b9162', 'volume_size': 1} Jul 07 17:22:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-452a747e-7570-4459-b6c6-673478e5add3 tempest-GroupSnapshotsTest-1142774596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:19 devstack sudo[91572]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c2a3442-9000-4292-8b6c-455a1217df73" returned: 0 in 7.657s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:19 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[149b5b5a-b36e-405b-8680-b8aaf8bec66b]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:22:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:19 devstack sudo[91606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e Jul 07 17:22:19 devstack sudo[91606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:20 devstack sudo[91606]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e" returned: 0 in 1.363s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:20 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] Image conversion details: src /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e, size 1024.00 MB, duration 7.66 sec, destination /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c2a3442-9000-4292-8b6c-455a1217df73 {{(pid=87233) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:22:20 devstack cinder-volume[87233]: INFO cinder.image.image_utils [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] Converted 1024.00 MB image at 133.72 MB/s Jul 07 17:22:20 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c2a3442-9000-4292-8b6c-455a1217df73 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:22:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c2a3442-9000-4292-8b6c-455a1217df73 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:20 devstack sudo[91621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c2a3442-9000-4292-8b6c-455a1217df73 Jul 07 17:22:20 devstack sudo[91621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:21 devstack sudo[91621]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c2a3442-9000-4292-8b6c-455a1217df73" returned: 0 in 0.762s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:21 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] Lock "cinder-quobyte-5c2a3442-9000-4292-8b6c-455a1217df73" released by "_copy_volume_from_snapshot" :: held 11.930s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:22:21 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:SELECT=87,cinder:UPDATE=99,cinder:INSERT=24,cinder:DELETE=2 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:22:21 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] Acquiring lock "cinder-quobyte-89a5cc85-1ef0-4344-b7ec-e383b0e525d8" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:22:21 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] Lock "cinder-quobyte-89a5cc85-1ef0-4344-b7ec-e383b0e525d8" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:22:21 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] Deleting offline snapshot 89a5cc85-1ef0-4344-b7ec-e383b0e525d8 of volume e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:22:21 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] snapshot_file for this snap is: volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e.89a5cc85-1ef0-4344-b7ec-e383b0e525d8 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:22:21 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae1ae4b-8984-4ea6-ab26-91cc1310a416]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:22:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e.89a5cc85-1ef0-4344-b7ec-e383b0e525d8 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:21 devstack sudo[91628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e.89a5cc85-1ef0-4344-b7ec-e383b0e525d8 Jul 07 17:22:21 devstack sudo[91628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:22 devstack sudo[91628]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e.89a5cc85-1ef0-4344-b7ec-e383b0e525d8" returned: 0 in 0.885s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:22 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:22:22 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a8ab9a-fe25-4574-b2aa-c42c454be172]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:22:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:22 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:UPDATE=94,cinder:SELECT=102,cinder:INSERT=22,cinder:DELETE=3 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:22:22 devstack sudo[91634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e Jul 07 17:22:22 devstack sudo[91634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:23 devstack sudo[91634]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e" returned: 0 in 0.767s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e.89a5cc85-1ef0-4344-b7ec-e383b0e525d8 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:23 devstack sudo[91639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e.89a5cc85-1ef0-4344-b7ec-e383b0e525d8 Jul 07 17:22:23 devstack sudo[91639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:23 devstack sudo[91639]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e.89a5cc85-1ef0-4344-b7ec-e383b0e525d8" returned: 0 in 0.755s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e.89a5cc85-1ef0-4344-b7ec-e383b0e525d8 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:23 devstack sudo[91646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e.89a5cc85-1ef0-4344-b7ec-e383b0e525d8 Jul 07 17:22:23 devstack sudo[91646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:24 devstack sudo[91646]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e.89a5cc85-1ef0-4344-b7ec-e383b0e525d8" returned: 0 in 0.683s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:24 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] Lock "cinder-quobyte-89a5cc85-1ef0-4344-b7ec-e383b0e525d8" released by "_delete_snapshot" :: held 3.232s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:22:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.354s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-452a747e-7570-4459-b6c6-673478e5add3 tempest-GroupSnapshotsTest-1142774596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.013s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:24 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-452a747e-7570-4459-b6c6-673478e5add3 tempest-GroupSnapshotsTest-1142774596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cba0d411-4d96-42f2-ac5d-30241c3232c0,created_at=2026-07-07T15:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-786475322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cba0d411-4d96-42f2-ac5d-30241c3232c0,host='devstack@QuobyteHD#QuobyteHD',id=d7425f66-28d4-4338-ae20-aa1b931b9162,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='688fe61f18a44f83a0b94be8baeb6a9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:22:12Z,use_quota=True,user_id='aef3db228fa847e392768b411452dfcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7a466eb-668b-4ca2-a67e-75dad0c5a53b),volume_type_id=b7a466eb-668b-4ca2-a67e-75dad0c5a53b)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:22:24 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-452a747e-7570-4459-b6c6-673478e5add3 tempest-GroupSnapshotsTest-1142774596 None] Creating volume d7425f66-28d4-4338-ae20-aa1b931b9162 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:22:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-452a747e-7570-4459-b6c6-673478e5add3 tempest-GroupSnapshotsTest-1142774596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-452a747e-7570-4459-b6c6-673478e5add3 tempest-GroupSnapshotsTest-1142774596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:24 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-452a747e-7570-4459-b6c6-673478e5add3 tempest-GroupSnapshotsTest-1142774596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:22:24 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-452a747e-7570-4459-b6c6-673478e5add3 tempest-GroupSnapshotsTest-1142774596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:22:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-452a747e-7570-4459-b6c6-673478e5add3 tempest-GroupSnapshotsTest-1142774596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:24 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-452a747e-7570-4459-b6c6-673478e5add3 tempest-GroupSnapshotsTest-1142774596 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:22:24 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-452a747e-7570-4459-b6c6-673478e5add3 tempest-GroupSnapshotsTest-1142774596 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:22:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-452a747e-7570-4459-b6c6-673478e5add3 tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7425f66-28d4-4338-ae20-aa1b931b9162 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:24 devstack sudo[91649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7425f66-28d4-4338-ae20-aa1b931b9162 1073741824 Jul 07 17:22:24 devstack sudo[91649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:24 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-1f7e64f2-0ffe-4a38-85a1-dc94b7dc8030 tempest-GroupsV314Test-785834081 None] Create group from source-group-b29db6d7-8ce1-44b6-a221-3cd5bd539821 completed successfully. Jul 07 17:22:25 devstack sudo[91649]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-452a747e-7570-4459-b6c6-673478e5add3 tempest-GroupSnapshotsTest-1142774596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7425f66-28d4-4338-ae20-aa1b931b9162 1073741824" returned: 0 in 0.914s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-452a747e-7570-4459-b6c6-673478e5add3 tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7425f66-28d4-4338-ae20-aa1b931b9162 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:25 devstack sudo[91679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7425f66-28d4-4338-ae20-aa1b931b9162 Jul 07 17:22:25 devstack sudo[91679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:25 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-08ba0369-097f-4eaf-bd7f-f8ffbae4d3d6 tempest-GroupsV314Test-785834081 None] Acquiring lock "cinder-quobyte-5c2a3442-9000-4292-8b6c-455a1217df73" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:22:25 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-08ba0369-097f-4eaf-bd7f-f8ffbae4d3d6 tempest-GroupsV314Test-785834081 None] Lock "cinder-quobyte-5c2a3442-9000-4292-8b6c-455a1217df73" acquired by "delete_volume" :: waited 0.017s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:22:25 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[836a13bf-e943-4c4a-a054-0ff5ee702e70]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:22:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-08ba0369-097f-4eaf-bd7f-f8ffbae4d3d6 tempest-GroupsV314Test-785834081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c2a3442-9000-4292-8b6c-455a1217df73 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:25 devstack sudo[91681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c2a3442-9000-4292-8b6c-455a1217df73 Jul 07 17:22:25 devstack sudo[91681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:26 devstack sudo[91679]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-452a747e-7570-4459-b6c6-673478e5add3 tempest-GroupSnapshotsTest-1142774596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7425f66-28d4-4338-ae20-aa1b931b9162" returned: 0 in 0.768s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:26 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-452a747e-7570-4459-b6c6-673478e5add3 tempest-GroupSnapshotsTest-1142774596 None] <== create_volume: return (1737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:22:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-452a747e-7570-4459-b6c6-673478e5add3 tempest-GroupSnapshotsTest-1142774596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.740s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-452a747e-7570-4459-b6c6-673478e5add3 tempest-GroupSnapshotsTest-1142774596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10024309-1dab-493a-b8e3-4a88d95f0342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7425f66-28d4-4338-ae20-aa1b931b9162', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-452a747e-7570-4459-b6c6-673478e5add3 tempest-GroupSnapshotsTest-1142774596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce8b3586-136a-40da-8ca6-f6d216c223fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:26 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-452a747e-7570-4459-b6c6-673478e5add3 tempest-GroupSnapshotsTest-1142774596 None] Volume volume-d7425f66-28d4-4338-ae20-aa1b931b9162 (d7425f66-28d4-4338-ae20-aa1b931b9162): created successfully Jul 07 17:22:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-452a747e-7570-4459-b6c6-673478e5add3 tempest-GroupSnapshotsTest-1142774596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce8b3586-136a-40da-8ca6-f6d216c223fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-452a747e-7570-4459-b6c6-673478e5add3 tempest-GroupSnapshotsTest-1142774596 None] Flow 'volume_create_manager' (d6a091ba-57c3-4116-a263-d91450f273d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:22:26 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-452a747e-7570-4459-b6c6-673478e5add3 tempest-GroupSnapshotsTest-1142774596 None] Created volume successfully. Jul 07 17:22:26 devstack sudo[91681]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-08ba0369-097f-4eaf-bd7f-f8ffbae4d3d6 tempest-GroupsV314Test-785834081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c2a3442-9000-4292-8b6c-455a1217df73" returned: 0 in 0.806s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-08ba0369-097f-4eaf-bd7f-f8ffbae4d3d6 tempest-GroupsV314Test-785834081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c2a3442-9000-4292-8b6c-455a1217df73 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:26 devstack sudo[91687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c2a3442-9000-4292-8b6c-455a1217df73 Jul 07 17:22:26 devstack sudo[91687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:27 devstack sudo[91687]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-08ba0369-097f-4eaf-bd7f-f8ffbae4d3d6 tempest-GroupsV314Test-785834081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c2a3442-9000-4292-8b6c-455a1217df73" returned: 0 in 0.704s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:27 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-08ba0369-097f-4eaf-bd7f-f8ffbae4d3d6 tempest-GroupsV314Test-785834081 None] Lock "cinder-quobyte-5c2a3442-9000-4292-8b6c-455a1217df73" released by "delete_volume" :: held 1.554s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:22:27 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-08ba0369-097f-4eaf-bd7f-f8ffbae4d3d6 tempest-GroupsV314Test-785834081 None] Created reservations ['3f241270-ec16-401d-a6e4-3b43614d2b1b'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:22:27 devstack cinder-volume[87233]: WARNING cinder.quota [None req-08ba0369-097f-4eaf-bd7f-f8ffbae4d3d6 tempest-GroupsV314Test-785834081 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-350007323 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-350007323, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:22:27 devstack cinder-volume[87233]: WARNING cinder.quota [None req-08ba0369-097f-4eaf-bd7f-f8ffbae4d3d6 tempest-GroupsV314Test-785834081 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-350007323 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-350007323, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:22:27 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-08ba0369-097f-4eaf-bd7f-f8ffbae4d3d6 tempest-GroupsV314Test-785834081 None] Created reservations ['73117a2d-8680-42a5-a0fa-e455fbf5082c', '7ffc08bd-e1e6-4654-b3ae-8dfb34933e79', 'f5176157-1182-40e6-8d5e-ae5c723b34fe', '8d45a38c-2c4a-4e69-b112-315754edc6e3'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:22:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-08ba0369-097f-4eaf-bd7f-f8ffbae4d3d6 tempest-GroupsV314Test-785834081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-08ba0369-097f-4eaf-bd7f-f8ffbae4d3d6 tempest-GroupsV314Test-785834081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:27 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-08ba0369-097f-4eaf-bd7f-f8ffbae4d3d6 tempest-GroupsV314Test-785834081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:22:27 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-08ba0369-097f-4eaf-bd7f-f8ffbae4d3d6 tempest-GroupsV314Test-785834081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:22:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-08ba0369-097f-4eaf-bd7f-f8ffbae4d3d6 tempest-GroupsV314Test-785834081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-08ba0369-097f-4eaf-bd7f-f8ffbae4d3d6 tempest-GroupsV314Test-785834081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:27 devstack sudo[91690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:22:27 devstack sudo[91690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:27 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-2346f4ac-ac9c-4d51-9a25-34cf1cc0639c tempest-GroupSnapshotsTest-1142774596 None] GroupSnapshot 2c30bf5f-dc06-4eec-a4a8-844adef4fcb7: creating. Jul 07 17:22:27 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-2346f4ac-ac9c-4d51-9a25-34cf1cc0639c tempest-GroupSnapshotsTest-1142774596 None] Group snapshot 2c30bf5f-dc06-4eec-a4a8-844adef4fcb7: creating. {{(pid=87233) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 07 17:22:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-2346f4ac-ac9c-4d51-9a25-34cf1cc0639c tempest-GroupSnapshotsTest-1142774596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-2346f4ac-ac9c-4d51-9a25-34cf1cc0639c tempest-GroupSnapshotsTest-1142774596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:27 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-2346f4ac-ac9c-4d51-9a25-34cf1cc0639c tempest-GroupSnapshotsTest-1142774596 None] Creating offline snapshot 6f70e2fe-3170-484a-b8af-1b877dbcf217 of volume d7425f66-28d4-4338-ae20-aa1b931b9162 {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:22:27 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[31aaa275-a120-4017-a61a-8be6551432c2]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:22:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2346f4ac-ac9c-4d51-9a25-34cf1cc0639c tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7425f66-28d4-4338-ae20-aa1b931b9162 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:28 devstack sudo[91692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7425f66-28d4-4338-ae20-aa1b931b9162 Jul 07 17:22:28 devstack sudo[91692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:28 devstack sudo[91690]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-08ba0369-097f-4eaf-bd7f-f8ffbae4d3d6 tempest-GroupsV314Test-785834081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.941s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:28 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-08ba0369-097f-4eaf-bd7f-f8ffbae4d3d6 tempest-GroupsV314Test-785834081 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:22:28 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-08ba0369-097f-4eaf-bd7f-f8ffbae4d3d6 tempest-GroupsV314Test-785834081 None] Delete group completed successfully. Jul 07 17:22:28 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-53991893-cf9c-4353-8683-cfd0364448e9 tempest-GroupsV314Test-785834081 None] Acquiring lock "cinder-quobyte-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:22:28 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-53991893-cf9c-4353-8683-cfd0364448e9 tempest-GroupsV314Test-785834081 None] Lock "cinder-quobyte-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e" acquired by "delete_volume" :: waited 0.032s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:22:28 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[366ec27e-eccb-4d54-91a2-75c264e89bb8]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:22:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-53991893-cf9c-4353-8683-cfd0364448e9 tempest-GroupsV314Test-785834081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:28 devstack sudo[91700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e Jul 07 17:22:28 devstack sudo[91700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:28 devstack sudo[91692]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2346f4ac-ac9c-4d51-9a25-34cf1cc0639c tempest-GroupSnapshotsTest-1142774596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7425f66-28d4-4338-ae20-aa1b931b9162" returned: 0 in 1.025s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2346f4ac-ac9c-4d51-9a25-34cf1cc0639c tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7425f66-28d4-4338-ae20-aa1b931b9162,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7425f66-28d4-4338-ae20-aa1b931b9162.6f70e2fe-3170-484a-b8af-1b877dbcf217 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:28 devstack sudo[91714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7425f66-28d4-4338-ae20-aa1b931b9162,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7425f66-28d4-4338-ae20-aa1b931b9162.6f70e2fe-3170-484a-b8af-1b877dbcf217 1G Jul 07 17:22:28 devstack sudo[91714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:29 devstack sudo[91700]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-53991893-cf9c-4353-8683-cfd0364448e9 tempest-GroupsV314Test-785834081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e" returned: 0 in 0.839s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-53991893-cf9c-4353-8683-cfd0364448e9 tempest-GroupsV314Test-785834081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:29 devstack sudo[91721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e Jul 07 17:22:29 devstack sudo[91721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:29 devstack sudo[91714]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2346f4ac-ac9c-4d51-9a25-34cf1cc0639c tempest-GroupSnapshotsTest-1142774596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7425f66-28d4-4338-ae20-aa1b931b9162,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7425f66-28d4-4338-ae20-aa1b931b9162.6f70e2fe-3170-484a-b8af-1b877dbcf217 1G" returned: 0 in 0.801s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2346f4ac-ac9c-4d51-9a25-34cf1cc0639c tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7425f66-28d4-4338-ae20-aa1b931b9162 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7425f66-28d4-4338-ae20-aa1b931b9162.6f70e2fe-3170-484a-b8af-1b877dbcf217 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:29 devstack sudo[91726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7425f66-28d4-4338-ae20-aa1b931b9162 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7425f66-28d4-4338-ae20-aa1b931b9162.6f70e2fe-3170-484a-b8af-1b877dbcf217 Jul 07 17:22:29 devstack sudo[91726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:30 devstack sudo[91721]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-53991893-cf9c-4353-8683-cfd0364448e9 tempest-GroupsV314Test-785834081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e" returned: 0 in 0.665s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:30 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-53991893-cf9c-4353-8683-cfd0364448e9 tempest-GroupsV314Test-785834081 None] Lock "cinder-quobyte-e0ddd7e0-cb3d-4f64-b641-cf335a4dea0e" released by "delete_volume" :: held 1.576s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:22:30 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-53991893-cf9c-4353-8683-cfd0364448e9 tempest-GroupsV314Test-785834081 None] Created reservations ['9e891a75-5d4e-47ba-abb7-112ce5b8c433'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:22:30 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-53991893-cf9c-4353-8683-cfd0364448e9 tempest-GroupsV314Test-785834081 None] Created reservations ['9b912351-48af-476f-ae52-bf2619faa65a', '9772f086-c9d5-4dbf-be24-d993ea33b403', '513a19c3-e411-4e70-83ce-666cdc04c17c', '42147a6e-8271-45fe-adff-42d09d228a27'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:22:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-53991893-cf9c-4353-8683-cfd0364448e9 tempest-GroupsV314Test-785834081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-53991893-cf9c-4353-8683-cfd0364448e9 tempest-GroupsV314Test-785834081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:30 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-53991893-cf9c-4353-8683-cfd0364448e9 tempest-GroupsV314Test-785834081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:22:30 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-53991893-cf9c-4353-8683-cfd0364448e9 tempest-GroupsV314Test-785834081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:22:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-53991893-cf9c-4353-8683-cfd0364448e9 tempest-GroupsV314Test-785834081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-53991893-cf9c-4353-8683-cfd0364448e9 tempest-GroupsV314Test-785834081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:30 devstack sudo[91733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:22:30 devstack sudo[91733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:30 devstack sudo[91726]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2346f4ac-ac9c-4d51-9a25-34cf1cc0639c tempest-GroupSnapshotsTest-1142774596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7425f66-28d4-4338-ae20-aa1b931b9162 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7425f66-28d4-4338-ae20-aa1b931b9162.6f70e2fe-3170-484a-b8af-1b877dbcf217" returned: 0 in 0.765s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:30 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-2346f4ac-ac9c-4d51-9a25-34cf1cc0639c tempest-GroupSnapshotsTest-1142774596 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7425f66-28d4-4338-ae20-aa1b931b9162.6f70e2fe-3170-484a-b8af-1b877dbcf217 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:22:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2346f4ac-ac9c-4d51-9a25-34cf1cc0639c tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7425f66-28d4-4338-ae20-aa1b931b9162.6f70e2fe-3170-484a-b8af-1b877dbcf217 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:30 devstack sudo[91735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7425f66-28d4-4338-ae20-aa1b931b9162.6f70e2fe-3170-484a-b8af-1b877dbcf217 Jul 07 17:22:30 devstack sudo[91735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:31 devstack sudo[91733]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-53991893-cf9c-4353-8683-cfd0364448e9 tempest-GroupsV314Test-785834081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.751s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:31 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-53991893-cf9c-4353-8683-cfd0364448e9 tempest-GroupsV314Test-785834081 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:22:31 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-53991893-cf9c-4353-8683-cfd0364448e9 tempest-GroupsV314Test-785834081 None] Delete group completed successfully. Jul 07 17:22:31 devstack sudo[91735]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2346f4ac-ac9c-4d51-9a25-34cf1cc0639c tempest-GroupSnapshotsTest-1142774596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7425f66-28d4-4338-ae20-aa1b931b9162.6f70e2fe-3170-484a-b8af-1b877dbcf217" returned: 0 in 0.725s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2346f4ac-ac9c-4d51-9a25-34cf1cc0639c tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7425f66-28d4-4338-ae20-aa1b931b9162.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:31 devstack sudo[91739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7425f66-28d4-4338-ae20-aa1b931b9162.info Jul 07 17:22:31 devstack sudo[91739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:32 devstack sudo[91739]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2346f4ac-ac9c-4d51-9a25-34cf1cc0639c tempest-GroupSnapshotsTest-1142774596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7425f66-28d4-4338-ae20-aa1b931b9162.info" returned: 0 in 0.875s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:32 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-2346f4ac-ac9c-4d51-9a25-34cf1cc0639c tempest-GroupSnapshotsTest-1142774596 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7425f66-28d4-4338-ae20-aa1b931b9162.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:22:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2346f4ac-ac9c-4d51-9a25-34cf1cc0639c tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7425f66-28d4-4338-ae20-aa1b931b9162.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:32 devstack sudo[91754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7425f66-28d4-4338-ae20-aa1b931b9162.info Jul 07 17:22:32 devstack sudo[91754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:33 devstack sudo[91754]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2346f4ac-ac9c-4d51-9a25-34cf1cc0639c tempest-GroupSnapshotsTest-1142774596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7425f66-28d4-4338-ae20-aa1b931b9162.info" returned: 0 in 1.083s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-2346f4ac-ac9c-4d51-9a25-34cf1cc0639c tempest-GroupSnapshotsTest-1142774596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.407s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:33 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-2346f4ac-ac9c-4d51-9a25-34cf1cc0639c tempest-GroupSnapshotsTest-1142774596 None] group_snapshot 2c30bf5f-dc06-4eec-a4a8-844adef4fcb7: created successfully Jul 07 17:22:34 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-d421dfc7-d833-40f7-9a3f-1ce7f0464483 tempest-GroupSnapshotsTest-1142774596 None] group_snapshot 2c30bf5f-dc06-4eec-a4a8-844adef4fcb7: deleting Jul 07 17:22:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d421dfc7-d833-40f7-9a3f-1ce7f0464483 tempest-GroupSnapshotsTest-1142774596 None] group_snapshot 2c30bf5f-dc06-4eec-a4a8-844adef4fcb7: deleting {{(pid=87233) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 07 17:22:34 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d421dfc7-d833-40f7-9a3f-1ce7f0464483 tempest-GroupSnapshotsTest-1142774596 None] Acquiring lock "cinder-quobyte-d7425f66-28d4-4338-ae20-aa1b931b9162" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:22:34 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d421dfc7-d833-40f7-9a3f-1ce7f0464483 tempest-GroupSnapshotsTest-1142774596 None] Lock "cinder-quobyte-d7425f66-28d4-4338-ae20-aa1b931b9162" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:22:34 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d421dfc7-d833-40f7-9a3f-1ce7f0464483 tempest-GroupSnapshotsTest-1142774596 None] Acquiring lock "cinder-quobyte-6f70e2fe-3170-484a-b8af-1b877dbcf217" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:22:34 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d421dfc7-d833-40f7-9a3f-1ce7f0464483 tempest-GroupSnapshotsTest-1142774596 None] Lock "cinder-quobyte-6f70e2fe-3170-484a-b8af-1b877dbcf217" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:22:34 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-d421dfc7-d833-40f7-9a3f-1ce7f0464483 tempest-GroupSnapshotsTest-1142774596 None] Deleting offline snapshot 6f70e2fe-3170-484a-b8af-1b877dbcf217 of volume d7425f66-28d4-4338-ae20-aa1b931b9162 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:22:34 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-d421dfc7-d833-40f7-9a3f-1ce7f0464483 tempest-GroupSnapshotsTest-1142774596 None] snapshot_file for this snap is: volume-d7425f66-28d4-4338-ae20-aa1b931b9162.6f70e2fe-3170-484a-b8af-1b877dbcf217 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:22:34 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ce2a08-1872-4c98-b43b-0bbb73b64b6c]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:22:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d421dfc7-d833-40f7-9a3f-1ce7f0464483 tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7425f66-28d4-4338-ae20-aa1b931b9162.6f70e2fe-3170-484a-b8af-1b877dbcf217 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:34 devstack sudo[91811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7425f66-28d4-4338-ae20-aa1b931b9162.6f70e2fe-3170-484a-b8af-1b877dbcf217 Jul 07 17:22:34 devstack sudo[91811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:35 devstack sudo[91811]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d421dfc7-d833-40f7-9a3f-1ce7f0464483 tempest-GroupSnapshotsTest-1142774596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7425f66-28d4-4338-ae20-aa1b931b9162.6f70e2fe-3170-484a-b8af-1b877dbcf217" returned: 0 in 0.923s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:35 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-d421dfc7-d833-40f7-9a3f-1ce7f0464483 tempest-GroupSnapshotsTest-1142774596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7425f66-28d4-4338-ae20-aa1b931b9162(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:22:35 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[907e7746-58c8-4c93-8765-b6d4e3c1c709]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:22:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d421dfc7-d833-40f7-9a3f-1ce7f0464483 tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7425f66-28d4-4338-ae20-aa1b931b9162 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:35 devstack sudo[91818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7425f66-28d4-4338-ae20-aa1b931b9162 Jul 07 17:22:35 devstack sudo[91818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:36 devstack sudo[91818]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d421dfc7-d833-40f7-9a3f-1ce7f0464483 tempest-GroupSnapshotsTest-1142774596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7425f66-28d4-4338-ae20-aa1b931b9162" returned: 0 in 0.868s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d421dfc7-d833-40f7-9a3f-1ce7f0464483 tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7425f66-28d4-4338-ae20-aa1b931b9162.6f70e2fe-3170-484a-b8af-1b877dbcf217 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:36 devstack sudo[91824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7425f66-28d4-4338-ae20-aa1b931b9162.6f70e2fe-3170-484a-b8af-1b877dbcf217 Jul 07 17:22:36 devstack sudo[91824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:37 devstack sudo[91824]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d421dfc7-d833-40f7-9a3f-1ce7f0464483 tempest-GroupSnapshotsTest-1142774596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7425f66-28d4-4338-ae20-aa1b931b9162.6f70e2fe-3170-484a-b8af-1b877dbcf217" returned: 0 in 0.817s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d421dfc7-d833-40f7-9a3f-1ce7f0464483 tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7425f66-28d4-4338-ae20-aa1b931b9162.6f70e2fe-3170-484a-b8af-1b877dbcf217 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:37 devstack sudo[91830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7425f66-28d4-4338-ae20-aa1b931b9162.6f70e2fe-3170-484a-b8af-1b877dbcf217 Jul 07 17:22:37 devstack sudo[91830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:37 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-5208efc8-f016-491f-879d-5ca98a97430d tempest-GroupsV320Test-398177440 None] Group tempest-GroupsV320Test-Group-1550083142: creating Jul 07 17:22:37 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-5208efc8-f016-491f-879d-5ca98a97430d tempest-GroupsV320Test-398177440 None] Group tempest-GroupsV320Test-Group-1550083142: created successfully Jul 07 17:22:37 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-5208efc8-f016-491f-879d-5ca98a97430d tempest-GroupsV320Test-398177440 None] Create group completed successfully. Jul 07 17:22:38 devstack sudo[91830]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d421dfc7-d833-40f7-9a3f-1ce7f0464483 tempest-GroupSnapshotsTest-1142774596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7425f66-28d4-4338-ae20-aa1b931b9162.6f70e2fe-3170-484a-b8af-1b877dbcf217" returned: 0 in 0.841s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:38 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d421dfc7-d833-40f7-9a3f-1ce7f0464483 tempest-GroupSnapshotsTest-1142774596 None] Lock "cinder-quobyte-6f70e2fe-3170-484a-b8af-1b877dbcf217" released by "_delete_snapshot" :: held 3.597s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:22:38 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d421dfc7-d833-40f7-9a3f-1ce7f0464483 tempest-GroupSnapshotsTest-1142774596 None] Lock "cinder-quobyte-d7425f66-28d4-4338-ae20-aa1b931b9162" released by "delete_snapshot" :: held 3.629s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:22:38 devstack cinder-volume[87233]: WARNING cinder.quota [None req-d421dfc7-d833-40f7-9a3f-1ce7f0464483 tempest-GroupSnapshotsTest-1142774596 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1852740719 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1852740719, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:22:38 devstack cinder-volume[87233]: WARNING cinder.quota [None req-d421dfc7-d833-40f7-9a3f-1ce7f0464483 tempest-GroupSnapshotsTest-1142774596 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1852740719 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1852740719, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:22:38 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-d421dfc7-d833-40f7-9a3f-1ce7f0464483 tempest-GroupSnapshotsTest-1142774596 None] Created reservations ['7af19ffc-6011-40c6-9137-94c4f788c69b', 'd272d198-a863-46cc-839a-4bd325030e65', 'b2a4faa6-e59f-40a9-89a5-74bdde106340', 'f0960b1d-f63b-4c00-9c4c-7cd790dfabd2'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:22:38 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-d421dfc7-d833-40f7-9a3f-1ce7f0464483 tempest-GroupSnapshotsTest-1142774596 None] group_snapshot 2c30bf5f-dc06-4eec-a4a8-844adef4fcb7: deleted successfully Jul 07 17:22:39 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6fa38082-4d0b-4b35-ba85-cbe4f8720ed0 tempest-GroupSnapshotsTest-1142774596 None] Acquiring lock "cinder-quobyte-d7425f66-28d4-4338-ae20-aa1b931b9162" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:22:39 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6fa38082-4d0b-4b35-ba85-cbe4f8720ed0 tempest-GroupSnapshotsTest-1142774596 None] Lock "cinder-quobyte-d7425f66-28d4-4338-ae20-aa1b931b9162" acquired by "delete_volume" :: waited 0.024s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:22:39 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc5eaa9-1cb3-4f9b-ae31-e1507b21abeb]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:22:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6fa38082-4d0b-4b35-ba85-cbe4f8720ed0 tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7425f66-28d4-4338-ae20-aa1b931b9162 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:39 devstack sudo[91835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7425f66-28d4-4338-ae20-aa1b931b9162 Jul 07 17:22:39 devstack sudo[91835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:39 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-0e8d3b53-9b11-4247-b847-36311057631a tempest-GroupsV320Test-398177440 None] Created reservations ['bb94fb29-5297-47db-92a5-2448bce4fd11'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:22:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0e8d3b53-9b11-4247-b847-36311057631a tempest-GroupsV320Test-398177440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0e8d3b53-9b11-4247-b847-36311057631a tempest-GroupsV320Test-398177440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:39 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-0e8d3b53-9b11-4247-b847-36311057631a tempest-GroupsV320Test-398177440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:22:39 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-0e8d3b53-9b11-4247-b847-36311057631a tempest-GroupsV320Test-398177440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:22:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0e8d3b53-9b11-4247-b847-36311057631a tempest-GroupsV320Test-398177440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0e8d3b53-9b11-4247-b847-36311057631a tempest-GroupsV320Test-398177440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:39 devstack sudo[91837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:22:39 devstack sudo[91837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:40 devstack sudo[91835]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6fa38082-4d0b-4b35-ba85-cbe4f8720ed0 tempest-GroupSnapshotsTest-1142774596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7425f66-28d4-4338-ae20-aa1b931b9162" returned: 0 in 0.882s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6fa38082-4d0b-4b35-ba85-cbe4f8720ed0 tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7425f66-28d4-4338-ae20-aa1b931b9162 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:40 devstack sudo[91845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7425f66-28d4-4338-ae20-aa1b931b9162 Jul 07 17:22:40 devstack sudo[91845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:40 devstack sudo[91837]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0e8d3b53-9b11-4247-b847-36311057631a tempest-GroupsV320Test-398177440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.833s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:40 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-0e8d3b53-9b11-4247-b847-36311057631a tempest-GroupsV320Test-398177440 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:22:40 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-0e8d3b53-9b11-4247-b847-36311057631a tempest-GroupsV320Test-398177440 None] Delete group completed successfully. Jul 07 17:22:41 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-af1e3bc2-3aa6-4477-b504-e27dc6ed2bb9 tempest-ServerActionsTestOtherA-1544739102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:22:41 devstack sudo[91845]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:41 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-af1e3bc2-3aa6-4477-b504-e27dc6ed2bb9 tempest-ServerActionsTestOtherA-1544739102 None] Flow 'volume_create_manager' (b4760854-8bb3-4179-9d14-a6ad4f7ad3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:22:41 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-af1e3bc2-3aa6-4477-b504-e27dc6ed2bb9 tempest-ServerActionsTestOtherA-1544739102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (300be5cb-6733-47bb-a9c5-490e1d7e92c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6fa38082-4d0b-4b35-ba85-cbe4f8720ed0 tempest-GroupSnapshotsTest-1142774596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7425f66-28d4-4338-ae20-aa1b931b9162" returned: 0 in 0.969s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:41 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-af1e3bc2-3aa6-4477-b504-e27dc6ed2bb9 tempest-ServerActionsTestOtherA-1544739102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (300be5cb-6733-47bb-a9c5-490e1d7e92c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1271619522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c917cef4-2e9d-49b0-b74a-c67d8ddf006d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d225cb53414e6ca387505525062bd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:22:41Z,use_quota=True,user_id='0b5a16c95d5442afa35fe47f17118624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:41 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-af1e3bc2-3aa6-4477-b504-e27dc6ed2bb9 tempest-ServerActionsTestOtherA-1544739102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (605ba36b-6c06-4826-a430-b127a4e6d379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:41 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-af1e3bc2-3aa6-4477-b504-e27dc6ed2bb9 tempest-ServerActionsTestOtherA-1544739102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (605ba36b-6c06-4826-a430-b127a4e6d379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:41 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-af1e3bc2-3aa6-4477-b504-e27dc6ed2bb9 tempest-ServerActionsTestOtherA-1544739102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0ac3342-9a45-4c21-8ec2-527684bd51c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:41 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-af1e3bc2-3aa6-4477-b504-e27dc6ed2bb9 tempest-ServerActionsTestOtherA-1544739102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0ac3342-9a45-4c21-8ec2-527684bd51c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c917cef4-2e9d-49b0-b74a-c67d8ddf006d', 'volume_name': 'volume-c917cef4-2e9d-49b0-b74a-c67d8ddf006d', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:41 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-af1e3bc2-3aa6-4477-b504-e27dc6ed2bb9 tempest-ServerActionsTestOtherA-1544739102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80d37ea3-3cf9-4cb2-878e-03d4019f36c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:41 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-af1e3bc2-3aa6-4477-b504-e27dc6ed2bb9 tempest-ServerActionsTestOtherA-1544739102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80d37ea3-3cf9-4cb2-878e-03d4019f36c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:41 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-af1e3bc2-3aa6-4477-b504-e27dc6ed2bb9 tempest-ServerActionsTestOtherA-1544739102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93c6ff83-4017-4df7-bd95-12bdfb7528d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:41 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-af1e3bc2-3aa6-4477-b504-e27dc6ed2bb9 tempest-ServerActionsTestOtherA-1544739102 None] Volume c917cef4-2e9d-49b0-b74a-c67d8ddf006d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c917cef4-2e9d-49b0-b74a-c67d8ddf006d', 'volume_size': 1} Jul 07 17:22:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-af1e3bc2-3aa6-4477-b504-e27dc6ed2bb9 tempest-ServerActionsTestOtherA-1544739102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-af1e3bc2-3aa6-4477-b504-e27dc6ed2bb9 tempest-ServerActionsTestOtherA-1544739102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:41 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-af1e3bc2-3aa6-4477-b504-e27dc6ed2bb9 tempest-ServerActionsTestOtherA-1544739102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1271619522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c917cef4-2e9d-49b0-b74a-c67d8ddf006d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d225cb53414e6ca387505525062bd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:22:41Z,use_quota=True,user_id='0b5a16c95d5442afa35fe47f17118624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:22:41 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-af1e3bc2-3aa6-4477-b504-e27dc6ed2bb9 tempest-ServerActionsTestOtherA-1544739102 None] Creating volume c917cef4-2e9d-49b0-b74a-c67d8ddf006d {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:22:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-af1e3bc2-3aa6-4477-b504-e27dc6ed2bb9 tempest-ServerActionsTestOtherA-1544739102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-af1e3bc2-3aa6-4477-b504-e27dc6ed2bb9 tempest-ServerActionsTestOtherA-1544739102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:41 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-af1e3bc2-3aa6-4477-b504-e27dc6ed2bb9 tempest-ServerActionsTestOtherA-1544739102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:22:41 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-af1e3bc2-3aa6-4477-b504-e27dc6ed2bb9 tempest-ServerActionsTestOtherA-1544739102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:22:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-af1e3bc2-3aa6-4477-b504-e27dc6ed2bb9 tempest-ServerActionsTestOtherA-1544739102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:41 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-af1e3bc2-3aa6-4477-b504-e27dc6ed2bb9 tempest-ServerActionsTestOtherA-1544739102 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:22:41 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-af1e3bc2-3aa6-4477-b504-e27dc6ed2bb9 tempest-ServerActionsTestOtherA-1544739102 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:22:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-af1e3bc2-3aa6-4477-b504-e27dc6ed2bb9 tempest-ServerActionsTestOtherA-1544739102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c917cef4-2e9d-49b0-b74a-c67d8ddf006d 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:41 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6fa38082-4d0b-4b35-ba85-cbe4f8720ed0 tempest-GroupSnapshotsTest-1142774596 None] Lock "cinder-quobyte-d7425f66-28d4-4338-ae20-aa1b931b9162" released by "delete_volume" :: held 2.022s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:22:41 devstack sudo[91849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c917cef4-2e9d-49b0-b74a-c67d8ddf006d 1073741824 Jul 07 17:22:41 devstack sudo[91849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:41 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-6fa38082-4d0b-4b35-ba85-cbe4f8720ed0 tempest-GroupSnapshotsTest-1142774596 None] Created reservations ['746a652e-51d8-444d-baeb-8e7fa9e7275d'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:22:41 devstack cinder-volume[87233]: WARNING cinder.quota [None req-6fa38082-4d0b-4b35-ba85-cbe4f8720ed0 tempest-GroupSnapshotsTest-1142774596 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1852740719 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1852740719, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:22:41 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-6fa38082-4d0b-4b35-ba85-cbe4f8720ed0 tempest-GroupSnapshotsTest-1142774596 None] Created reservations ['bf303ab8-80d4-4639-ac88-ff6d39ac7f2e', '56c215a5-270d-4bc5-b567-136eebc802f4', 'a93c7e10-59b8-49d8-9f67-6ef95f52d8d0', '96085c02-7223-4890-a0bd-34e65ec2b8ee'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:22:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-6fa38082-4d0b-4b35-ba85-cbe4f8720ed0 tempest-GroupSnapshotsTest-1142774596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-6fa38082-4d0b-4b35-ba85-cbe4f8720ed0 tempest-GroupSnapshotsTest-1142774596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:41 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-6fa38082-4d0b-4b35-ba85-cbe4f8720ed0 tempest-GroupSnapshotsTest-1142774596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:22:41 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-6fa38082-4d0b-4b35-ba85-cbe4f8720ed0 tempest-GroupSnapshotsTest-1142774596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:22:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-6fa38082-4d0b-4b35-ba85-cbe4f8720ed0 tempest-GroupSnapshotsTest-1142774596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6fa38082-4d0b-4b35-ba85-cbe4f8720ed0 tempest-GroupSnapshotsTest-1142774596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:41 devstack sudo[91851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:22:41 devstack sudo[91851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:43 devstack sudo[91849]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-af1e3bc2-3aa6-4477-b504-e27dc6ed2bb9 tempest-ServerActionsTestOtherA-1544739102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c917cef4-2e9d-49b0-b74a-c67d8ddf006d 1073741824" returned: 0 in 1.719s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:43 devstack sudo[91851]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6fa38082-4d0b-4b35-ba85-cbe4f8720ed0 tempest-GroupSnapshotsTest-1142774596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 1.331s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:43 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-6fa38082-4d0b-4b35-ba85-cbe4f8720ed0 tempest-GroupSnapshotsTest-1142774596 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:22:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-af1e3bc2-3aa6-4477-b504-e27dc6ed2bb9 tempest-ServerActionsTestOtherA-1544739102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c917cef4-2e9d-49b0-b74a-c67d8ddf006d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:43 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-6fa38082-4d0b-4b35-ba85-cbe4f8720ed0 tempest-GroupSnapshotsTest-1142774596 None] Delete group completed successfully. Jul 07 17:22:43 devstack sudo[91858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c917cef4-2e9d-49b0-b74a-c67d8ddf006d Jul 07 17:22:43 devstack sudo[91858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:43 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:22:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:22:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:22:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:43 devstack sudo[91861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:22:43 devstack sudo[91861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:44 devstack sudo[91858]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-af1e3bc2-3aa6-4477-b504-e27dc6ed2bb9 tempest-ServerActionsTestOtherA-1544739102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c917cef4-2e9d-49b0-b74a-c67d8ddf006d" returned: 0 in 1.360s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:44 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-af1e3bc2-3aa6-4477-b504-e27dc6ed2bb9 tempest-ServerActionsTestOtherA-1544739102 None] <== create_volume: return (3171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:22:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-af1e3bc2-3aa6-4477-b504-e27dc6ed2bb9 tempest-ServerActionsTestOtherA-1544739102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.173s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-af1e3bc2-3aa6-4477-b504-e27dc6ed2bb9 tempest-ServerActionsTestOtherA-1544739102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93c6ff83-4017-4df7-bd95-12bdfb7528d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c917cef4-2e9d-49b0-b74a-c67d8ddf006d', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-af1e3bc2-3aa6-4477-b504-e27dc6ed2bb9 tempest-ServerActionsTestOtherA-1544739102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f2d1bb1-228e-4665-aece-417d7894da02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:44 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-af1e3bc2-3aa6-4477-b504-e27dc6ed2bb9 tempest-ServerActionsTestOtherA-1544739102 None] Volume volume-c917cef4-2e9d-49b0-b74a-c67d8ddf006d (c917cef4-2e9d-49b0-b74a-c67d8ddf006d): created successfully Jul 07 17:22:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-af1e3bc2-3aa6-4477-b504-e27dc6ed2bb9 tempest-ServerActionsTestOtherA-1544739102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f2d1bb1-228e-4665-aece-417d7894da02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-af1e3bc2-3aa6-4477-b504-e27dc6ed2bb9 tempest-ServerActionsTestOtherA-1544739102 None] Flow 'volume_create_manager' (b4760854-8bb3-4179-9d14-a6ad4f7ad3f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:22:44 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-af1e3bc2-3aa6-4477-b504-e27dc6ed2bb9 tempest-ServerActionsTestOtherA-1544739102 None] Created volume successfully. Jul 07 17:22:44 devstack sudo[91861]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 1.414s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:44 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:22:44 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:22:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread count: 8 {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:22:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread info: [<_MainThread(MainThread, started 126077716062336)>, , , , , , , ] {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:22:50 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-4531cf47-e008-4bca-aee4-e1e5d9bc2f53 tempest-GroupSnapshotsV319Test-1640515095 None] Group tempest-GroupSnapshotsV319Test-Group-1211277129: creating Jul 07 17:22:50 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-4531cf47-e008-4bca-aee4-e1e5d9bc2f53 tempest-GroupSnapshotsV319Test-1640515095 None] Group tempest-GroupSnapshotsV319Test-Group-1211277129: created successfully Jul 07 17:22:50 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-4531cf47-e008-4bca-aee4-e1e5d9bc2f53 tempest-GroupSnapshotsV319Test-1640515095 None] Create group completed successfully. Jul 07 17:22:51 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-21b94f01-2c2a-476c-a8e0-d0cb0b228620 tempest-GroupSnapshotsV319Test-1640515095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:22:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-21b94f01-2c2a-476c-a8e0-d0cb0b228620 tempest-GroupSnapshotsV319Test-1640515095 None] Flow 'volume_create_manager' (958ce457-239d-45da-9703-996e91b57834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:22:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-21b94f01-2c2a-476c-a8e0-d0cb0b228620 tempest-GroupSnapshotsV319Test-1640515095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a9b47b4-2895-4ccc-8f8b-552ebbde6174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-21b94f01-2c2a-476c-a8e0-d0cb0b228620 tempest-GroupSnapshotsV319Test-1640515095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a9b47b4-2895-4ccc-8f8b-552ebbde6174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2077198105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4c8643d0-1b51-4adc-ad83-dfe024d46cf3,host='devstack@QuobyteHD#QuobyteHD',id=ac0a31c4-1b71-4f84-b8e2-083c4a305dcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5f3111db3264ec290678dffb3c14021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:22:52Z,use_quota=True,user_id='674e223a3295400caf30d183a9ca9888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5aead2c-44fc-449d-9cfa-168dc22e6c05),volume_type_id=b5aead2c-44fc-449d-9cfa-168dc22e6c05)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-21b94f01-2c2a-476c-a8e0-d0cb0b228620 tempest-GroupSnapshotsV319Test-1640515095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6719b2e2-2d75-4b21-afe7-e5491aba31db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-21b94f01-2c2a-476c-a8e0-d0cb0b228620 tempest-GroupSnapshotsV319Test-1640515095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6719b2e2-2d75-4b21-afe7-e5491aba31db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-21b94f01-2c2a-476c-a8e0-d0cb0b228620 tempest-GroupSnapshotsV319Test-1640515095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfd0dbf7-c608-4ecb-b22c-3bec689b9044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-21b94f01-2c2a-476c-a8e0-d0cb0b228620 tempest-GroupSnapshotsV319Test-1640515095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfd0dbf7-c608-4ecb-b22c-3bec689b9044) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac0a31c4-1b71-4f84-b8e2-083c4a305dcd', 'volume_name': 'volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-21b94f01-2c2a-476c-a8e0-d0cb0b228620 tempest-GroupSnapshotsV319Test-1640515095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d91e250-dd1d-4605-b820-af6863c7d3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-21b94f01-2c2a-476c-a8e0-d0cb0b228620 tempest-GroupSnapshotsV319Test-1640515095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d91e250-dd1d-4605-b820-af6863c7d3f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-21b94f01-2c2a-476c-a8e0-d0cb0b228620 tempest-GroupSnapshotsV319Test-1640515095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (919f9b6e-93e3-4e71-88e3-9150ed288be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:51 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-21b94f01-2c2a-476c-a8e0-d0cb0b228620 tempest-GroupSnapshotsV319Test-1640515095 None] Volume ac0a31c4-1b71-4f84-b8e2-083c4a305dcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd', 'volume_size': 1} Jul 07 17:22:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-21b94f01-2c2a-476c-a8e0-d0cb0b228620 tempest-GroupSnapshotsV319Test-1640515095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-21b94f01-2c2a-476c-a8e0-d0cb0b228620 tempest-GroupSnapshotsV319Test-1640515095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:52 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-21b94f01-2c2a-476c-a8e0-d0cb0b228620 tempest-GroupSnapshotsV319Test-1640515095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4c8643d0-1b51-4adc-ad83-dfe024d46cf3,created_at=2026-07-07T15:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2077198105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4c8643d0-1b51-4adc-ad83-dfe024d46cf3,host='devstack@QuobyteHD#QuobyteHD',id=ac0a31c4-1b71-4f84-b8e2-083c4a305dcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5f3111db3264ec290678dffb3c14021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:22:52Z,use_quota=True,user_id='674e223a3295400caf30d183a9ca9888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5aead2c-44fc-449d-9cfa-168dc22e6c05),volume_type_id=b5aead2c-44fc-449d-9cfa-168dc22e6c05)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:22:52 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-21b94f01-2c2a-476c-a8e0-d0cb0b228620 tempest-GroupSnapshotsV319Test-1640515095 None] Creating volume ac0a31c4-1b71-4f84-b8e2-083c4a305dcd {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:22:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-21b94f01-2c2a-476c-a8e0-d0cb0b228620 tempest-GroupSnapshotsV319Test-1640515095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-21b94f01-2c2a-476c-a8e0-d0cb0b228620 tempest-GroupSnapshotsV319Test-1640515095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:52 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-21b94f01-2c2a-476c-a8e0-d0cb0b228620 tempest-GroupSnapshotsV319Test-1640515095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:22:52 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-21b94f01-2c2a-476c-a8e0-d0cb0b228620 tempest-GroupSnapshotsV319Test-1640515095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:22:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-21b94f01-2c2a-476c-a8e0-d0cb0b228620 tempest-GroupSnapshotsV319Test-1640515095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:52 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-21b94f01-2c2a-476c-a8e0-d0cb0b228620 tempest-GroupSnapshotsV319Test-1640515095 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:22:52 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-21b94f01-2c2a-476c-a8e0-d0cb0b228620 tempest-GroupSnapshotsV319Test-1640515095 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:22:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-21b94f01-2c2a-476c-a8e0-d0cb0b228620 tempest-GroupSnapshotsV319Test-1640515095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:52 devstack sudo[91910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd 1073741824 Jul 07 17:22:52 devstack sudo[91910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:52 devstack sudo[91910]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-21b94f01-2c2a-476c-a8e0-d0cb0b228620 tempest-GroupSnapshotsV319Test-1640515095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd 1073741824" returned: 0 in 0.990s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-21b94f01-2c2a-476c-a8e0-d0cb0b228620 tempest-GroupSnapshotsV319Test-1640515095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:53 devstack sudo[91916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd Jul 07 17:22:53 devstack sudo[91916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:54 devstack sudo[91916]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-21b94f01-2c2a-476c-a8e0-d0cb0b228620 tempest-GroupSnapshotsV319Test-1640515095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd" returned: 0 in 1.154s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:54 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-21b94f01-2c2a-476c-a8e0-d0cb0b228620 tempest-GroupSnapshotsV319Test-1640515095 None] <== create_volume: return (2203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:22:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-21b94f01-2c2a-476c-a8e0-d0cb0b228620 tempest-GroupSnapshotsV319Test-1640515095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.206s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-21b94f01-2c2a-476c-a8e0-d0cb0b228620 tempest-GroupSnapshotsV319Test-1640515095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (919f9b6e-93e3-4e71-88e3-9150ed288be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-21b94f01-2c2a-476c-a8e0-d0cb0b228620 tempest-GroupSnapshotsV319Test-1640515095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a9f7f57-f9d3-421e-8a39-320be1424d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:54 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-21b94f01-2c2a-476c-a8e0-d0cb0b228620 tempest-GroupSnapshotsV319Test-1640515095 None] Volume volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd (ac0a31c4-1b71-4f84-b8e2-083c4a305dcd): created successfully Jul 07 17:22:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-21b94f01-2c2a-476c-a8e0-d0cb0b228620 tempest-GroupSnapshotsV319Test-1640515095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a9f7f57-f9d3-421e-8a39-320be1424d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-21b94f01-2c2a-476c-a8e0-d0cb0b228620 tempest-GroupSnapshotsV319Test-1640515095 None] Flow 'volume_create_manager' (958ce457-239d-45da-9703-996e91b57834) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:22:54 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-21b94f01-2c2a-476c-a8e0-d0cb0b228620 tempest-GroupSnapshotsV319Test-1640515095 None] Created volume successfully. Jul 07 17:22:54 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-e5214df7-36f7-41a5-a7f6-272d20cdd407 tempest-GroupSnapshotsV319Test-1640515095 None] GroupSnapshot 94e81226-f92e-4add-906e-dc9c34bd5d12: creating. Jul 07 17:22:55 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e5214df7-36f7-41a5-a7f6-272d20cdd407 tempest-GroupSnapshotsV319Test-1640515095 None] Group snapshot 94e81226-f92e-4add-906e-dc9c34bd5d12: creating. {{(pid=87233) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 07 17:22:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e5214df7-36f7-41a5-a7f6-272d20cdd407 tempest-GroupSnapshotsV319Test-1640515095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e5214df7-36f7-41a5-a7f6-272d20cdd407 tempest-GroupSnapshotsV319Test-1640515095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:55 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-e5214df7-36f7-41a5-a7f6-272d20cdd407 tempest-GroupSnapshotsV319Test-1640515095 None] Creating offline snapshot 05f12dd9-4aaa-4a86-a704-b57afec1e918 of volume ac0a31c4-1b71-4f84-b8e2-083c4a305dcd {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:22:55 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc31514-0cf6-436d-9a55-14fb1583b23d]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:22:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e5214df7-36f7-41a5-a7f6-272d20cdd407 tempest-GroupSnapshotsV319Test-1640515095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:55 devstack sudo[91933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd Jul 07 17:22:55 devstack sudo[91933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:56 devstack sudo[91933]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e5214df7-36f7-41a5-a7f6-272d20cdd407 tempest-GroupSnapshotsV319Test-1640515095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd" returned: 0 in 0.998s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e5214df7-36f7-41a5-a7f6-272d20cdd407 tempest-GroupSnapshotsV319Test-1640515095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd.05f12dd9-4aaa-4a86-a704-b57afec1e918 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:56 devstack sudo[91940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd.05f12dd9-4aaa-4a86-a704-b57afec1e918 1G Jul 07 17:22:56 devstack sudo[91940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:57 devstack sudo[91940]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e5214df7-36f7-41a5-a7f6-272d20cdd407 tempest-GroupSnapshotsV319Test-1640515095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd.05f12dd9-4aaa-4a86-a704-b57afec1e918 1G" returned: 0 in 0.960s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e5214df7-36f7-41a5-a7f6-272d20cdd407 tempest-GroupSnapshotsV319Test-1640515095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd.05f12dd9-4aaa-4a86-a704-b57afec1e918 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:57 devstack sudo[91946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd.05f12dd9-4aaa-4a86-a704-b57afec1e918 Jul 07 17:22:57 devstack sudo[91946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:57 devstack sudo[91946]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e5214df7-36f7-41a5-a7f6-272d20cdd407 tempest-GroupSnapshotsV319Test-1640515095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd.05f12dd9-4aaa-4a86-a704-b57afec1e918" returned: 0 in 0.766s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:57 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-e5214df7-36f7-41a5-a7f6-272d20cdd407 tempest-GroupSnapshotsV319Test-1640515095 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd.05f12dd9-4aaa-4a86-a704-b57afec1e918 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:22:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e5214df7-36f7-41a5-a7f6-272d20cdd407 tempest-GroupSnapshotsV319Test-1640515095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd.05f12dd9-4aaa-4a86-a704-b57afec1e918 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:57 devstack sudo[91951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd.05f12dd9-4aaa-4a86-a704-b57afec1e918 Jul 07 17:22:57 devstack sudo[91951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:58 devstack sudo[91951]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e5214df7-36f7-41a5-a7f6-272d20cdd407 tempest-GroupSnapshotsV319Test-1640515095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd.05f12dd9-4aaa-4a86-a704-b57afec1e918" returned: 0 in 0.682s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e5214df7-36f7-41a5-a7f6-272d20cdd407 tempest-GroupSnapshotsV319Test-1640515095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:58 devstack sudo[91954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd.info Jul 07 17:22:58 devstack sudo[91954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:59 devstack sudo[91954]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e5214df7-36f7-41a5-a7f6-272d20cdd407 tempest-GroupSnapshotsV319Test-1640515095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd.info" returned: 0 in 0.865s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:59 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-e5214df7-36f7-41a5-a7f6-272d20cdd407 tempest-GroupSnapshotsV319Test-1640515095 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:22:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e5214df7-36f7-41a5-a7f6-272d20cdd407 tempest-GroupSnapshotsV319Test-1640515095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:59 devstack sudo[91978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd.info Jul 07 17:22:59 devstack sudo[91978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:59 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5b54bdc-7da3-4472-9076-68034d9a16e4 tempest-AttachVolumeTestJSON-841000093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:22:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d5b54bdc-7da3-4472-9076-68034d9a16e4 tempest-AttachVolumeTestJSON-841000093 None] Flow 'volume_create_manager' (5578401a-2424-4beb-97d5-58deb2720ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:22:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d5b54bdc-7da3-4472-9076-68034d9a16e4 tempest-AttachVolumeTestJSON-841000093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7644a74a-6674-41fa-a162-e1009f25e6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d5b54bdc-7da3-4472-9076-68034d9a16e4 tempest-AttachVolumeTestJSON-841000093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7644a74a-6674-41fa-a162-e1009f25e6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:22:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-378088426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f410302d-27df-4225-9875-45a67313cd47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d36fd6a2d1430aa9143c1c4dcb50ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:23:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:23:00Z,use_quota=True,user_id='e1b4dbf2f53d49119331b866cdc284c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d5b54bdc-7da3-4472-9076-68034d9a16e4 tempest-AttachVolumeTestJSON-841000093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c9648de-62dd-4e34-b3f3-546a4177c3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d5b54bdc-7da3-4472-9076-68034d9a16e4 tempest-AttachVolumeTestJSON-841000093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c9648de-62dd-4e34-b3f3-546a4177c3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d5b54bdc-7da3-4472-9076-68034d9a16e4 tempest-AttachVolumeTestJSON-841000093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa5b2166-41c2-4852-86c2-59455bf00b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d5b54bdc-7da3-4472-9076-68034d9a16e4 tempest-AttachVolumeTestJSON-841000093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa5b2166-41c2-4852-86c2-59455bf00b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f410302d-27df-4225-9875-45a67313cd47', 'volume_name': 'volume-f410302d-27df-4225-9875-45a67313cd47', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d5b54bdc-7da3-4472-9076-68034d9a16e4 tempest-AttachVolumeTestJSON-841000093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db3bbf74-fdcd-44bd-ac0b-05686cfdee67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d5b54bdc-7da3-4472-9076-68034d9a16e4 tempest-AttachVolumeTestJSON-841000093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db3bbf74-fdcd-44bd-ac0b-05686cfdee67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d5b54bdc-7da3-4472-9076-68034d9a16e4 tempest-AttachVolumeTestJSON-841000093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c63a34e1-44c1-4603-b4b3-4c1b08932ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:59 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-d5b54bdc-7da3-4472-9076-68034d9a16e4 tempest-AttachVolumeTestJSON-841000093 None] Volume f410302d-27df-4225-9875-45a67313cd47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f410302d-27df-4225-9875-45a67313cd47', 'volume_size': 1} Jul 07 17:22:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d5b54bdc-7da3-4472-9076-68034d9a16e4 tempest-AttachVolumeTestJSON-841000093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:00 devstack sudo[91978]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e5214df7-36f7-41a5-a7f6-272d20cdd407 tempest-GroupSnapshotsV319Test-1640515095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd.info" returned: 0 in 0.825s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e5214df7-36f7-41a5-a7f6-272d20cdd407 tempest-GroupSnapshotsV319Test-1640515095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.224s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d5b54bdc-7da3-4472-9076-68034d9a16e4 tempest-AttachVolumeTestJSON-841000093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.472s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:00 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d5b54bdc-7da3-4472-9076-68034d9a16e4 tempest-AttachVolumeTestJSON-841000093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:22:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-378088426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f410302d-27df-4225-9875-45a67313cd47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d36fd6a2d1430aa9143c1c4dcb50ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:23:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:23:00Z,use_quota=True,user_id='e1b4dbf2f53d49119331b866cdc284c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:23:00 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-d5b54bdc-7da3-4472-9076-68034d9a16e4 tempest-AttachVolumeTestJSON-841000093 None] Creating volume f410302d-27df-4225-9875-45a67313cd47 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:23:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d5b54bdc-7da3-4472-9076-68034d9a16e4 tempest-AttachVolumeTestJSON-841000093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d5b54bdc-7da3-4472-9076-68034d9a16e4 tempest-AttachVolumeTestJSON-841000093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:00 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d5b54bdc-7da3-4472-9076-68034d9a16e4 tempest-AttachVolumeTestJSON-841000093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:23:00 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d5b54bdc-7da3-4472-9076-68034d9a16e4 tempest-AttachVolumeTestJSON-841000093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:23:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d5b54bdc-7da3-4472-9076-68034d9a16e4 tempest-AttachVolumeTestJSON-841000093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:00 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d5b54bdc-7da3-4472-9076-68034d9a16e4 tempest-AttachVolumeTestJSON-841000093 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:23:00 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-d5b54bdc-7da3-4472-9076-68034d9a16e4 tempest-AttachVolumeTestJSON-841000093 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:23:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d5b54bdc-7da3-4472-9076-68034d9a16e4 tempest-AttachVolumeTestJSON-841000093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f410302d-27df-4225-9875-45a67313cd47 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:00 devstack sudo[91983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f410302d-27df-4225-9875-45a67313cd47 1073741824 Jul 07 17:23:00 devstack sudo[91983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:00 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-e5214df7-36f7-41a5-a7f6-272d20cdd407 tempest-GroupSnapshotsV319Test-1640515095 None] group_snapshot 94e81226-f92e-4add-906e-dc9c34bd5d12: created successfully Jul 07 17:23:01 devstack sudo[91983]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d5b54bdc-7da3-4472-9076-68034d9a16e4 tempest-AttachVolumeTestJSON-841000093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f410302d-27df-4225-9875-45a67313cd47 1073741824" returned: 0 in 1.092s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d5b54bdc-7da3-4472-9076-68034d9a16e4 tempest-AttachVolumeTestJSON-841000093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f410302d-27df-4225-9875-45a67313cd47 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:01 devstack sudo[92010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f410302d-27df-4225-9875-45a67313cd47 Jul 07 17:23:01 devstack sudo[92010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:02 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-ee8cd600-5262-429f-b504-2b7687f290cf tempest-GroupSnapshotsV319Test-1640515095 None] group_snapshot 94e81226-f92e-4add-906e-dc9c34bd5d12: deleting Jul 07 17:23:02 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ee8cd600-5262-429f-b504-2b7687f290cf tempest-GroupSnapshotsV319Test-1640515095 None] group_snapshot 94e81226-f92e-4add-906e-dc9c34bd5d12: deleting {{(pid=87233) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 07 17:23:02 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ee8cd600-5262-429f-b504-2b7687f290cf tempest-GroupSnapshotsV319Test-1640515095 None] Acquiring lock "cinder-quobyte-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:02 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ee8cd600-5262-429f-b504-2b7687f290cf tempest-GroupSnapshotsV319Test-1640515095 None] Lock "cinder-quobyte-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:02 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ee8cd600-5262-429f-b504-2b7687f290cf tempest-GroupSnapshotsV319Test-1640515095 None] Acquiring lock "cinder-quobyte-05f12dd9-4aaa-4a86-a704-b57afec1e918" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:02 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ee8cd600-5262-429f-b504-2b7687f290cf tempest-GroupSnapshotsV319Test-1640515095 None] Lock "cinder-quobyte-05f12dd9-4aaa-4a86-a704-b57afec1e918" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:02 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-ee8cd600-5262-429f-b504-2b7687f290cf tempest-GroupSnapshotsV319Test-1640515095 None] Deleting offline snapshot 05f12dd9-4aaa-4a86-a704-b57afec1e918 of volume ac0a31c4-1b71-4f84-b8e2-083c4a305dcd {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:23:02 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-ee8cd600-5262-429f-b504-2b7687f290cf tempest-GroupSnapshotsV319Test-1640515095 None] snapshot_file for this snap is: volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd.05f12dd9-4aaa-4a86-a704-b57afec1e918 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:23:02 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d274cd40-7f7a-4592-a638-a39b0ab3ce82]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ee8cd600-5262-429f-b504-2b7687f290cf tempest-GroupSnapshotsV319Test-1640515095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd.05f12dd9-4aaa-4a86-a704-b57afec1e918 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:02 devstack sudo[92014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd.05f12dd9-4aaa-4a86-a704-b57afec1e918 Jul 07 17:23:02 devstack sudo[92014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:02 devstack sudo[92010]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d5b54bdc-7da3-4472-9076-68034d9a16e4 tempest-AttachVolumeTestJSON-841000093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f410302d-27df-4225-9875-45a67313cd47" returned: 0 in 1.253s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:02 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d5b54bdc-7da3-4472-9076-68034d9a16e4 tempest-AttachVolumeTestJSON-841000093 None] <== create_volume: return (2417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:23:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d5b54bdc-7da3-4472-9076-68034d9a16e4 tempest-AttachVolumeTestJSON-841000093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.425s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:02 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d5b54bdc-7da3-4472-9076-68034d9a16e4 tempest-AttachVolumeTestJSON-841000093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c63a34e1-44c1-4603-b4b3-4c1b08932ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f410302d-27df-4225-9875-45a67313cd47', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:02 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d5b54bdc-7da3-4472-9076-68034d9a16e4 tempest-AttachVolumeTestJSON-841000093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e67621ab-c358-410a-81e2-33b33f2b4d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:02 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-d5b54bdc-7da3-4472-9076-68034d9a16e4 tempest-AttachVolumeTestJSON-841000093 None] Volume volume-f410302d-27df-4225-9875-45a67313cd47 (f410302d-27df-4225-9875-45a67313cd47): created successfully Jul 07 17:23:02 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d5b54bdc-7da3-4472-9076-68034d9a16e4 tempest-AttachVolumeTestJSON-841000093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e67621ab-c358-410a-81e2-33b33f2b4d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:02 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d5b54bdc-7da3-4472-9076-68034d9a16e4 tempest-AttachVolumeTestJSON-841000093 None] Flow 'volume_create_manager' (5578401a-2424-4beb-97d5-58deb2720ffc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:23:02 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-d5b54bdc-7da3-4472-9076-68034d9a16e4 tempest-AttachVolumeTestJSON-841000093 None] Created volume successfully. Jul 07 17:23:03 devstack sudo[92014]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ee8cd600-5262-429f-b504-2b7687f290cf tempest-GroupSnapshotsV319Test-1640515095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd.05f12dd9-4aaa-4a86-a704-b57afec1e918" returned: 0 in 1.417s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:03 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-ee8cd600-5262-429f-b504-2b7687f290cf tempest-GroupSnapshotsV319Test-1640515095 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:23:03 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5318e832-fa2f-4607-874a-6dca9bd600e0]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ee8cd600-5262-429f-b504-2b7687f290cf tempest-GroupSnapshotsV319Test-1640515095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:03 devstack sudo[92025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd Jul 07 17:23:03 devstack sudo[92025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:04 devstack sudo[92025]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ee8cd600-5262-429f-b504-2b7687f290cf tempest-GroupSnapshotsV319Test-1640515095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd" returned: 0 in 1.200s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ee8cd600-5262-429f-b504-2b7687f290cf tempest-GroupSnapshotsV319Test-1640515095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd.05f12dd9-4aaa-4a86-a704-b57afec1e918 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:05 devstack sudo[92030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd.05f12dd9-4aaa-4a86-a704-b57afec1e918 Jul 07 17:23:05 devstack sudo[92030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:06 devstack sudo[92030]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ee8cd600-5262-429f-b504-2b7687f290cf tempest-GroupSnapshotsV319Test-1640515095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd.05f12dd9-4aaa-4a86-a704-b57afec1e918" returned: 0 in 1.302s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ee8cd600-5262-429f-b504-2b7687f290cf tempest-GroupSnapshotsV319Test-1640515095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd.05f12dd9-4aaa-4a86-a704-b57afec1e918 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:06 devstack sudo[92045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd.05f12dd9-4aaa-4a86-a704-b57afec1e918 Jul 07 17:23:06 devstack sudo[92045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-4bc9243f-8d10-4d38-8ca6-e2ae516e28af req-592110ea-c025-4c04-9603-e2d1cbd46644 tempest-AttachVolumeTestJSON-841000093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-4bc9243f-8d10-4d38-8ca6-e2ae516e28af req-592110ea-c025-4c04-9603-e2d1cbd46644 tempest-AttachVolumeTestJSON-841000093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:06 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a600c772-0d9e-4ae8-8dc5-5b2cfcf9a4ba]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-4bc9243f-8d10-4d38-8ca6-e2ae516e28af req-592110ea-c025-4c04-9603-e2d1cbd46644 tempest-AttachVolumeTestJSON-841000093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f410302d-27df-4225-9875-45a67313cd47 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:06 devstack sudo[92059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f410302d-27df-4225-9875-45a67313cd47 Jul 07 17:23:06 devstack sudo[92059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:07 devstack sudo[92045]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ee8cd600-5262-429f-b504-2b7687f290cf tempest-GroupSnapshotsV319Test-1640515095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd.05f12dd9-4aaa-4a86-a704-b57afec1e918" returned: 0 in 1.012s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:07 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ee8cd600-5262-429f-b504-2b7687f290cf tempest-GroupSnapshotsV319Test-1640515095 None] Lock "cinder-quobyte-05f12dd9-4aaa-4a86-a704-b57afec1e918" released by "_delete_snapshot" :: held 5.148s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:07 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ee8cd600-5262-429f-b504-2b7687f290cf tempest-GroupSnapshotsV319Test-1640515095 None] Lock "cinder-quobyte-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd" released by "delete_snapshot" :: held 5.203s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:07 devstack cinder-volume[87233]: WARNING cinder.quota [None req-ee8cd600-5262-429f-b504-2b7687f290cf tempest-GroupSnapshotsV319Test-1640515095 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1279519623 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1279519623, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:23:07 devstack cinder-volume[87233]: WARNING cinder.quota [None req-ee8cd600-5262-429f-b504-2b7687f290cf tempest-GroupSnapshotsV319Test-1640515095 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1279519623 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1279519623, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:23:07 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-ee8cd600-5262-429f-b504-2b7687f290cf tempest-GroupSnapshotsV319Test-1640515095 None] Created reservations ['56b84d64-f96a-4754-b9bb-2b3e6d0c2ba4', 'a3259c36-b5c7-4aa8-a5f2-12aadaa0625b', '20b4d8d5-ffa8-4e37-9a0f-d31d4464dbc9', 'ce3f2f20-85f3-4d13-9556-38517ff772f4'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:23:07 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-ee8cd600-5262-429f-b504-2b7687f290cf tempest-GroupSnapshotsV319Test-1640515095 None] group_snapshot 94e81226-f92e-4add-906e-dc9c34bd5d12: deleted successfully Jul 07 17:23:08 devstack sudo[92059]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-4bc9243f-8d10-4d38-8ca6-e2ae516e28af req-592110ea-c025-4c04-9603-e2d1cbd46644 tempest-AttachVolumeTestJSON-841000093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f410302d-27df-4225-9875-45a67313cd47" returned: 0 in 1.615s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-4bc9243f-8d10-4d38-8ca6-e2ae516e28af req-592110ea-c025-4c04-9603-e2d1cbd46644 tempest-AttachVolumeTestJSON-841000093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.681s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:08 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-4bc9243f-8d10-4d38-8ca6-e2ae516e28af req-592110ea-c025-4c04-9603-e2d1cbd46644 tempest-AttachVolumeTestJSON-841000093 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7', 'name': 'volume-f410302d-27df-4225-9875-45a67313cd47', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '50d01db9-ca6d-4f38-9994-fd2686ffdee1', 'enforce_multipath': True} {{(pid=87233) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:23:08 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-4bc9243f-8d10-4d38-8ca6-e2ae516e28af req-592110ea-c025-4c04-9603-e2d1cbd46644 tempest-AttachVolumeTestJSON-841000093 None] attachment_update completed successfully. Jul 07 17:23:09 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-89fa514f-7808-4ff2-adeb-85be1cb19cea tempest-GroupSnapshotsV319Test-1640515095 None] Acquiring lock "cinder-quobyte-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:09 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-89fa514f-7808-4ff2-adeb-85be1cb19cea tempest-GroupSnapshotsV319Test-1640515095 None] Lock "cinder-quobyte-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd" acquired by "delete_volume" :: waited 0.019s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:09 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9b7dfe-d18a-4c96-8db0-6d96d58cd995]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-89fa514f-7808-4ff2-adeb-85be1cb19cea tempest-GroupSnapshotsV319Test-1640515095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:09 devstack sudo[92160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd Jul 07 17:23:09 devstack sudo[92160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:10 devstack sudo[92160]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-89fa514f-7808-4ff2-adeb-85be1cb19cea tempest-GroupSnapshotsV319Test-1640515095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd" returned: 0 in 1.431s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-89fa514f-7808-4ff2-adeb-85be1cb19cea tempest-GroupSnapshotsV319Test-1640515095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:10 devstack sudo[92481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd Jul 07 17:23:10 devstack sudo[92481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:11 devstack sudo[92481]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-89fa514f-7808-4ff2-adeb-85be1cb19cea tempest-GroupSnapshotsV319Test-1640515095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd" returned: 0 in 0.740s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:11 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-89fa514f-7808-4ff2-adeb-85be1cb19cea tempest-GroupSnapshotsV319Test-1640515095 None] Lock "cinder-quobyte-ac0a31c4-1b71-4f84-b8e2-083c4a305dcd" released by "delete_volume" :: held 2.264s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:11 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-89fa514f-7808-4ff2-adeb-85be1cb19cea tempest-GroupSnapshotsV319Test-1640515095 None] Created reservations ['1888c068-d7b8-4a6a-a4c7-5449f540dbd1'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:23:11 devstack cinder-volume[87233]: WARNING cinder.quota [None req-89fa514f-7808-4ff2-adeb-85be1cb19cea tempest-GroupSnapshotsV319Test-1640515095 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1279519623 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1279519623, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:23:11 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-89fa514f-7808-4ff2-adeb-85be1cb19cea tempest-GroupSnapshotsV319Test-1640515095 None] Created reservations ['49410e50-2301-4f89-966b-7f54f58a1317', 'd39c28f9-2548-4b2e-af2a-7e14be1cde50', 'c4c8a93b-58b2-4775-9c39-58fe1d09aa90', '1b8cbd50-d55e-4d2e-a77b-bf9096dac000'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:23:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-89fa514f-7808-4ff2-adeb-85be1cb19cea tempest-GroupSnapshotsV319Test-1640515095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-89fa514f-7808-4ff2-adeb-85be1cb19cea tempest-GroupSnapshotsV319Test-1640515095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:11 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-89fa514f-7808-4ff2-adeb-85be1cb19cea tempest-GroupSnapshotsV319Test-1640515095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:23:11 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-89fa514f-7808-4ff2-adeb-85be1cb19cea tempest-GroupSnapshotsV319Test-1640515095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:23:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-89fa514f-7808-4ff2-adeb-85be1cb19cea tempest-GroupSnapshotsV319Test-1640515095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-89fa514f-7808-4ff2-adeb-85be1cb19cea tempest-GroupSnapshotsV319Test-1640515095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:11 devstack sudo[92484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:23:11 devstack sudo[92484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:12 devstack sudo[92484]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-89fa514f-7808-4ff2-adeb-85be1cb19cea tempest-GroupSnapshotsV319Test-1640515095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.690s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:12 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-89fa514f-7808-4ff2-adeb-85be1cb19cea tempest-GroupSnapshotsV319Test-1640515095 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:23:12 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-89fa514f-7808-4ff2-adeb-85be1cb19cea tempest-GroupSnapshotsV319Test-1640515095 None] Delete group completed successfully. Jul 07 17:23:13 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cf8c6c7-da8d-4462-91d7-01feea539074 tempest-AttachVolumeTestJSON-841000093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:23:14 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-3cf8c6c7-da8d-4462-91d7-01feea539074 tempest-AttachVolumeTestJSON-841000093 None] Flow 'volume_create_manager' (5058da6c-ff8a-4b5b-9932-36b5f1e8e11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:23:14 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-3cf8c6c7-da8d-4462-91d7-01feea539074 tempest-AttachVolumeTestJSON-841000093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d01a0d-2ac1-4987-87fa-0017355a7007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:14 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-3cf8c6c7-da8d-4462-91d7-01feea539074 tempest-AttachVolumeTestJSON-841000093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d01a0d-2ac1-4987-87fa-0017355a7007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-217824295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60d91305-1e71-4035-9197-acd3d6c65087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d36fd6a2d1430aa9143c1c4dcb50ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:23:14Z,use_quota=True,user_id='e1b4dbf2f53d49119331b866cdc284c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:14 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-3cf8c6c7-da8d-4462-91d7-01feea539074 tempest-AttachVolumeTestJSON-841000093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dedb3519-6adb-47a9-b965-76ac78645496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:14 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-3cf8c6c7-da8d-4462-91d7-01feea539074 tempest-AttachVolumeTestJSON-841000093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dedb3519-6adb-47a9-b965-76ac78645496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:14 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-3cf8c6c7-da8d-4462-91d7-01feea539074 tempest-AttachVolumeTestJSON-841000093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (174ba29e-314e-41f4-846f-761ef96489fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:14 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-3cf8c6c7-da8d-4462-91d7-01feea539074 tempest-AttachVolumeTestJSON-841000093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (174ba29e-314e-41f4-846f-761ef96489fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60d91305-1e71-4035-9197-acd3d6c65087', 'volume_name': 'volume-60d91305-1e71-4035-9197-acd3d6c65087', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:14 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-3cf8c6c7-da8d-4462-91d7-01feea539074 tempest-AttachVolumeTestJSON-841000093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ece1f838-abdc-4754-a197-bdf02ad14d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:14 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-3cf8c6c7-da8d-4462-91d7-01feea539074 tempest-AttachVolumeTestJSON-841000093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ece1f838-abdc-4754-a197-bdf02ad14d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:14 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-3cf8c6c7-da8d-4462-91d7-01feea539074 tempest-AttachVolumeTestJSON-841000093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4ceb472-bd38-4a96-afc9-5b2f81903205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:14 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-3cf8c6c7-da8d-4462-91d7-01feea539074 tempest-AttachVolumeTestJSON-841000093 None] Volume 60d91305-1e71-4035-9197-acd3d6c65087: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60d91305-1e71-4035-9197-acd3d6c65087', 'volume_size': 1} Jul 07 17:23:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-3cf8c6c7-da8d-4462-91d7-01feea539074 tempest-AttachVolumeTestJSON-841000093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-3cf8c6c7-da8d-4462-91d7-01feea539074 tempest-AttachVolumeTestJSON-841000093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:14 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-3cf8c6c7-da8d-4462-91d7-01feea539074 tempest-AttachVolumeTestJSON-841000093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-217824295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60d91305-1e71-4035-9197-acd3d6c65087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d36fd6a2d1430aa9143c1c4dcb50ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:23:14Z,use_quota=True,user_id='e1b4dbf2f53d49119331b866cdc284c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:23:14 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-3cf8c6c7-da8d-4462-91d7-01feea539074 tempest-AttachVolumeTestJSON-841000093 None] Creating volume 60d91305-1e71-4035-9197-acd3d6c65087 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:23:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-3cf8c6c7-da8d-4462-91d7-01feea539074 tempest-AttachVolumeTestJSON-841000093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-3cf8c6c7-da8d-4462-91d7-01feea539074 tempest-AttachVolumeTestJSON-841000093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:14 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-3cf8c6c7-da8d-4462-91d7-01feea539074 tempest-AttachVolumeTestJSON-841000093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:23:14 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-3cf8c6c7-da8d-4462-91d7-01feea539074 tempest-AttachVolumeTestJSON-841000093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:23:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-3cf8c6c7-da8d-4462-91d7-01feea539074 tempest-AttachVolumeTestJSON-841000093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:14 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-3cf8c6c7-da8d-4462-91d7-01feea539074 tempest-AttachVolumeTestJSON-841000093 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:23:14 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-3cf8c6c7-da8d-4462-91d7-01feea539074 tempest-AttachVolumeTestJSON-841000093 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:23:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3cf8c6c7-da8d-4462-91d7-01feea539074 tempest-AttachVolumeTestJSON-841000093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-60d91305-1e71-4035-9197-acd3d6c65087 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:14 devstack sudo[92487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-60d91305-1e71-4035-9197-acd3d6c65087 1073741824 Jul 07 17:23:14 devstack sudo[92487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:15 devstack sudo[92487]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3cf8c6c7-da8d-4462-91d7-01feea539074 tempest-AttachVolumeTestJSON-841000093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-60d91305-1e71-4035-9197-acd3d6c65087 1073741824" returned: 0 in 1.170s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3cf8c6c7-da8d-4462-91d7-01feea539074 tempest-AttachVolumeTestJSON-841000093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-60d91305-1e71-4035-9197-acd3d6c65087 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:15 devstack sudo[92522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-60d91305-1e71-4035-9197-acd3d6c65087 Jul 07 17:23:15 devstack sudo[92522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:16 devstack sudo[92522]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3cf8c6c7-da8d-4462-91d7-01feea539074 tempest-AttachVolumeTestJSON-841000093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-60d91305-1e71-4035-9197-acd3d6c65087" returned: 0 in 0.791s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:16 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-3cf8c6c7-da8d-4462-91d7-01feea539074 tempest-AttachVolumeTestJSON-841000093 None] <== create_volume: return (2017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:23:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-3cf8c6c7-da8d-4462-91d7-01feea539074 tempest-AttachVolumeTestJSON-841000093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.020s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:16 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-3cf8c6c7-da8d-4462-91d7-01feea539074 tempest-AttachVolumeTestJSON-841000093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4ceb472-bd38-4a96-afc9-5b2f81903205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60d91305-1e71-4035-9197-acd3d6c65087', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:16 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-3cf8c6c7-da8d-4462-91d7-01feea539074 tempest-AttachVolumeTestJSON-841000093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c53a9ffe-6ed8-47a4-98a5-2676ab0ca5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:16 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-3cf8c6c7-da8d-4462-91d7-01feea539074 tempest-AttachVolumeTestJSON-841000093 None] Volume volume-60d91305-1e71-4035-9197-acd3d6c65087 (60d91305-1e71-4035-9197-acd3d6c65087): created successfully Jul 07 17:23:16 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-3cf8c6c7-da8d-4462-91d7-01feea539074 tempest-AttachVolumeTestJSON-841000093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c53a9ffe-6ed8-47a4-98a5-2676ab0ca5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:16 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-3cf8c6c7-da8d-4462-91d7-01feea539074 tempest-AttachVolumeTestJSON-841000093 None] Flow 'volume_create_manager' (5058da6c-ff8a-4b5b-9932-36b5f1e8e11d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:23:16 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-3cf8c6c7-da8d-4462-91d7-01feea539074 tempest-AttachVolumeTestJSON-841000093 None] Created volume successfully. Jul 07 17:23:20 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ee1d421-81f8-4b7b-9ff0-81deae15608e tempest-SnapshotsActionsTest-1129268036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:23:20 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0ee1d421-81f8-4b7b-9ff0-81deae15608e tempest-SnapshotsActionsTest-1129268036 None] Flow 'volume_create_manager' (b3d151c8-e119-4c58-a15a-2bdf76273eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:23:20 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0ee1d421-81f8-4b7b-9ff0-81deae15608e tempest-SnapshotsActionsTest-1129268036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19ae940c-23f4-4360-aafd-10f9fc9c75e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:20 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0ee1d421-81f8-4b7b-9ff0-81deae15608e tempest-SnapshotsActionsTest-1129268036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19ae940c-23f4-4360-aafd-10f9fc9c75e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1574353808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=225b299e-fe3e-4903-821a-c7dc2c297238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87eb330493b24d1094728e81abca1b5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:23:20Z,use_quota=True,user_id='be6fc78781ae4dc39fca1272128974af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:20 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0ee1d421-81f8-4b7b-9ff0-81deae15608e tempest-SnapshotsActionsTest-1129268036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e350444a-db13-4e1d-8027-a236dc67ce48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:20 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0ee1d421-81f8-4b7b-9ff0-81deae15608e tempest-SnapshotsActionsTest-1129268036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e350444a-db13-4e1d-8027-a236dc67ce48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:20 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0ee1d421-81f8-4b7b-9ff0-81deae15608e tempest-SnapshotsActionsTest-1129268036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e388d823-4249-4ae3-b7bb-5e783bc08630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:20 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0ee1d421-81f8-4b7b-9ff0-81deae15608e tempest-SnapshotsActionsTest-1129268036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e388d823-4249-4ae3-b7bb-5e783bc08630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '225b299e-fe3e-4903-821a-c7dc2c297238', 'volume_name': 'volume-225b299e-fe3e-4903-821a-c7dc2c297238', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:20 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0ee1d421-81f8-4b7b-9ff0-81deae15608e tempest-SnapshotsActionsTest-1129268036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3fc50e5-6896-4aab-9c69-7866eb147c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:20 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0ee1d421-81f8-4b7b-9ff0-81deae15608e tempest-SnapshotsActionsTest-1129268036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3fc50e5-6896-4aab-9c69-7866eb147c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:20 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0ee1d421-81f8-4b7b-9ff0-81deae15608e tempest-SnapshotsActionsTest-1129268036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8da8b9e-699c-439c-989e-1c4ea0893143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:20 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-0ee1d421-81f8-4b7b-9ff0-81deae15608e tempest-SnapshotsActionsTest-1129268036 None] Volume 225b299e-fe3e-4903-821a-c7dc2c297238: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-225b299e-fe3e-4903-821a-c7dc2c297238', 'volume_size': 1} Jul 07 17:23:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0ee1d421-81f8-4b7b-9ff0-81deae15608e tempest-SnapshotsActionsTest-1129268036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0ee1d421-81f8-4b7b-9ff0-81deae15608e tempest-SnapshotsActionsTest-1129268036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:20 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-0ee1d421-81f8-4b7b-9ff0-81deae15608e tempest-SnapshotsActionsTest-1129268036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1574353808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=225b299e-fe3e-4903-821a-c7dc2c297238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87eb330493b24d1094728e81abca1b5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:23:20Z,use_quota=True,user_id='be6fc78781ae4dc39fca1272128974af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:23:20 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-0ee1d421-81f8-4b7b-9ff0-81deae15608e tempest-SnapshotsActionsTest-1129268036 None] Creating volume 225b299e-fe3e-4903-821a-c7dc2c297238 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:23:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0ee1d421-81f8-4b7b-9ff0-81deae15608e tempest-SnapshotsActionsTest-1129268036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0ee1d421-81f8-4b7b-9ff0-81deae15608e tempest-SnapshotsActionsTest-1129268036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:20 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-0ee1d421-81f8-4b7b-9ff0-81deae15608e tempest-SnapshotsActionsTest-1129268036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:23:20 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-0ee1d421-81f8-4b7b-9ff0-81deae15608e tempest-SnapshotsActionsTest-1129268036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:23:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0ee1d421-81f8-4b7b-9ff0-81deae15608e tempest-SnapshotsActionsTest-1129268036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:20 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-0ee1d421-81f8-4b7b-9ff0-81deae15608e tempest-SnapshotsActionsTest-1129268036 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:23:20 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-0ee1d421-81f8-4b7b-9ff0-81deae15608e tempest-SnapshotsActionsTest-1129268036 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:23:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0ee1d421-81f8-4b7b-9ff0-81deae15608e tempest-SnapshotsActionsTest-1129268036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:20 devstack sudo[92545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238 1073741824 Jul 07 17:23:20 devstack sudo[92545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-b87b5a39-5175-4001-9e1e-c3c63b29e117 req-9e9a7304-7063-41e9-9425-f05784b86ac2 tempest-AttachVolumeTestJSON-841000093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:21 devstack sudo[92545]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0ee1d421-81f8-4b7b-9ff0-81deae15608e tempest-SnapshotsActionsTest-1129268036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238 1073741824" returned: 0 in 0.914s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0ee1d421-81f8-4b7b-9ff0-81deae15608e tempest-SnapshotsActionsTest-1129268036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:21 devstack sudo[92552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238 Jul 07 17:23:21 devstack sudo[92552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:21 devstack sudo[92552]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0ee1d421-81f8-4b7b-9ff0-81deae15608e tempest-SnapshotsActionsTest-1129268036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238" returned: 0 in 0.694s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:21 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-0ee1d421-81f8-4b7b-9ff0-81deae15608e tempest-SnapshotsActionsTest-1129268036 None] <== create_volume: return (1653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:23:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0ee1d421-81f8-4b7b-9ff0-81deae15608e tempest-SnapshotsActionsTest-1129268036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.656s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-b87b5a39-5175-4001-9e1e-c3c63b29e117 req-9e9a7304-7063-41e9-9425-f05784b86ac2 tempest-AttachVolumeTestJSON-841000093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.477s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:21 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0ee1d421-81f8-4b7b-9ff0-81deae15608e tempest-SnapshotsActionsTest-1129268036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8da8b9e-699c-439c-989e-1c4ea0893143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-225b299e-fe3e-4903-821a-c7dc2c297238', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:21 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0ee1d421-81f8-4b7b-9ff0-81deae15608e tempest-SnapshotsActionsTest-1129268036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6487af63-8c15-483e-bacb-f69590be9adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:21 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:UPDATE=83,cinder:SELECT=88,cinder:INSERT=15,cinder:DELETE=1 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:23:21 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-0ee1d421-81f8-4b7b-9ff0-81deae15608e tempest-SnapshotsActionsTest-1129268036 None] Volume volume-225b299e-fe3e-4903-821a-c7dc2c297238 (225b299e-fe3e-4903-821a-c7dc2c297238): created successfully Jul 07 17:23:21 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0ee1d421-81f8-4b7b-9ff0-81deae15608e tempest-SnapshotsActionsTest-1129268036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6487af63-8c15-483e-bacb-f69590be9adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:21 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0ee1d421-81f8-4b7b-9ff0-81deae15608e tempest-SnapshotsActionsTest-1129268036 None] Flow 'volume_create_manager' (b3d151c8-e119-4c58-a15a-2bdf76273eb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:23:21 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1147bd36-71e9-4cec-8218-355db16ecf64]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-b87b5a39-5175-4001-9e1e-c3c63b29e117 req-9e9a7304-7063-41e9-9425-f05784b86ac2 tempest-AttachVolumeTestJSON-841000093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-60d91305-1e71-4035-9197-acd3d6c65087 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:21 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-0ee1d421-81f8-4b7b-9ff0-81deae15608e tempest-SnapshotsActionsTest-1129268036 None] Created volume successfully. Jul 07 17:23:22 devstack sudo[92558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-60d91305-1e71-4035-9197-acd3d6c65087 Jul 07 17:23:22 devstack sudo[92558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-5a1d4413-098a-4194-85a6-5a3c59944902 tempest-SnapshotsActionsTest-1129268036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:22 devstack sudo[92558]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-b87b5a39-5175-4001-9e1e-c3c63b29e117 req-9e9a7304-7063-41e9-9425-f05784b86ac2 tempest-AttachVolumeTestJSON-841000093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-60d91305-1e71-4035-9197-acd3d6c65087" returned: 0 in 0.949s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-b87b5a39-5175-4001-9e1e-c3c63b29e117 req-9e9a7304-7063-41e9-9425-f05784b86ac2 tempest-AttachVolumeTestJSON-841000093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.012s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-5a1d4413-098a-4194-85a6-5a3c59944902 tempest-SnapshotsActionsTest-1129268036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.376s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:22 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:UPDATE=90,cinder:SELECT=85,cinder:INSERT=22,cinder:DELETE=5 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:23:22 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-5a1d4413-098a-4194-85a6-5a3c59944902 tempest-SnapshotsActionsTest-1129268036 None] Creating offline snapshot 7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa of volume 225b299e-fe3e-4903-821a-c7dc2c297238 {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:23:22 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-b87b5a39-5175-4001-9e1e-c3c63b29e117 req-9e9a7304-7063-41e9-9425-f05784b86ac2 tempest-AttachVolumeTestJSON-841000093 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7', 'name': 'volume-60d91305-1e71-4035-9197-acd3d6c65087', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3fb47d4e-c397-4f26-be55-6ae13106398a', 'enforce_multipath': True} {{(pid=87233) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:23:22 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bccd10f-9d54-4940-9805-a95ac55838ad]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5a1d4413-098a-4194-85a6-5a3c59944902 tempest-SnapshotsActionsTest-1129268036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:22 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-b87b5a39-5175-4001-9e1e-c3c63b29e117 req-9e9a7304-7063-41e9-9425-f05784b86ac2 tempest-AttachVolumeTestJSON-841000093 None] attachment_update completed successfully. Jul 07 17:23:23 devstack sudo[92565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238 Jul 07 17:23:23 devstack sudo[92565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:23 devstack sudo[92565]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5a1d4413-098a-4194-85a6-5a3c59944902 tempest-SnapshotsActionsTest-1129268036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238" returned: 0 in 0.812s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5a1d4413-098a-4194-85a6-5a3c59944902 tempest-SnapshotsActionsTest-1129268036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:23 devstack sudo[92572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa 1G Jul 07 17:23:23 devstack sudo[92572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:24 devstack sudo[92572]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5a1d4413-098a-4194-85a6-5a3c59944902 tempest-SnapshotsActionsTest-1129268036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa 1G" returned: 0 in 0.834s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5a1d4413-098a-4194-85a6-5a3c59944902 tempest-SnapshotsActionsTest-1129268036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-225b299e-fe3e-4903-821a-c7dc2c297238 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:24 devstack sudo[92579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-225b299e-fe3e-4903-821a-c7dc2c297238 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa Jul 07 17:23:24 devstack sudo[92579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:25 devstack sudo[92579]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5a1d4413-098a-4194-85a6-5a3c59944902 tempest-SnapshotsActionsTest-1129268036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-225b299e-fe3e-4903-821a-c7dc2c297238 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa" returned: 0 in 0.680s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:25 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-5a1d4413-098a-4194-85a6-5a3c59944902 tempest-SnapshotsActionsTest-1129268036 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa is being set with open permissions: ugo+rw Jul 07 17:23:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5a1d4413-098a-4194-85a6-5a3c59944902 tempest-SnapshotsActionsTest-1129268036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:25 devstack sudo[92584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa Jul 07 17:23:25 devstack sudo[92584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:25 devstack sudo[92584]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5a1d4413-098a-4194-85a6-5a3c59944902 tempest-SnapshotsActionsTest-1129268036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa" returned: 0 in 0.634s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5a1d4413-098a-4194-85a6-5a3c59944902 tempest-SnapshotsActionsTest-1129268036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:25 devstack sudo[92587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.info Jul 07 17:23:25 devstack sudo[92587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:26 devstack sudo[92587]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5a1d4413-098a-4194-85a6-5a3c59944902 tempest-SnapshotsActionsTest-1129268036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.info" returned: 0 in 0.662s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:26 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-5a1d4413-098a-4194-85a6-5a3c59944902 tempest-SnapshotsActionsTest-1129268036 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.info is being set with open permissions: ugo+rw Jul 07 17:23:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5a1d4413-098a-4194-85a6-5a3c59944902 tempest-SnapshotsActionsTest-1129268036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:26 devstack sudo[92590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.info Jul 07 17:23:26 devstack sudo[92590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:27 devstack sudo[92590]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5a1d4413-098a-4194-85a6-5a3c59944902 tempest-SnapshotsActionsTest-1129268036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.info" returned: 0 in 0.702s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-5a1d4413-098a-4194-85a6-5a3c59944902 tempest-SnapshotsActionsTest-1129268036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.455s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:27 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-5a1d4413-098a-4194-85a6-5a3c59944902 tempest-SnapshotsActionsTest-1129268036 None] Create snapshot completed successfully Jul 07 17:23:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-72247d32-2123-4c21-ab17-479fad8e7711 tempest-SnapshotsActionsTest-1129268036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-72247d32-2123-4c21-ab17-479fad8e7711 tempest-SnapshotsActionsTest-1129268036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:28 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-72247d32-2123-4c21-ab17-479fad8e7711 tempest-SnapshotsActionsTest-1129268036 None] Creating offline snapshot 8ccb8623-c3ba-40bb-b00f-0be7b1c290de of volume 225b299e-fe3e-4903-821a-c7dc2c297238 {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:23:28 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d92a10-ae62-4227-876b-f8ae1d18a5f6]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-72247d32-2123-4c21-ab17-479fad8e7711 tempest-SnapshotsActionsTest-1129268036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:28 devstack sudo[92598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa Jul 07 17:23:28 devstack sudo[92598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:29 devstack sudo[92598]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-72247d32-2123-4c21-ab17-479fad8e7711 tempest-SnapshotsActionsTest-1129268036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa" returned: 0 in 0.842s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:29 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-72247d32-2123-4c21-ab17-479fad8e7711 tempest-SnapshotsActionsTest-1129268036 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-225b299e-fe3e-4903-821a-c7dc2c297238(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:23:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-72247d32-2123-4c21-ab17-479fad8e7711 tempest-SnapshotsActionsTest-1129268036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.8ccb8623-c3ba-40bb-b00f-0be7b1c290de 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:29 devstack sudo[92648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.8ccb8623-c3ba-40bb-b00f-0be7b1c290de 1G Jul 07 17:23:29 devstack sudo[92648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:29 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-95b8c928-bab2-4455-bea7-7c73094aa3ab req-bf7d2a21-0f1b-4f9a-aee0-98207f44a58d tempest-AttachVolumeTestJSON-841000093 None] Terminate volume connection completed successfully. Jul 07 17:23:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-95b8c928-bab2-4455-bea7-7c73094aa3ab req-bf7d2a21-0f1b-4f9a-aee0-98207f44a58d tempest-AttachVolumeTestJSON-841000093 None] Deleting attachment 50d01db9-ca6d-4f38-9994-fd2686ffdee1. {{(pid=87233) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:23:29 devstack sudo[92648]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-72247d32-2123-4c21-ab17-479fad8e7711 tempest-SnapshotsActionsTest-1129268036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.8ccb8623-c3ba-40bb-b00f-0be7b1c290de 1G" returned: 0 in 0.842s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-72247d32-2123-4c21-ab17-479fad8e7711 tempest-SnapshotsActionsTest-1129268036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.8ccb8623-c3ba-40bb-b00f-0be7b1c290de {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:30 devstack sudo[92657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.8ccb8623-c3ba-40bb-b00f-0be7b1c290de Jul 07 17:23:30 devstack sudo[92657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:30 devstack sudo[92657]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-72247d32-2123-4c21-ab17-479fad8e7711 tempest-SnapshotsActionsTest-1129268036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.8ccb8623-c3ba-40bb-b00f-0be7b1c290de" returned: 0 in 0.723s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:30 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-72247d32-2123-4c21-ab17-479fad8e7711 tempest-SnapshotsActionsTest-1129268036 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.8ccb8623-c3ba-40bb-b00f-0be7b1c290de is being set with open permissions: ugo+rw Jul 07 17:23:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-72247d32-2123-4c21-ab17-479fad8e7711 tempest-SnapshotsActionsTest-1129268036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.8ccb8623-c3ba-40bb-b00f-0be7b1c290de {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:30 devstack sudo[92663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.8ccb8623-c3ba-40bb-b00f-0be7b1c290de Jul 07 17:23:30 devstack sudo[92663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:31 devstack sudo[92663]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-72247d32-2123-4c21-ab17-479fad8e7711 tempest-SnapshotsActionsTest-1129268036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.8ccb8623-c3ba-40bb-b00f-0be7b1c290de" returned: 0 in 0.632s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-72247d32-2123-4c21-ab17-479fad8e7711 tempest-SnapshotsActionsTest-1129268036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.144s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:31 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-72247d32-2123-4c21-ab17-479fad8e7711 tempest-SnapshotsActionsTest-1129268036 None] Create snapshot completed successfully Jul 07 17:23:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-0ff6da38-7f8e-4acd-bd23-70a720693695 req-44e57f15-eab3-4efe-aedc-dca83ea3befb tempest-ServerActionsTestOtherA-1544739102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-0ff6da38-7f8e-4acd-bd23-70a720693695 req-44e57f15-eab3-4efe-aedc-dca83ea3befb tempest-ServerActionsTestOtherA-1544739102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:31 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0d8822-77b9-4978-9d53-19cfa2920a1b]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-0ff6da38-7f8e-4acd-bd23-70a720693695 req-44e57f15-eab3-4efe-aedc-dca83ea3befb tempest-ServerActionsTestOtherA-1544739102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c917cef4-2e9d-49b0-b74a-c67d8ddf006d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:31 devstack sudo[92675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c917cef4-2e9d-49b0-b74a-c67d8ddf006d Jul 07 17:23:31 devstack sudo[92675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:32 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-7882f4bd-9912-40bd-87a6-2dbdb67506d8 req-03c5bf55-41ad-45e7-8d75-0b8f1285a83b tempest-AttachVolumeTestJSON-841000093 None] Terminate volume connection completed successfully. Jul 07 17:23:32 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-7882f4bd-9912-40bd-87a6-2dbdb67506d8 req-03c5bf55-41ad-45e7-8d75-0b8f1285a83b tempest-AttachVolumeTestJSON-841000093 None] Deleting attachment 3fb47d4e-c397-4f26-be55-6ae13106398a. {{(pid=87233) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:23:32 devstack sudo[92675]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-0ff6da38-7f8e-4acd-bd23-70a720693695 req-44e57f15-eab3-4efe-aedc-dca83ea3befb tempest-ServerActionsTestOtherA-1544739102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c917cef4-2e9d-49b0-b74a-c67d8ddf006d" returned: 0 in 1.107s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-0ff6da38-7f8e-4acd-bd23-70a720693695 req-44e57f15-eab3-4efe-aedc-dca83ea3befb tempest-ServerActionsTestOtherA-1544739102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.126s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:32 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-0ff6da38-7f8e-4acd-bd23-70a720693695 req-44e57f15-eab3-4efe-aedc-dca83ea3befb tempest-ServerActionsTestOtherA-1544739102 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7', 'name': 'volume-c917cef4-2e9d-49b0-b74a-c67d8ddf006d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '896e0663-99f5-41ff-b32f-52d2d9ce1cdd', 'enforce_multipath': True} {{(pid=87233) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:23:32 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-0ff6da38-7f8e-4acd-bd23-70a720693695 req-44e57f15-eab3-4efe-aedc-dca83ea3befb tempest-ServerActionsTestOtherA-1544739102 None] attachment_update completed successfully. Jul 07 17:23:33 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-059b644a-5602-42ab-8331-6768a5459f97 tempest-SnapshotsActionsTest-439353654 None] Acquiring lock "cinder-8ccb8623-c3ba-40bb-b00f-0be7b1c290de-delete_snapshot" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:33 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-059b644a-5602-42ab-8331-6768a5459f97 tempest-SnapshotsActionsTest-439353654 None] Lock "cinder-8ccb8623-c3ba-40bb-b00f-0be7b1c290de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:33 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-059b644a-5602-42ab-8331-6768a5459f97 tempest-SnapshotsActionsTest-439353654 None] Acquiring lock "cinder-quobyte-225b299e-fe3e-4903-821a-c7dc2c297238" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:33 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-059b644a-5602-42ab-8331-6768a5459f97 tempest-SnapshotsActionsTest-439353654 None] Lock "cinder-quobyte-225b299e-fe3e-4903-821a-c7dc2c297238" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:33 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-059b644a-5602-42ab-8331-6768a5459f97 tempest-SnapshotsActionsTest-439353654 None] Acquiring lock "cinder-quobyte-8ccb8623-c3ba-40bb-b00f-0be7b1c290de" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:33 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-059b644a-5602-42ab-8331-6768a5459f97 tempest-SnapshotsActionsTest-439353654 None] Lock "cinder-quobyte-8ccb8623-c3ba-40bb-b00f-0be7b1c290de" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:33 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-059b644a-5602-42ab-8331-6768a5459f97 tempest-SnapshotsActionsTest-439353654 None] Deleting offline snapshot 8ccb8623-c3ba-40bb-b00f-0be7b1c290de of volume 225b299e-fe3e-4903-821a-c7dc2c297238 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:23:33 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-059b644a-5602-42ab-8331-6768a5459f97 tempest-SnapshotsActionsTest-439353654 None] snapshot_file for this snap is: volume-225b299e-fe3e-4903-821a-c7dc2c297238.8ccb8623-c3ba-40bb-b00f-0be7b1c290de {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:23:33 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad0fc4e-db35-40fb-9731-dbea46352184]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-059b644a-5602-42ab-8331-6768a5459f97 tempest-SnapshotsActionsTest-439353654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.8ccb8623-c3ba-40bb-b00f-0be7b1c290de {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:33 devstack sudo[92730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.8ccb8623-c3ba-40bb-b00f-0be7b1c290de Jul 07 17:23:33 devstack sudo[92730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:34 devstack sudo[92730]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-059b644a-5602-42ab-8331-6768a5459f97 tempest-SnapshotsActionsTest-439353654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.8ccb8623-c3ba-40bb-b00f-0be7b1c290de" returned: 0 in 0.851s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:34 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-059b644a-5602-42ab-8331-6768a5459f97 tempest-SnapshotsActionsTest-439353654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-225b299e-fe3e-4903-821a-c7dc2c297238(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:23:34 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3871b21-5302-4d57-a89e-839c08233625]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-059b644a-5602-42ab-8331-6768a5459f97 tempest-SnapshotsActionsTest-439353654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:34 devstack sudo[93136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa Jul 07 17:23:34 devstack sudo[93136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:35 devstack sudo[93136]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-059b644a-5602-42ab-8331-6768a5459f97 tempest-SnapshotsActionsTest-439353654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa" returned: 0 in 0.999s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:35 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-059b644a-5602-42ab-8331-6768a5459f97 tempest-SnapshotsActionsTest-439353654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-225b299e-fe3e-4903-821a-c7dc2c297238(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:23:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-059b644a-5602-42ab-8331-6768a5459f97 tempest-SnapshotsActionsTest-439353654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.8ccb8623-c3ba-40bb-b00f-0be7b1c290de {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:35 devstack sudo[93158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.8ccb8623-c3ba-40bb-b00f-0be7b1c290de Jul 07 17:23:35 devstack sudo[93158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:36 devstack sudo[93158]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-059b644a-5602-42ab-8331-6768a5459f97 tempest-SnapshotsActionsTest-439353654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.8ccb8623-c3ba-40bb-b00f-0be7b1c290de" returned: 0 in 1.011s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-059b644a-5602-42ab-8331-6768a5459f97 tempest-SnapshotsActionsTest-439353654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.8ccb8623-c3ba-40bb-b00f-0be7b1c290de {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:36 devstack sudo[93168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.8ccb8623-c3ba-40bb-b00f-0be7b1c290de Jul 07 17:23:36 devstack sudo[93168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:37 devstack sudo[93168]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-059b644a-5602-42ab-8331-6768a5459f97 tempest-SnapshotsActionsTest-439353654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.8ccb8623-c3ba-40bb-b00f-0be7b1c290de" returned: 0 in 1.083s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:37 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-059b644a-5602-42ab-8331-6768a5459f97 tempest-SnapshotsActionsTest-439353654 None] Lock "cinder-quobyte-8ccb8623-c3ba-40bb-b00f-0be7b1c290de" released by "_delete_snapshot" :: held 4.112s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:37 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-059b644a-5602-42ab-8331-6768a5459f97 tempest-SnapshotsActionsTest-439353654 None] Lock "cinder-quobyte-225b299e-fe3e-4903-821a-c7dc2c297238" released by "delete_snapshot" :: held 4.148s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:37 devstack cinder-volume[87233]: WARNING cinder.quota [None req-059b644a-5602-42ab-8331-6768a5459f97 tempest-SnapshotsActionsTest-439353654 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:23:37 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-059b644a-5602-42ab-8331-6768a5459f97 tempest-SnapshotsActionsTest-439353654 None] Created reservations ['d26e8597-576c-44d9-bdf2-30b4ae17b36b', 'fa1eba45-649b-4f58-98a3-ee505384f754', '8d77ceae-245a-426c-a0be-f8a5cca1f3ef', '4c242349-72f9-45db-b4db-8aae0e32a763'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:23:37 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-059b644a-5602-42ab-8331-6768a5459f97 tempest-SnapshotsActionsTest-439353654 None] Delete snapshot completed successfully. Jul 07 17:23:37 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-059b644a-5602-42ab-8331-6768a5459f97 tempest-SnapshotsActionsTest-439353654 None] Lock "cinder-8ccb8623-c3ba-40bb-b00f-0be7b1c290de-delete_snapshot" released by "delete_snapshot" :: held 4.467s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:38 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-1db1ca0a-1d4f-4a83-bab1-da8b68dcc1e1 tempest-VolumesActionsTest-30875521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:23:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-1db1ca0a-1d4f-4a83-bab1-da8b68dcc1e1 tempest-VolumesActionsTest-30875521 None] Flow 'volume_create_manager' (15366dab-2289-4ab4-afc1-f7e4386f95ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:23:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-1db1ca0a-1d4f-4a83-bab1-da8b68dcc1e1 tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d52fc2a-3794-4951-b6bd-b0fe56920b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-1db1ca0a-1d4f-4a83-bab1-da8b68dcc1e1 tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d52fc2a-3794-4951-b6bd-b0fe56920b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1371829967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=594ca357-d52f-407c-8a84-d36f45fb2536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f6d3d3242cc4a0985413eb44decf459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:23:38Z,use_quota=True,user_id='3ad1ec1148104bd3b691c7bc15118fd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-1db1ca0a-1d4f-4a83-bab1-da8b68dcc1e1 tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (356998c7-e2ec-4206-9611-05b56d38b2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-1db1ca0a-1d4f-4a83-bab1-da8b68dcc1e1 tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (356998c7-e2ec-4206-9611-05b56d38b2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-1db1ca0a-1d4f-4a83-bab1-da8b68dcc1e1 tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30a2cd47-abea-43a3-bd7a-0b6d45ea0166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-1db1ca0a-1d4f-4a83-bab1-da8b68dcc1e1 tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30a2cd47-abea-43a3-bd7a-0b6d45ea0166) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '594ca357-d52f-407c-8a84-d36f45fb2536', 'volume_name': 'volume-594ca357-d52f-407c-8a84-d36f45fb2536', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-1db1ca0a-1d4f-4a83-bab1-da8b68dcc1e1 tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db668840-b87c-4a27-87bb-e9526d8e14e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-1db1ca0a-1d4f-4a83-bab1-da8b68dcc1e1 tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db668840-b87c-4a27-87bb-e9526d8e14e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-1db1ca0a-1d4f-4a83-bab1-da8b68dcc1e1 tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (794cdfc8-2d91-4766-be81-d57bad813646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:38 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-1db1ca0a-1d4f-4a83-bab1-da8b68dcc1e1 tempest-VolumesActionsTest-30875521 None] Volume 594ca357-d52f-407c-8a84-d36f45fb2536: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-594ca357-d52f-407c-8a84-d36f45fb2536', 'volume_size': 1} Jul 07 17:23:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1db1ca0a-1d4f-4a83-bab1-da8b68dcc1e1 tempest-VolumesActionsTest-30875521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1db1ca0a-1d4f-4a83-bab1-da8b68dcc1e1 tempest-VolumesActionsTest-30875521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:38 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-1db1ca0a-1d4f-4a83-bab1-da8b68dcc1e1 tempest-VolumesActionsTest-30875521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1371829967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=594ca357-d52f-407c-8a84-d36f45fb2536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f6d3d3242cc4a0985413eb44decf459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:23:38Z,use_quota=True,user_id='3ad1ec1148104bd3b691c7bc15118fd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:23:38 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-1db1ca0a-1d4f-4a83-bab1-da8b68dcc1e1 tempest-VolumesActionsTest-30875521 None] Creating volume 594ca357-d52f-407c-8a84-d36f45fb2536 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:23:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1db1ca0a-1d4f-4a83-bab1-da8b68dcc1e1 tempest-VolumesActionsTest-30875521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1db1ca0a-1d4f-4a83-bab1-da8b68dcc1e1 tempest-VolumesActionsTest-30875521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:38 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-1db1ca0a-1d4f-4a83-bab1-da8b68dcc1e1 tempest-VolumesActionsTest-30875521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:23:38 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-1db1ca0a-1d4f-4a83-bab1-da8b68dcc1e1 tempest-VolumesActionsTest-30875521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:23:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1db1ca0a-1d4f-4a83-bab1-da8b68dcc1e1 tempest-VolumesActionsTest-30875521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:38 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-1db1ca0a-1d4f-4a83-bab1-da8b68dcc1e1 tempest-VolumesActionsTest-30875521 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:23:38 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-1db1ca0a-1d4f-4a83-bab1-da8b68dcc1e1 tempest-VolumesActionsTest-30875521 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:23:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1db1ca0a-1d4f-4a83-bab1-da8b68dcc1e1 tempest-VolumesActionsTest-30875521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-594ca357-d52f-407c-8a84-d36f45fb2536 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:38 devstack sudo[93188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-594ca357-d52f-407c-8a84-d36f45fb2536 1073741824 Jul 07 17:23:38 devstack sudo[93188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ddb4cf7f-b5f1-4a0f-8dda-9ad622512123 tempest-SnapshotsActionsTest-1129268036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:39 devstack sudo[93188]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1db1ca0a-1d4f-4a83-bab1-da8b68dcc1e1 tempest-VolumesActionsTest-30875521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-594ca357-d52f-407c-8a84-d36f45fb2536 1073741824" returned: 0 in 1.336s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1db1ca0a-1d4f-4a83-bab1-da8b68dcc1e1 tempest-VolumesActionsTest-30875521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-594ca357-d52f-407c-8a84-d36f45fb2536 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:39 devstack sudo[93198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-594ca357-d52f-407c-8a84-d36f45fb2536 Jul 07 17:23:39 devstack sudo[93198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:40 devstack sudo[93198]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1db1ca0a-1d4f-4a83-bab1-da8b68dcc1e1 tempest-VolumesActionsTest-30875521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-594ca357-d52f-407c-8a84-d36f45fb2536" returned: 0 in 0.699s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:40 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-1db1ca0a-1d4f-4a83-bab1-da8b68dcc1e1 tempest-VolumesActionsTest-30875521 None] <== create_volume: return (2085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:23:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1db1ca0a-1d4f-4a83-bab1-da8b68dcc1e1 tempest-VolumesActionsTest-30875521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.089s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ddb4cf7f-b5f1-4a0f-8dda-9ad622512123 tempest-SnapshotsActionsTest-1129268036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.393s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:40 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-ddb4cf7f-b5f1-4a0f-8dda-9ad622512123 tempest-SnapshotsActionsTest-1129268036 None] Creating offline snapshot 65712be7-3fc9-402a-a4ae-af203f55ad50 of volume 225b299e-fe3e-4903-821a-c7dc2c297238 {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:23:40 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-1db1ca0a-1d4f-4a83-bab1-da8b68dcc1e1 tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (794cdfc8-2d91-4766-be81-d57bad813646) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-594ca357-d52f-407c-8a84-d36f45fb2536', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:40 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-1db1ca0a-1d4f-4a83-bab1-da8b68dcc1e1 tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbe1134d-cf11-411f-a0da-5ade48dda3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:40 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d8c2dd-f2b7-4a6f-938c-3e62f695e125]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ddb4cf7f-b5f1-4a0f-8dda-9ad622512123 tempest-SnapshotsActionsTest-1129268036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:40 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-1db1ca0a-1d4f-4a83-bab1-da8b68dcc1e1 tempest-VolumesActionsTest-30875521 None] Volume volume-594ca357-d52f-407c-8a84-d36f45fb2536 (594ca357-d52f-407c-8a84-d36f45fb2536): created successfully Jul 07 17:23:40 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-1db1ca0a-1d4f-4a83-bab1-da8b68dcc1e1 tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbe1134d-cf11-411f-a0da-5ade48dda3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:40 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-1db1ca0a-1d4f-4a83-bab1-da8b68dcc1e1 tempest-VolumesActionsTest-30875521 None] Flow 'volume_create_manager' (15366dab-2289-4ab4-afc1-f7e4386f95ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:23:40 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-1db1ca0a-1d4f-4a83-bab1-da8b68dcc1e1 tempest-VolumesActionsTest-30875521 None] Created volume successfully. Jul 07 17:23:40 devstack sudo[93202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa Jul 07 17:23:40 devstack sudo[93202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:41 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-7628385d-979f-4620-af04-10a86757dd94 tempest-VolumesActionsTest-30875521 None] Acquiring lock "cinder-594ca357-d52f-407c-8a84-d36f45fb2536" by "attach_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:41 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-7628385d-979f-4620-af04-10a86757dd94 tempest-VolumesActionsTest-30875521 None] Lock "cinder-594ca357-d52f-407c-8a84-d36f45fb2536" acquired by "attach_volume" :: waited 0.021s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:41 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-7628385d-979f-4620-af04-10a86757dd94 tempest-VolumesActionsTest-30875521 None] Attaching volume 594ca357-d52f-407c-8a84-d36f45fb2536 to instance 357b9146-73f3-4e1e-82fd-9062830dd820 at mountpoint /dev/vdb on host None. Jul 07 17:23:41 devstack sudo[93202]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ddb4cf7f-b5f1-4a0f-8dda-9ad622512123 tempest-SnapshotsActionsTest-1129268036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa" returned: 0 in 0.961s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:41 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-ddb4cf7f-b5f1-4a0f-8dda-9ad622512123 tempest-SnapshotsActionsTest-1129268036 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-225b299e-fe3e-4903-821a-c7dc2c297238(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:23:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ddb4cf7f-b5f1-4a0f-8dda-9ad622512123 tempest-SnapshotsActionsTest-1129268036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.65712be7-3fc9-402a-a4ae-af203f55ad50 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:41 devstack sudo[93213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.65712be7-3fc9-402a-a4ae-af203f55ad50 1G Jul 07 17:23:41 devstack sudo[93213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:41 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-7628385d-979f-4620-af04-10a86757dd94 tempest-VolumesActionsTest-30875521 None] Attach volume completed successfully. Jul 07 17:23:41 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-7628385d-979f-4620-af04-10a86757dd94 tempest-VolumesActionsTest-30875521 None] Lock "cinder-594ca357-d52f-407c-8a84-d36f45fb2536" released by "attach_volume" :: held 0.179s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:41 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-ac43c760-f554-4d0a-820d-f89031a76bfa req-c7795df4-ba24-4f93-8c81-edb1f9c7afd5 tempest-ServerActionsTestOtherA-1544739102 None] Terminate volume connection completed successfully. Jul 07 17:23:41 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-ac43c760-f554-4d0a-820d-f89031a76bfa req-c7795df4-ba24-4f93-8c81-edb1f9c7afd5 tempest-ServerActionsTestOtherA-1544739102 None] Deleting attachment 896e0663-99f5-41ff-b32f-52d2d9ce1cdd. {{(pid=87233) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:23:42 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-af9f4fd8-6d38-4c80-9fef-457ffa7fa611 tempest-VolumesActionsTest-1324430718 None] Terminate volume connection completed successfully. Jul 07 17:23:42 devstack sudo[93213]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ddb4cf7f-b5f1-4a0f-8dda-9ad622512123 tempest-SnapshotsActionsTest-1129268036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.65712be7-3fc9-402a-a4ae-af203f55ad50 1G" returned: 0 in 1.108s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ddb4cf7f-b5f1-4a0f-8dda-9ad622512123 tempest-SnapshotsActionsTest-1129268036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.65712be7-3fc9-402a-a4ae-af203f55ad50 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:42 devstack sudo[93245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.65712be7-3fc9-402a-a4ae-af203f55ad50 Jul 07 17:23:42 devstack sudo[93245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:43 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-af9f4fd8-6d38-4c80-9fef-457ffa7fa611 tempest-VolumesActionsTest-1324430718 None] Acquiring lock "cinder-594ca357-d52f-407c-8a84-d36f45fb2536-detach_volume" by "detach_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:43 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-af9f4fd8-6d38-4c80-9fef-457ffa7fa611 tempest-VolumesActionsTest-1324430718 None] Lock "cinder-594ca357-d52f-407c-8a84-d36f45fb2536-detach_volume" acquired by "detach_volume" :: waited 0.056s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:43 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-af9f4fd8-6d38-4c80-9fef-457ffa7fa611 tempest-VolumesActionsTest-1324430718 None] Detaching volume 594ca357-d52f-407c-8a84-d36f45fb2536 from instance 357b9146-73f3-4e1e-82fd-9062830dd820. Jul 07 17:23:43 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-af9f4fd8-6d38-4c80-9fef-457ffa7fa611 tempest-VolumesActionsTest-1324430718 None] Detach volume completed successfully. Jul 07 17:23:43 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-af9f4fd8-6d38-4c80-9fef-457ffa7fa611 tempest-VolumesActionsTest-1324430718 None] Lock "cinder-594ca357-d52f-407c-8a84-d36f45fb2536-detach_volume" released by "detach_volume" :: held 0.164s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:43 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:23:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:23:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:23:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:43 devstack sudo[93265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:23:43 devstack sudo[93265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:44 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-66820f07-bfcf-45c6-9853-443c832295e4 tempest-VolumesActionsTest-30875521 None] Acquiring lock "cinder-594ca357-d52f-407c-8a84-d36f45fb2536-detach_volume" by "detach_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:44 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-66820f07-bfcf-45c6-9853-443c832295e4 tempest-VolumesActionsTest-30875521 None] Lock "cinder-594ca357-d52f-407c-8a84-d36f45fb2536-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:44 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-66820f07-bfcf-45c6-9853-443c832295e4 tempest-VolumesActionsTest-30875521 None] Volume detach called, but volume not attached. Jul 07 17:23:44 devstack sudo[93245]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ddb4cf7f-b5f1-4a0f-8dda-9ad622512123 tempest-SnapshotsActionsTest-1129268036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.65712be7-3fc9-402a-a4ae-af203f55ad50" returned: 0 in 1.398s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:44 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-ddb4cf7f-b5f1-4a0f-8dda-9ad622512123 tempest-SnapshotsActionsTest-1129268036 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.65712be7-3fc9-402a-a4ae-af203f55ad50 is being set with open permissions: ugo+rw Jul 07 17:23:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ddb4cf7f-b5f1-4a0f-8dda-9ad622512123 tempest-SnapshotsActionsTest-1129268036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.65712be7-3fc9-402a-a4ae-af203f55ad50 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:44 devstack sudo[93273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.65712be7-3fc9-402a-a4ae-af203f55ad50 Jul 07 17:23:44 devstack sudo[93273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:44 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-66820f07-bfcf-45c6-9853-443c832295e4 tempest-VolumesActionsTest-30875521 None] Lock "cinder-594ca357-d52f-407c-8a84-d36f45fb2536-detach_volume" released by "detach_volume" :: held 0.056s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:44 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-36b6d110-a83f-4313-8f8e-8a50b1015a0b tempest-VolumesActionsTest-30875521 None] Acquiring lock "cinder-594ca357-d52f-407c-8a84-d36f45fb2536-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-ac43c760-f554-4d0a-820d-f89031a76bfa req-a48c24eb-c20e-44d4-9b4c-3501c1f4d658 tempest-ServerActionsTestOtherA-1544739102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:45 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-36b6d110-a83f-4313-8f8e-8a50b1015a0b tempest-VolumesActionsTest-30875521 None] Lock "cinder-594ca357-d52f-407c-8a84-d36f45fb2536-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:45 devstack sudo[93265]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 1.734s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:45 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:23:45 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-36b6d110-a83f-4313-8f8e-8a50b1015a0b tempest-VolumesActionsTest-30875521 None] Acquiring lock "cinder-quobyte-594ca357-d52f-407c-8a84-d36f45fb2536" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:45 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:23:45 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread count: 8 {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:23:45 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread info: [<_MainThread(MainThread, started 126077716062336)>, , , , , , , ] {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:23:45 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-36b6d110-a83f-4313-8f8e-8a50b1015a0b tempest-VolumesActionsTest-30875521 None] Lock "cinder-quobyte-594ca357-d52f-407c-8a84-d36f45fb2536" acquired by "delete_volume" :: waited 0.027s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:45 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7914c56c-bbda-4230-a08c-171888240598]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-36b6d110-a83f-4313-8f8e-8a50b1015a0b tempest-VolumesActionsTest-30875521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-594ca357-d52f-407c-8a84-d36f45fb2536 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:45 devstack sudo[93287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-594ca357-d52f-407c-8a84-d36f45fb2536 Jul 07 17:23:45 devstack sudo[93287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:45 devstack sudo[93273]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ddb4cf7f-b5f1-4a0f-8dda-9ad622512123 tempest-SnapshotsActionsTest-1129268036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.65712be7-3fc9-402a-a4ae-af203f55ad50" returned: 0 in 1.393s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ddb4cf7f-b5f1-4a0f-8dda-9ad622512123 tempest-SnapshotsActionsTest-1129268036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.078s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-ac43c760-f554-4d0a-820d-f89031a76bfa req-a48c24eb-c20e-44d4-9b4c-3501c1f4d658 tempest-ServerActionsTestOtherA-1544739102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.608s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:45 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac7fc7b-501e-4c5b-a8fb-befb4737d52f]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-ac43c760-f554-4d0a-820d-f89031a76bfa req-a48c24eb-c20e-44d4-9b4c-3501c1f4d658 tempest-ServerActionsTestOtherA-1544739102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c917cef4-2e9d-49b0-b74a-c67d8ddf006d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:45 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-f47131b6-4eed-4914-be5b-2cf1a9637cc0 tempest-AttachVolumeTestJSON-841000093 None] Acquiring lock "cinder-60d91305-1e71-4035-9197-acd3d6c65087-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:45 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-ddb4cf7f-b5f1-4a0f-8dda-9ad622512123 tempest-SnapshotsActionsTest-1129268036 None] Create snapshot completed successfully Jul 07 17:23:45 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-f47131b6-4eed-4914-be5b-2cf1a9637cc0 tempest-AttachVolumeTestJSON-841000093 None] Lock "cinder-60d91305-1e71-4035-9197-acd3d6c65087-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:45 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-f47131b6-4eed-4914-be5b-2cf1a9637cc0 tempest-AttachVolumeTestJSON-841000093 None] Acquiring lock "cinder-quobyte-60d91305-1e71-4035-9197-acd3d6c65087" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:45 devstack sudo[93292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c917cef4-2e9d-49b0-b74a-c67d8ddf006d Jul 07 17:23:45 devstack sudo[93292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:45 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-f47131b6-4eed-4914-be5b-2cf1a9637cc0 tempest-AttachVolumeTestJSON-841000093 None] Lock "cinder-quobyte-60d91305-1e71-4035-9197-acd3d6c65087" acquired by "delete_volume" :: waited 0.034s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:45 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb9f581-b503-4f3a-b917-a22d169122d9]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f47131b6-4eed-4914-be5b-2cf1a9637cc0 tempest-AttachVolumeTestJSON-841000093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-60d91305-1e71-4035-9197-acd3d6c65087 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:46 devstack sudo[93295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-60d91305-1e71-4035-9197-acd3d6c65087 Jul 07 17:23:46 devstack sudo[93295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:46 devstack sudo[93287]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-36b6d110-a83f-4313-8f8e-8a50b1015a0b tempest-VolumesActionsTest-30875521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-594ca357-d52f-407c-8a84-d36f45fb2536" returned: 0 in 1.359s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-36b6d110-a83f-4313-8f8e-8a50b1015a0b tempest-VolumesActionsTest-30875521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-594ca357-d52f-407c-8a84-d36f45fb2536 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:46 devstack sudo[93310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-594ca357-d52f-407c-8a84-d36f45fb2536 Jul 07 17:23:46 devstack sudo[93310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:46 devstack sudo[93292]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-ac43c760-f554-4d0a-820d-f89031a76bfa req-a48c24eb-c20e-44d4-9b4c-3501c1f4d658 tempest-ServerActionsTestOtherA-1544739102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c917cef4-2e9d-49b0-b74a-c67d8ddf006d" returned: 0 in 1.228s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-ac43c760-f554-4d0a-820d-f89031a76bfa req-a48c24eb-c20e-44d4-9b4c-3501c1f4d658 tempest-ServerActionsTestOtherA-1544739102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.270s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:46 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-ac43c760-f554-4d0a-820d-f89031a76bfa req-a48c24eb-c20e-44d4-9b4c-3501c1f4d658 tempest-ServerActionsTestOtherA-1544739102 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7', 'name': 'volume-c917cef4-2e9d-49b0-b74a-c67d8ddf006d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '168efdf0-bd7d-4c82-8eef-607fba30f077', 'enforce_multipath': True} {{(pid=87233) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:23:47 devstack sudo[93295]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f47131b6-4eed-4914-be5b-2cf1a9637cc0 tempest-AttachVolumeTestJSON-841000093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-60d91305-1e71-4035-9197-acd3d6c65087" returned: 0 in 1.171s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f47131b6-4eed-4914-be5b-2cf1a9637cc0 tempest-AttachVolumeTestJSON-841000093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-60d91305-1e71-4035-9197-acd3d6c65087 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:47 devstack sudo[93318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-60d91305-1e71-4035-9197-acd3d6c65087 Jul 07 17:23:47 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5ae5f410-9de7-485f-bd13-d41848333413 tempest-SnapshotsActionsTest-439353654 None] Acquiring lock "cinder-65712be7-3fc9-402a-a4ae-af203f55ad50-delete_snapshot" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:47 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-ac43c760-f554-4d0a-820d-f89031a76bfa req-a48c24eb-c20e-44d4-9b4c-3501c1f4d658 tempest-ServerActionsTestOtherA-1544739102 None] attachment_update completed successfully. Jul 07 17:23:47 devstack sudo[93318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:47 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5ae5f410-9de7-485f-bd13-d41848333413 tempest-SnapshotsActionsTest-439353654 None] Lock "cinder-65712be7-3fc9-402a-a4ae-af203f55ad50-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:47 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5ae5f410-9de7-485f-bd13-d41848333413 tempest-SnapshotsActionsTest-439353654 None] Acquiring lock "cinder-quobyte-225b299e-fe3e-4903-821a-c7dc2c297238" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:47 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5ae5f410-9de7-485f-bd13-d41848333413 tempest-SnapshotsActionsTest-439353654 None] Lock "cinder-quobyte-225b299e-fe3e-4903-821a-c7dc2c297238" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:47 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5ae5f410-9de7-485f-bd13-d41848333413 tempest-SnapshotsActionsTest-439353654 None] Acquiring lock "cinder-quobyte-65712be7-3fc9-402a-a4ae-af203f55ad50" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:47 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5ae5f410-9de7-485f-bd13-d41848333413 tempest-SnapshotsActionsTest-439353654 None] Lock "cinder-quobyte-65712be7-3fc9-402a-a4ae-af203f55ad50" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:47 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-5ae5f410-9de7-485f-bd13-d41848333413 tempest-SnapshotsActionsTest-439353654 None] Deleting offline snapshot 65712be7-3fc9-402a-a4ae-af203f55ad50 of volume 225b299e-fe3e-4903-821a-c7dc2c297238 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:23:47 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-5ae5f410-9de7-485f-bd13-d41848333413 tempest-SnapshotsActionsTest-439353654 None] snapshot_file for this snap is: volume-225b299e-fe3e-4903-821a-c7dc2c297238.65712be7-3fc9-402a-a4ae-af203f55ad50 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:23:47 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[df521399-99cd-41b2-afc6-ab5f63d8c56f]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5ae5f410-9de7-485f-bd13-d41848333413 tempest-SnapshotsActionsTest-439353654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.65712be7-3fc9-402a-a4ae-af203f55ad50 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:47 devstack sudo[93320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.65712be7-3fc9-402a-a4ae-af203f55ad50 Jul 07 17:23:47 devstack sudo[93320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:47 devstack sudo[93310]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-36b6d110-a83f-4313-8f8e-8a50b1015a0b tempest-VolumesActionsTest-30875521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-594ca357-d52f-407c-8a84-d36f45fb2536" returned: 0 in 1.185s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:47 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-36b6d110-a83f-4313-8f8e-8a50b1015a0b tempest-VolumesActionsTest-30875521 None] Lock "cinder-quobyte-594ca357-d52f-407c-8a84-d36f45fb2536" released by "delete_volume" :: held 2.602s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:47 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-36b6d110-a83f-4313-8f8e-8a50b1015a0b tempest-VolumesActionsTest-30875521 None] Created reservations ['f5709c73-3fbb-4369-9dca-8b7049c32649', '900ee719-68a7-4971-ad54-1f2b764260cb', '44d485c0-5f2e-4530-a746-a461fa44e419', '1e3d1613-104e-4137-80a9-e8115754c7d5'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:23:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-36b6d110-a83f-4313-8f8e-8a50b1015a0b tempest-VolumesActionsTest-30875521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-36b6d110-a83f-4313-8f8e-8a50b1015a0b tempest-VolumesActionsTest-30875521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:47 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-36b6d110-a83f-4313-8f8e-8a50b1015a0b tempest-VolumesActionsTest-30875521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:23:47 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-36b6d110-a83f-4313-8f8e-8a50b1015a0b tempest-VolumesActionsTest-30875521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:23:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-36b6d110-a83f-4313-8f8e-8a50b1015a0b tempest-VolumesActionsTest-30875521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-36b6d110-a83f-4313-8f8e-8a50b1015a0b tempest-VolumesActionsTest-30875521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:47 devstack sudo[93344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:23:47 devstack sudo[93344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:48 devstack sudo[93318]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f47131b6-4eed-4914-be5b-2cf1a9637cc0 tempest-AttachVolumeTestJSON-841000093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-60d91305-1e71-4035-9197-acd3d6c65087" returned: 0 in 0.976s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:48 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-f47131b6-4eed-4914-be5b-2cf1a9637cc0 tempest-AttachVolumeTestJSON-841000093 None] Lock "cinder-quobyte-60d91305-1e71-4035-9197-acd3d6c65087" released by "delete_volume" :: held 2.229s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:48 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-f47131b6-4eed-4914-be5b-2cf1a9637cc0 tempest-AttachVolumeTestJSON-841000093 None] Created reservations ['56c4dd99-8e75-4e06-9392-b0317ca2dc27', '6e5cc344-bf9c-4600-8e69-43f47128ed89', '90369045-504e-40f8-b098-fb23286e3b4f', '2c5c4a87-a0ef-483d-8b89-3fe08b207226'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:23:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f47131b6-4eed-4914-be5b-2cf1a9637cc0 tempest-AttachVolumeTestJSON-841000093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f47131b6-4eed-4914-be5b-2cf1a9637cc0 tempest-AttachVolumeTestJSON-841000093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:48 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-f47131b6-4eed-4914-be5b-2cf1a9637cc0 tempest-AttachVolumeTestJSON-841000093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:23:48 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-f47131b6-4eed-4914-be5b-2cf1a9637cc0 tempest-AttachVolumeTestJSON-841000093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:23:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f47131b6-4eed-4914-be5b-2cf1a9637cc0 tempest-AttachVolumeTestJSON-841000093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f47131b6-4eed-4914-be5b-2cf1a9637cc0 tempest-AttachVolumeTestJSON-841000093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:48 devstack sudo[93349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:23:48 devstack sudo[93349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:48 devstack sudo[93320]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5ae5f410-9de7-485f-bd13-d41848333413 tempest-SnapshotsActionsTest-439353654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.65712be7-3fc9-402a-a4ae-af203f55ad50" returned: 0 in 1.075s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:48 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-5ae5f410-9de7-485f-bd13-d41848333413 tempest-SnapshotsActionsTest-439353654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-225b299e-fe3e-4903-821a-c7dc2c297238(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:23:48 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34b40f5-78a0-489c-8940-22f4ec07eb53]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5ae5f410-9de7-485f-bd13-d41848333413 tempest-SnapshotsActionsTest-439353654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:48 devstack sudo[93351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa Jul 07 17:23:48 devstack sudo[93351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:48 devstack sudo[93344]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-36b6d110-a83f-4313-8f8e-8a50b1015a0b tempest-VolumesActionsTest-30875521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.976s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:48 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-36b6d110-a83f-4313-8f8e-8a50b1015a0b tempest-VolumesActionsTest-30875521 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:23:48 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-36b6d110-a83f-4313-8f8e-8a50b1015a0b tempest-VolumesActionsTest-30875521 None] Deleted volume successfully. Jul 07 17:23:48 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-36b6d110-a83f-4313-8f8e-8a50b1015a0b tempest-VolumesActionsTest-30875521 None] Lock "cinder-594ca357-d52f-407c-8a84-d36f45fb2536-delete_volume" released by "delete_volume" :: held 3.935s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:49 devstack sudo[93349]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f47131b6-4eed-4914-be5b-2cf1a9637cc0 tempest-AttachVolumeTestJSON-841000093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.861s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:49 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-f47131b6-4eed-4914-be5b-2cf1a9637cc0 tempest-AttachVolumeTestJSON-841000093 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:23:49 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-f47131b6-4eed-4914-be5b-2cf1a9637cc0 tempest-AttachVolumeTestJSON-841000093 None] Deleted volume successfully. Jul 07 17:23:49 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-f47131b6-4eed-4914-be5b-2cf1a9637cc0 tempest-AttachVolumeTestJSON-841000093 None] Lock "cinder-60d91305-1e71-4035-9197-acd3d6c65087-delete_volume" released by "delete_volume" :: held 3.397s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:49 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-794c3658-c4f4-4c5a-a68e-bb7643e7708c tempest-AttachVolumeTestJSON-841000093 None] Acquiring lock "cinder-f410302d-27df-4225-9875-45a67313cd47-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:49 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-794c3658-c4f4-4c5a-a68e-bb7643e7708c tempest-AttachVolumeTestJSON-841000093 None] Lock "cinder-f410302d-27df-4225-9875-45a67313cd47-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:49 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-794c3658-c4f4-4c5a-a68e-bb7643e7708c tempest-AttachVolumeTestJSON-841000093 None] Acquiring lock "cinder-quobyte-f410302d-27df-4225-9875-45a67313cd47" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:49 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-794c3658-c4f4-4c5a-a68e-bb7643e7708c tempest-AttachVolumeTestJSON-841000093 None] Lock "cinder-quobyte-f410302d-27df-4225-9875-45a67313cd47" acquired by "delete_volume" :: waited 0.023s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:49 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[db52a288-ad92-4cac-ad81-9810d4cac03f]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-794c3658-c4f4-4c5a-a68e-bb7643e7708c tempest-AttachVolumeTestJSON-841000093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f410302d-27df-4225-9875-45a67313cd47 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:49 devstack sudo[93351]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5ae5f410-9de7-485f-bd13-d41848333413 tempest-SnapshotsActionsTest-439353654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa" returned: 0 in 0.976s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:49 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-5ae5f410-9de7-485f-bd13-d41848333413 tempest-SnapshotsActionsTest-439353654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-225b299e-fe3e-4903-821a-c7dc2c297238(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:23:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5ae5f410-9de7-485f-bd13-d41848333413 tempest-SnapshotsActionsTest-439353654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.65712be7-3fc9-402a-a4ae-af203f55ad50 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:49 devstack sudo[93364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.65712be7-3fc9-402a-a4ae-af203f55ad50 Jul 07 17:23:49 devstack sudo[93364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:49 devstack sudo[93362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f410302d-27df-4225-9875-45a67313cd47 Jul 07 17:23:49 devstack sudo[93362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:50 devstack sudo[93362]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-794c3658-c4f4-4c5a-a68e-bb7643e7708c tempest-AttachVolumeTestJSON-841000093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f410302d-27df-4225-9875-45a67313cd47" returned: 0 in 0.803s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-794c3658-c4f4-4c5a-a68e-bb7643e7708c tempest-AttachVolumeTestJSON-841000093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f410302d-27df-4225-9875-45a67313cd47 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:50 devstack sudo[93392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f410302d-27df-4225-9875-45a67313cd47 Jul 07 17:23:50 devstack sudo[93392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:50 devstack sudo[93364]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5ae5f410-9de7-485f-bd13-d41848333413 tempest-SnapshotsActionsTest-439353654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.65712be7-3fc9-402a-a4ae-af203f55ad50" returned: 0 in 0.816s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5ae5f410-9de7-485f-bd13-d41848333413 tempest-SnapshotsActionsTest-439353654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.65712be7-3fc9-402a-a4ae-af203f55ad50 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:50 devstack sudo[93394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.65712be7-3fc9-402a-a4ae-af203f55ad50 Jul 07 17:23:50 devstack sudo[93394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:50 devstack sudo[93392]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-794c3658-c4f4-4c5a-a68e-bb7643e7708c tempest-AttachVolumeTestJSON-841000093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f410302d-27df-4225-9875-45a67313cd47" returned: 0 in 0.856s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:50 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-794c3658-c4f4-4c5a-a68e-bb7643e7708c tempest-AttachVolumeTestJSON-841000093 None] Lock "cinder-quobyte-f410302d-27df-4225-9875-45a67313cd47" released by "delete_volume" :: held 1.711s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:50 devstack sudo[93394]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5ae5f410-9de7-485f-bd13-d41848333413 tempest-SnapshotsActionsTest-439353654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.65712be7-3fc9-402a-a4ae-af203f55ad50" returned: 0 in 0.830s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:50 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5ae5f410-9de7-485f-bd13-d41848333413 tempest-SnapshotsActionsTest-439353654 None] Lock "cinder-quobyte-65712be7-3fc9-402a-a4ae-af203f55ad50" released by "_delete_snapshot" :: held 3.793s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:51 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5ae5f410-9de7-485f-bd13-d41848333413 tempest-SnapshotsActionsTest-439353654 None] Lock "cinder-quobyte-225b299e-fe3e-4903-821a-c7dc2c297238" released by "delete_snapshot" :: held 3.823s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:51 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-794c3658-c4f4-4c5a-a68e-bb7643e7708c tempest-AttachVolumeTestJSON-841000093 None] Created reservations ['3011eb7f-6741-430d-a0bb-c71127dbf421', '438771ff-b591-4de5-b092-afad126e4913', '98c8dfff-45d7-4ea1-a8dc-15bb56fed33f', '254459e9-a5cb-4abd-aece-97d587fbc1b6'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:23:51 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-5ae5f410-9de7-485f-bd13-d41848333413 tempest-SnapshotsActionsTest-439353654 None] Created reservations ['e3a17721-50fe-45a3-839c-a7e50b58c084', '8f3cc475-55b1-425a-be43-9bea1c8394c3', 'ad12d3a2-3b53-40ea-b559-7832b1353c43', '67ab2e52-27cf-4446-a1fc-b8c457cf892e'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:23:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-794c3658-c4f4-4c5a-a68e-bb7643e7708c tempest-AttachVolumeTestJSON-841000093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-794c3658-c4f4-4c5a-a68e-bb7643e7708c tempest-AttachVolumeTestJSON-841000093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:51 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-794c3658-c4f4-4c5a-a68e-bb7643e7708c tempest-AttachVolumeTestJSON-841000093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:23:51 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-794c3658-c4f4-4c5a-a68e-bb7643e7708c tempest-AttachVolumeTestJSON-841000093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:23:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-794c3658-c4f4-4c5a-a68e-bb7643e7708c tempest-AttachVolumeTestJSON-841000093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-794c3658-c4f4-4c5a-a68e-bb7643e7708c tempest-AttachVolumeTestJSON-841000093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:51 devstack sudo[93480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:23:51 devstack sudo[93480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:51 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-5ae5f410-9de7-485f-bd13-d41848333413 tempest-SnapshotsActionsTest-439353654 None] Delete snapshot completed successfully. Jul 07 17:23:51 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5ae5f410-9de7-485f-bd13-d41848333413 tempest-SnapshotsActionsTest-439353654 None] Lock "cinder-65712be7-3fc9-402a-a4ae-af203f55ad50-delete_snapshot" released by "delete_snapshot" :: held 4.139s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:51 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-1bde1eaf-452e-4584-8f35-9cbbad49fe25 tempest-AttachVolumeTestJSON-841000093 None] Acquiring lock "cinder-3cda4c26-a34f-4437-84cf-97a9d9a8177c-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:51 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-1bde1eaf-452e-4584-8f35-9cbbad49fe25 tempest-AttachVolumeTestJSON-841000093 None] Lock "cinder-3cda4c26-a34f-4437-84cf-97a9d9a8177c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:51 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-1bde1eaf-452e-4584-8f35-9cbbad49fe25 tempest-AttachVolumeTestJSON-841000093 None] Acquiring lock "cinder-quobyte-3cda4c26-a34f-4437-84cf-97a9d9a8177c" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:51 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-1bde1eaf-452e-4584-8f35-9cbbad49fe25 tempest-AttachVolumeTestJSON-841000093 None] Lock "cinder-quobyte-3cda4c26-a34f-4437-84cf-97a9d9a8177c" acquired by "delete_volume" :: waited 0.025s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:51 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[421bb298-01ac-449f-8210-334db83ddc23]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1bde1eaf-452e-4584-8f35-9cbbad49fe25 tempest-AttachVolumeTestJSON-841000093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3cda4c26-a34f-4437-84cf-97a9d9a8177c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4836fa65-4b2e-4c1c-9935-f28e84e701c4 tempest-SnapshotsActionsTest-1129268036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4836fa65-4b2e-4c1c-9935-f28e84e701c4 tempest-SnapshotsActionsTest-1129268036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:52 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-4836fa65-4b2e-4c1c-9935-f28e84e701c4 tempest-SnapshotsActionsTest-1129268036 None] Creating offline snapshot 8caed149-3a91-459e-9837-d4158fbd345b of volume 225b299e-fe3e-4903-821a-c7dc2c297238 {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:23:52 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[493cd6fa-abcd-4c43-a561-373aae0047cb]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4836fa65-4b2e-4c1c-9935-f28e84e701c4 tempest-SnapshotsActionsTest-1129268036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:52 devstack sudo[93500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3cda4c26-a34f-4437-84cf-97a9d9a8177c Jul 07 17:23:52 devstack sudo[93500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:52 devstack sudo[93502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa Jul 07 17:23:52 devstack sudo[93502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:52 devstack sudo[93480]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-794c3658-c4f4-4c5a-a68e-bb7643e7708c tempest-AttachVolumeTestJSON-841000093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 1.397s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:52 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-794c3658-c4f4-4c5a-a68e-bb7643e7708c tempest-AttachVolumeTestJSON-841000093 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:23:52 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-794c3658-c4f4-4c5a-a68e-bb7643e7708c tempest-AttachVolumeTestJSON-841000093 None] Deleted volume successfully. Jul 07 17:23:52 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-794c3658-c4f4-4c5a-a68e-bb7643e7708c tempest-AttachVolumeTestJSON-841000093 None] Lock "cinder-f410302d-27df-4225-9875-45a67313cd47-delete_volume" released by "delete_volume" :: held 3.507s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:53 devstack sudo[93500]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1bde1eaf-452e-4584-8f35-9cbbad49fe25 tempest-AttachVolumeTestJSON-841000093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3cda4c26-a34f-4437-84cf-97a9d9a8177c" returned: 0 in 1.181s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1bde1eaf-452e-4584-8f35-9cbbad49fe25 tempest-AttachVolumeTestJSON-841000093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3cda4c26-a34f-4437-84cf-97a9d9a8177c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:53 devstack sudo[93837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3cda4c26-a34f-4437-84cf-97a9d9a8177c Jul 07 17:23:53 devstack sudo[93837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:53 devstack sudo[93502]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4836fa65-4b2e-4c1c-9935-f28e84e701c4 tempest-SnapshotsActionsTest-1129268036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa" returned: 0 in 1.122s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:53 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-4836fa65-4b2e-4c1c-9935-f28e84e701c4 tempest-SnapshotsActionsTest-1129268036 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-225b299e-fe3e-4903-821a-c7dc2c297238(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:23:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4836fa65-4b2e-4c1c-9935-f28e84e701c4 tempest-SnapshotsActionsTest-1129268036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.8caed149-3a91-459e-9837-d4158fbd345b 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:53 devstack sudo[93845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.8caed149-3a91-459e-9837-d4158fbd345b 1G Jul 07 17:23:53 devstack sudo[93845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:53 devstack sudo[93837]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1bde1eaf-452e-4584-8f35-9cbbad49fe25 tempest-AttachVolumeTestJSON-841000093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3cda4c26-a34f-4437-84cf-97a9d9a8177c" returned: 0 in 0.693s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:53 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-1bde1eaf-452e-4584-8f35-9cbbad49fe25 tempest-AttachVolumeTestJSON-841000093 None] Lock "cinder-quobyte-3cda4c26-a34f-4437-84cf-97a9d9a8177c" released by "delete_volume" :: held 1.948s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:53 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-1bde1eaf-452e-4584-8f35-9cbbad49fe25 tempest-AttachVolumeTestJSON-841000093 None] Created reservations ['ce206e90-d973-4446-8d51-0cdb1764dac2', '9c586132-7c1e-46e4-a825-0636ad9e102a', '71a89140-a71c-4f91-ae1e-d5533f1d0a55', 'e2566e6f-0e31-404e-ac71-0008c5cbeb05'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:23:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1bde1eaf-452e-4584-8f35-9cbbad49fe25 tempest-AttachVolumeTestJSON-841000093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1bde1eaf-452e-4584-8f35-9cbbad49fe25 tempest-AttachVolumeTestJSON-841000093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:54 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-1bde1eaf-452e-4584-8f35-9cbbad49fe25 tempest-AttachVolumeTestJSON-841000093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:23:54 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-1bde1eaf-452e-4584-8f35-9cbbad49fe25 tempest-AttachVolumeTestJSON-841000093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:23:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1bde1eaf-452e-4584-8f35-9cbbad49fe25 tempest-AttachVolumeTestJSON-841000093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1bde1eaf-452e-4584-8f35-9cbbad49fe25 tempest-AttachVolumeTestJSON-841000093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:54 devstack sudo[93857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:23:54 devstack sudo[93857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:54 devstack sudo[93845]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4836fa65-4b2e-4c1c-9935-f28e84e701c4 tempest-SnapshotsActionsTest-1129268036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.8caed149-3a91-459e-9837-d4158fbd345b 1G" returned: 0 in 1.137s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4836fa65-4b2e-4c1c-9935-f28e84e701c4 tempest-SnapshotsActionsTest-1129268036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.8caed149-3a91-459e-9837-d4158fbd345b {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:54 devstack sudo[93861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.8caed149-3a91-459e-9837-d4158fbd345b Jul 07 17:23:54 devstack sudo[93861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:54 devstack sudo[93857]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1bde1eaf-452e-4584-8f35-9cbbad49fe25 tempest-AttachVolumeTestJSON-841000093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.805s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:54 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-1bde1eaf-452e-4584-8f35-9cbbad49fe25 tempest-AttachVolumeTestJSON-841000093 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:23:54 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-1bde1eaf-452e-4584-8f35-9cbbad49fe25 tempest-AttachVolumeTestJSON-841000093 None] Deleted volume successfully. Jul 07 17:23:54 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-1bde1eaf-452e-4584-8f35-9cbbad49fe25 tempest-AttachVolumeTestJSON-841000093 None] Lock "cinder-3cda4c26-a34f-4437-84cf-97a9d9a8177c-delete_volume" released by "delete_volume" :: held 3.100s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:55 devstack sudo[93861]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4836fa65-4b2e-4c1c-9935-f28e84e701c4 tempest-SnapshotsActionsTest-1129268036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.8caed149-3a91-459e-9837-d4158fbd345b" returned: 0 in 0.992s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:55 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-4836fa65-4b2e-4c1c-9935-f28e84e701c4 tempest-SnapshotsActionsTest-1129268036 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.8caed149-3a91-459e-9837-d4158fbd345b is being set with open permissions: ugo+rw Jul 07 17:23:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4836fa65-4b2e-4c1c-9935-f28e84e701c4 tempest-SnapshotsActionsTest-1129268036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.8caed149-3a91-459e-9837-d4158fbd345b {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:55 devstack sudo[93867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.8caed149-3a91-459e-9837-d4158fbd345b Jul 07 17:23:55 devstack sudo[93867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:56 devstack sudo[93867]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4836fa65-4b2e-4c1c-9935-f28e84e701c4 tempest-SnapshotsActionsTest-1129268036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.8caed149-3a91-459e-9837-d4158fbd345b" returned: 0 in 0.783s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4836fa65-4b2e-4c1c-9935-f28e84e701c4 tempest-SnapshotsActionsTest-1129268036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.191s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:56 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-4836fa65-4b2e-4c1c-9935-f28e84e701c4 tempest-SnapshotsActionsTest-1129268036 None] Create snapshot completed successfully Jul 07 17:23:57 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-12687d6b-0601-4770-a97b-7af4e45c76c8 tempest-VolumesActionsTest-30875521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:23:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-12687d6b-0601-4770-a97b-7af4e45c76c8 tempest-VolumesActionsTest-30875521 None] Flow 'volume_create_manager' (6e95185a-ef5e-42d7-8104-60ff2ab29b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:23:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-12687d6b-0601-4770-a97b-7af4e45c76c8 tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5935ffe-8637-4e08-8595-09704a65198a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-12687d6b-0601-4770-a97b-7af4e45c76c8 tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5935ffe-8637-4e08-8595-09704a65198a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-50117343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2c6b950-7555-4b60-a530-1c23504f580a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f6d3d3242cc4a0985413eb44decf459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:23:57Z,use_quota=True,user_id='3ad1ec1148104bd3b691c7bc15118fd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-12687d6b-0601-4770-a97b-7af4e45c76c8 tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3daa2fbe-4de1-402f-a801-2bda067cb994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-12687d6b-0601-4770-a97b-7af4e45c76c8 tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3daa2fbe-4de1-402f-a801-2bda067cb994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-12687d6b-0601-4770-a97b-7af4e45c76c8 tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16060dbf-dad8-4289-9c4c-710e7746917d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-12687d6b-0601-4770-a97b-7af4e45c76c8 tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16060dbf-dad8-4289-9c4c-710e7746917d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2c6b950-7555-4b60-a530-1c23504f580a', 'volume_name': 'volume-f2c6b950-7555-4b60-a530-1c23504f580a', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-12687d6b-0601-4770-a97b-7af4e45c76c8 tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a13bf434-10a5-469e-98d0-706d53b5644c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-12687d6b-0601-4770-a97b-7af4e45c76c8 tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a13bf434-10a5-469e-98d0-706d53b5644c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-12687d6b-0601-4770-a97b-7af4e45c76c8 tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02b376f7-19ba-4c96-84be-74fa1a0415d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:57 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-12687d6b-0601-4770-a97b-7af4e45c76c8 tempest-VolumesActionsTest-30875521 None] Volume f2c6b950-7555-4b60-a530-1c23504f580a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2c6b950-7555-4b60-a530-1c23504f580a', 'volume_size': 1} Jul 07 17:23:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-12687d6b-0601-4770-a97b-7af4e45c76c8 tempest-VolumesActionsTest-30875521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-12687d6b-0601-4770-a97b-7af4e45c76c8 tempest-VolumesActionsTest-30875521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:57 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-12687d6b-0601-4770-a97b-7af4e45c76c8 tempest-VolumesActionsTest-30875521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-50117343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2c6b950-7555-4b60-a530-1c23504f580a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f6d3d3242cc4a0985413eb44decf459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:23:57Z,use_quota=True,user_id='3ad1ec1148104bd3b691c7bc15118fd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:23:57 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-12687d6b-0601-4770-a97b-7af4e45c76c8 tempest-VolumesActionsTest-30875521 None] Creating volume f2c6b950-7555-4b60-a530-1c23504f580a {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:23:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-12687d6b-0601-4770-a97b-7af4e45c76c8 tempest-VolumesActionsTest-30875521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-12687d6b-0601-4770-a97b-7af4e45c76c8 tempest-VolumesActionsTest-30875521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:57 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-12687d6b-0601-4770-a97b-7af4e45c76c8 tempest-VolumesActionsTest-30875521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:23:57 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-12687d6b-0601-4770-a97b-7af4e45c76c8 tempest-VolumesActionsTest-30875521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:23:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-12687d6b-0601-4770-a97b-7af4e45c76c8 tempest-VolumesActionsTest-30875521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:57 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-12687d6b-0601-4770-a97b-7af4e45c76c8 tempest-VolumesActionsTest-30875521 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:23:57 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-12687d6b-0601-4770-a97b-7af4e45c76c8 tempest-VolumesActionsTest-30875521 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:23:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-12687d6b-0601-4770-a97b-7af4e45c76c8 tempest-VolumesActionsTest-30875521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f2c6b950-7555-4b60-a530-1c23504f580a 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:57 devstack sudo[93871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f2c6b950-7555-4b60-a530-1c23504f580a 1073741824 Jul 07 17:23:57 devstack sudo[93871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:57 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d8c9929b-1f03-4ea5-8687-7c2c8472ac27 tempest-SnapshotsActionsTest-439353654 None] Acquiring lock "cinder-8caed149-3a91-459e-9837-d4158fbd345b-delete_snapshot" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:57 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d8c9929b-1f03-4ea5-8687-7c2c8472ac27 tempest-SnapshotsActionsTest-439353654 None] Lock "cinder-8caed149-3a91-459e-9837-d4158fbd345b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:57 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d8c9929b-1f03-4ea5-8687-7c2c8472ac27 tempest-SnapshotsActionsTest-439353654 None] Acquiring lock "cinder-quobyte-225b299e-fe3e-4903-821a-c7dc2c297238" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:57 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d8c9929b-1f03-4ea5-8687-7c2c8472ac27 tempest-SnapshotsActionsTest-439353654 None] Lock "cinder-quobyte-225b299e-fe3e-4903-821a-c7dc2c297238" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:57 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d8c9929b-1f03-4ea5-8687-7c2c8472ac27 tempest-SnapshotsActionsTest-439353654 None] Acquiring lock "cinder-quobyte-8caed149-3a91-459e-9837-d4158fbd345b" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:57 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d8c9929b-1f03-4ea5-8687-7c2c8472ac27 tempest-SnapshotsActionsTest-439353654 None] Lock "cinder-quobyte-8caed149-3a91-459e-9837-d4158fbd345b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:57 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-d8c9929b-1f03-4ea5-8687-7c2c8472ac27 tempest-SnapshotsActionsTest-439353654 None] Deleting offline snapshot 8caed149-3a91-459e-9837-d4158fbd345b of volume 225b299e-fe3e-4903-821a-c7dc2c297238 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:23:57 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-d8c9929b-1f03-4ea5-8687-7c2c8472ac27 tempest-SnapshotsActionsTest-439353654 None] snapshot_file for this snap is: volume-225b299e-fe3e-4903-821a-c7dc2c297238.8caed149-3a91-459e-9837-d4158fbd345b {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:23:57 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b904f7ee-25af-4ff0-a099-590e25ccd549]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d8c9929b-1f03-4ea5-8687-7c2c8472ac27 tempest-SnapshotsActionsTest-439353654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.8caed149-3a91-459e-9837-d4158fbd345b {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:57 devstack sudo[93873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.8caed149-3a91-459e-9837-d4158fbd345b Jul 07 17:23:57 devstack sudo[93873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:58 devstack sudo[93871]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-12687d6b-0601-4770-a97b-7af4e45c76c8 tempest-VolumesActionsTest-30875521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f2c6b950-7555-4b60-a530-1c23504f580a 1073741824" returned: 0 in 1.027s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-12687d6b-0601-4770-a97b-7af4e45c76c8 tempest-VolumesActionsTest-30875521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f2c6b950-7555-4b60-a530-1c23504f580a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:58 devstack sudo[93882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f2c6b950-7555-4b60-a530-1c23504f580a Jul 07 17:23:58 devstack sudo[93882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:58 devstack sudo[93873]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d8c9929b-1f03-4ea5-8687-7c2c8472ac27 tempest-SnapshotsActionsTest-439353654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.8caed149-3a91-459e-9837-d4158fbd345b" returned: 0 in 1.036s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:58 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-d8c9929b-1f03-4ea5-8687-7c2c8472ac27 tempest-SnapshotsActionsTest-439353654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-225b299e-fe3e-4903-821a-c7dc2c297238(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:23:58 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8aedaff-6b4a-453f-a214-67a7e3e1f349]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d8c9929b-1f03-4ea5-8687-7c2c8472ac27 tempest-SnapshotsActionsTest-439353654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:58 devstack sudo[93884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa Jul 07 17:23:58 devstack sudo[93884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:59 devstack sudo[93882]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-12687d6b-0601-4770-a97b-7af4e45c76c8 tempest-VolumesActionsTest-30875521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f2c6b950-7555-4b60-a530-1c23504f580a" returned: 0 in 0.797s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:59 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-12687d6b-0601-4770-a97b-7af4e45c76c8 tempest-VolumesActionsTest-30875521 None] <== create_volume: return (1887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:23:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-12687d6b-0601-4770-a97b-7af4e45c76c8 tempest-VolumesActionsTest-30875521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.890s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-12687d6b-0601-4770-a97b-7af4e45c76c8 tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02b376f7-19ba-4c96-84be-74fa1a0415d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2c6b950-7555-4b60-a530-1c23504f580a', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-12687d6b-0601-4770-a97b-7af4e45c76c8 tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f004b7ce-8c79-47c0-b71e-5c22f38e2c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:59 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-12687d6b-0601-4770-a97b-7af4e45c76c8 tempest-VolumesActionsTest-30875521 None] Volume volume-f2c6b950-7555-4b60-a530-1c23504f580a (f2c6b950-7555-4b60-a530-1c23504f580a): created successfully Jul 07 17:23:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-12687d6b-0601-4770-a97b-7af4e45c76c8 tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f004b7ce-8c79-47c0-b71e-5c22f38e2c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-12687d6b-0601-4770-a97b-7af4e45c76c8 tempest-VolumesActionsTest-30875521 None] Flow 'volume_create_manager' (6e95185a-ef5e-42d7-8104-60ff2ab29b83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:23:59 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-12687d6b-0601-4770-a97b-7af4e45c76c8 tempest-VolumesActionsTest-30875521 None] Created volume successfully. Jul 07 17:23:59 devstack sudo[93884]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d8c9929b-1f03-4ea5-8687-7c2c8472ac27 tempest-SnapshotsActionsTest-439353654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa" returned: 0 in 1.026s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:59 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-d8c9929b-1f03-4ea5-8687-7c2c8472ac27 tempest-SnapshotsActionsTest-439353654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-225b299e-fe3e-4903-821a-c7dc2c297238(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:23:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d8c9929b-1f03-4ea5-8687-7c2c8472ac27 tempest-SnapshotsActionsTest-439353654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.8caed149-3a91-459e-9837-d4158fbd345b {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:59 devstack sudo[93891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.8caed149-3a91-459e-9837-d4158fbd345b Jul 07 17:23:59 devstack sudo[93891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:00 devstack sudo[93891]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d8c9929b-1f03-4ea5-8687-7c2c8472ac27 tempest-SnapshotsActionsTest-439353654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.8caed149-3a91-459e-9837-d4158fbd345b" returned: 0 in 0.845s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d8c9929b-1f03-4ea5-8687-7c2c8472ac27 tempest-SnapshotsActionsTest-439353654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.8caed149-3a91-459e-9837-d4158fbd345b {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:00 devstack sudo[93898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.8caed149-3a91-459e-9837-d4158fbd345b Jul 07 17:24:00 devstack sudo[93898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:00 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-11ee52d6-813f-44af-95e4-a800190ab80b tempest-VolumesActionsTest-1324430718 None] Acquiring lock "cinder-f2c6b950-7555-4b60-a530-1c23504f580a-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:00 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-11ee52d6-813f-44af-95e4-a800190ab80b tempest-VolumesActionsTest-1324430718 None] Lock "cinder-f2c6b950-7555-4b60-a530-1c23504f580a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:00 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-11ee52d6-813f-44af-95e4-a800190ab80b tempest-VolumesActionsTest-1324430718 None] Acquiring lock "cinder-quobyte-f2c6b950-7555-4b60-a530-1c23504f580a" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:00 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-11ee52d6-813f-44af-95e4-a800190ab80b tempest-VolumesActionsTest-1324430718 None] Lock "cinder-quobyte-f2c6b950-7555-4b60-a530-1c23504f580a" acquired by "delete_volume" :: waited 0.017s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:00 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39b5fad-ec7c-4956-a183-8bb9d8ca7d7c]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-11ee52d6-813f-44af-95e4-a800190ab80b tempest-VolumesActionsTest-1324430718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f2c6b950-7555-4b60-a530-1c23504f580a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:00 devstack sudo[93900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f2c6b950-7555-4b60-a530-1c23504f580a Jul 07 17:24:00 devstack sudo[93900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:01 devstack sudo[93898]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d8c9929b-1f03-4ea5-8687-7c2c8472ac27 tempest-SnapshotsActionsTest-439353654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.8caed149-3a91-459e-9837-d4158fbd345b" returned: 0 in 0.812s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:01 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d8c9929b-1f03-4ea5-8687-7c2c8472ac27 tempest-SnapshotsActionsTest-439353654 None] Lock "cinder-quobyte-8caed149-3a91-459e-9837-d4158fbd345b" released by "_delete_snapshot" :: held 3.821s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:01 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d8c9929b-1f03-4ea5-8687-7c2c8472ac27 tempest-SnapshotsActionsTest-439353654 None] Lock "cinder-quobyte-225b299e-fe3e-4903-821a-c7dc2c297238" released by "delete_snapshot" :: held 3.854s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:01 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-d8c9929b-1f03-4ea5-8687-7c2c8472ac27 tempest-SnapshotsActionsTest-439353654 None] Created reservations ['fc5b032d-5b74-4b0c-b45e-d0a1bb551603', 'c39926d2-caa9-4bd7-a305-1415762ca113', '62a5e251-e0d7-4f6c-8c49-d0c7143528ec', '0ad926de-332e-4207-82cb-cc53a8c75cb1'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:24:01 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-d8c9929b-1f03-4ea5-8687-7c2c8472ac27 tempest-SnapshotsActionsTest-439353654 None] Delete snapshot completed successfully. Jul 07 17:24:01 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d8c9929b-1f03-4ea5-8687-7c2c8472ac27 tempest-SnapshotsActionsTest-439353654 None] Lock "cinder-8caed149-3a91-459e-9837-d4158fbd345b-delete_snapshot" released by "delete_snapshot" :: held 4.025s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:01 devstack sudo[93900]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-11ee52d6-813f-44af-95e4-a800190ab80b tempest-VolumesActionsTest-1324430718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f2c6b950-7555-4b60-a530-1c23504f580a" returned: 0 in 0.979s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-11ee52d6-813f-44af-95e4-a800190ab80b tempest-VolumesActionsTest-1324430718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f2c6b950-7555-4b60-a530-1c23504f580a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:01 devstack sudo[93906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f2c6b950-7555-4b60-a530-1c23504f580a Jul 07 17:24:01 devstack sudo[93906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-04806fec-abb7-45ab-8a99-51187ca9e3cd tempest-SnapshotsActionsTest-1129268036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-04806fec-abb7-45ab-8a99-51187ca9e3cd tempest-SnapshotsActionsTest-1129268036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:02 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-04806fec-abb7-45ab-8a99-51187ca9e3cd tempest-SnapshotsActionsTest-1129268036 None] Creating offline snapshot eda06751-85a1-4850-b97d-d392a3ce012c of volume 225b299e-fe3e-4903-821a-c7dc2c297238 {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:24:02 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[737e448f-fcef-4feb-af14-a0566fbb149a]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-04806fec-abb7-45ab-8a99-51187ca9e3cd tempest-SnapshotsActionsTest-1129268036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:02 devstack sudo[93908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa Jul 07 17:24:02 devstack sudo[93908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:02 devstack sudo[93906]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-11ee52d6-813f-44af-95e4-a800190ab80b tempest-VolumesActionsTest-1324430718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f2c6b950-7555-4b60-a530-1c23504f580a" returned: 0 in 0.845s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:02 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-11ee52d6-813f-44af-95e4-a800190ab80b tempest-VolumesActionsTest-1324430718 None] Lock "cinder-quobyte-f2c6b950-7555-4b60-a530-1c23504f580a" released by "delete_volume" :: held 1.871s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:02 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-11ee52d6-813f-44af-95e4-a800190ab80b tempest-VolumesActionsTest-1324430718 None] Created reservations ['aa570000-a175-4aa7-9be3-e08e54b7969e', '3b11a091-5ba2-4513-ae05-299780aefa74', '2d1c762b-8756-4261-9dae-56f8299d9d7b', '30ce5b87-155a-4177-963e-dde6908bf960'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:24:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-11ee52d6-813f-44af-95e4-a800190ab80b tempest-VolumesActionsTest-1324430718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-11ee52d6-813f-44af-95e4-a800190ab80b tempest-VolumesActionsTest-1324430718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:02 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-11ee52d6-813f-44af-95e4-a800190ab80b tempest-VolumesActionsTest-1324430718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:24:02 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-11ee52d6-813f-44af-95e4-a800190ab80b tempest-VolumesActionsTest-1324430718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:24:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-11ee52d6-813f-44af-95e4-a800190ab80b tempest-VolumesActionsTest-1324430718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-11ee52d6-813f-44af-95e4-a800190ab80b tempest-VolumesActionsTest-1324430718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:02 devstack sudo[93911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:24:02 devstack sudo[93911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:03 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [req-5ab855ff-819a-4d2e-a98d-c83b9f1b415c req-e94c5c07-a55a-45ea-a111-da506258cae2 tempest-VolumesSnapshotsTestJSON-1744798236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:24:03 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-5ab855ff-819a-4d2e-a98d-c83b9f1b415c req-e94c5c07-a55a-45ea-a111-da506258cae2 tempest-VolumesSnapshotsTestJSON-1744798236 None] Flow 'volume_create_manager' (ac406fe9-6d93-488c-9985-576249d8fdba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:24:03 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-5ab855ff-819a-4d2e-a98d-c83b9f1b415c req-e94c5c07-a55a-45ea-a111-da506258cae2 tempest-VolumesSnapshotsTestJSON-1744798236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3755d5cf-1d2d-40e0-95ea-e7d015df81c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:03 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-5ab855ff-819a-4d2e-a98d-c83b9f1b415c req-e94c5c07-a55a-45ea-a111-da506258cae2 tempest-VolumesSnapshotsTestJSON-1744798236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3755d5cf-1d2d-40e0-95ea-e7d015df81c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-893060913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f87dbfe-2754-4121-9474-a81cf04e9579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef767b3db95a43c989b9bac215a24745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:24:03Z,use_quota=True,user_id='f8620475295442abb3689eb42c5aa789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:03 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-5ab855ff-819a-4d2e-a98d-c83b9f1b415c req-e94c5c07-a55a-45ea-a111-da506258cae2 tempest-VolumesSnapshotsTestJSON-1744798236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fbb0ab2-e7e0-43be-b387-97b3653774ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:03 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-5ab855ff-819a-4d2e-a98d-c83b9f1b415c req-e94c5c07-a55a-45ea-a111-da506258cae2 tempest-VolumesSnapshotsTestJSON-1744798236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fbb0ab2-e7e0-43be-b387-97b3653774ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:03 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-5ab855ff-819a-4d2e-a98d-c83b9f1b415c req-e94c5c07-a55a-45ea-a111-da506258cae2 tempest-VolumesSnapshotsTestJSON-1744798236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (245edd25-8a8b-4e2a-a544-ccb02cba39aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:03 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-5ab855ff-819a-4d2e-a98d-c83b9f1b415c req-e94c5c07-a55a-45ea-a111-da506258cae2 tempest-VolumesSnapshotsTestJSON-1744798236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (245edd25-8a8b-4e2a-a544-ccb02cba39aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f87dbfe-2754-4121-9474-a81cf04e9579', 'volume_name': 'volume-6f87dbfe-2754-4121-9474-a81cf04e9579', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:03 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-5ab855ff-819a-4d2e-a98d-c83b9f1b415c req-e94c5c07-a55a-45ea-a111-da506258cae2 tempest-VolumesSnapshotsTestJSON-1744798236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96bebc9c-98a0-4eac-9459-541e91089c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:03 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-5ab855ff-819a-4d2e-a98d-c83b9f1b415c req-e94c5c07-a55a-45ea-a111-da506258cae2 tempest-VolumesSnapshotsTestJSON-1744798236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96bebc9c-98a0-4eac-9459-541e91089c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:03 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-5ab855ff-819a-4d2e-a98d-c83b9f1b415c req-e94c5c07-a55a-45ea-a111-da506258cae2 tempest-VolumesSnapshotsTestJSON-1744798236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7768d3d-c2e4-4ec0-976e-414dfc946df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:03 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [req-5ab855ff-819a-4d2e-a98d-c83b9f1b415c req-e94c5c07-a55a-45ea-a111-da506258cae2 tempest-VolumesSnapshotsTestJSON-1744798236 None] Volume 6f87dbfe-2754-4121-9474-a81cf04e9579: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f87dbfe-2754-4121-9474-a81cf04e9579', 'volume_size': 1} Jul 07 17:24:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-5ab855ff-819a-4d2e-a98d-c83b9f1b415c req-e94c5c07-a55a-45ea-a111-da506258cae2 tempest-VolumesSnapshotsTestJSON-1744798236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:03 devstack sudo[93908]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-04806fec-abb7-45ab-8a99-51187ca9e3cd tempest-SnapshotsActionsTest-1129268036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa" returned: 0 in 1.028s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:03 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-04806fec-abb7-45ab-8a99-51187ca9e3cd tempest-SnapshotsActionsTest-1129268036 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-225b299e-fe3e-4903-821a-c7dc2c297238(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:24:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-04806fec-abb7-45ab-8a99-51187ca9e3cd tempest-SnapshotsActionsTest-1129268036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.eda06751-85a1-4850-b97d-d392a3ce012c 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:03 devstack sudo[93917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.eda06751-85a1-4850-b97d-d392a3ce012c 1G Jul 07 17:24:03 devstack sudo[93917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:03 devstack sudo[93911]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-11ee52d6-813f-44af-95e4-a800190ab80b tempest-VolumesActionsTest-1324430718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.900s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:03 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-11ee52d6-813f-44af-95e4-a800190ab80b tempest-VolumesActionsTest-1324430718 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:24:03 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-11ee52d6-813f-44af-95e4-a800190ab80b tempest-VolumesActionsTest-1324430718 None] Deleted volume successfully. Jul 07 17:24:03 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-11ee52d6-813f-44af-95e4-a800190ab80b tempest-VolumesActionsTest-1324430718 None] Lock "cinder-f2c6b950-7555-4b60-a530-1c23504f580a-delete_volume" released by "delete_volume" :: held 3.141s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:04 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-50b2ab74-49c8-48e2-9ffe-1b3e3e626725 tempest-VolumesActionsTest-30875521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:24:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-50b2ab74-49c8-48e2-9ffe-1b3e3e626725 tempest-VolumesActionsTest-30875521 None] Flow 'volume_create_manager' (41543312-dd5f-4d23-a704-9ab27443dc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:24:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-50b2ab74-49c8-48e2-9ffe-1b3e3e626725 tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (522e0951-771d-441c-827d-c6da9e953c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-50b2ab74-49c8-48e2-9ffe-1b3e3e626725 tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (522e0951-771d-441c-827d-c6da9e953c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1073909375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0b7f251-ead1-4c5d-a160-d84c6e6247f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f6d3d3242cc4a0985413eb44decf459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:24:04Z,use_quota=True,user_id='3ad1ec1148104bd3b691c7bc15118fd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-50b2ab74-49c8-48e2-9ffe-1b3e3e626725 tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21c3b9dd-7fd2-4154-b020-c747dec42c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-50b2ab74-49c8-48e2-9ffe-1b3e3e626725 tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21c3b9dd-7fd2-4154-b020-c747dec42c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-50b2ab74-49c8-48e2-9ffe-1b3e3e626725 tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fab8400-73cc-4051-9b04-e7fc2d9f68ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-50b2ab74-49c8-48e2-9ffe-1b3e3e626725 tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fab8400-73cc-4051-9b04-e7fc2d9f68ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0b7f251-ead1-4c5d-a160-d84c6e6247f0', 'volume_name': 'volume-a0b7f251-ead1-4c5d-a160-d84c6e6247f0', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-50b2ab74-49c8-48e2-9ffe-1b3e3e626725 tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf4c0b14-2480-4463-a09e-6a4123b71f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-50b2ab74-49c8-48e2-9ffe-1b3e3e626725 tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf4c0b14-2480-4463-a09e-6a4123b71f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-50b2ab74-49c8-48e2-9ffe-1b3e3e626725 tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26c20cd1-c549-4e9a-ae6f-9782d7fb831f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:04 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-50b2ab74-49c8-48e2-9ffe-1b3e3e626725 tempest-VolumesActionsTest-30875521 None] Volume a0b7f251-ead1-4c5d-a160-d84c6e6247f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0b7f251-ead1-4c5d-a160-d84c6e6247f0', 'volume_size': 1} Jul 07 17:24:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-50b2ab74-49c8-48e2-9ffe-1b3e3e626725 tempest-VolumesActionsTest-30875521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:04 devstack sudo[93917]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-04806fec-abb7-45ab-8a99-51187ca9e3cd tempest-SnapshotsActionsTest-1129268036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.eda06751-85a1-4850-b97d-d392a3ce012c 1G" returned: 0 in 0.975s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-04806fec-abb7-45ab-8a99-51187ca9e3cd tempest-SnapshotsActionsTest-1129268036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.eda06751-85a1-4850-b97d-d392a3ce012c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:04 devstack sudo[93924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.eda06751-85a1-4850-b97d-d392a3ce012c Jul 07 17:24:04 devstack sudo[93924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:04 devstack sudo[93924]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-04806fec-abb7-45ab-8a99-51187ca9e3cd tempest-SnapshotsActionsTest-1129268036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.eda06751-85a1-4850-b97d-d392a3ce012c" returned: 0 in 0.685s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:04 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-04806fec-abb7-45ab-8a99-51187ca9e3cd tempest-SnapshotsActionsTest-1129268036 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.eda06751-85a1-4850-b97d-d392a3ce012c is being set with open permissions: ugo+rw Jul 07 17:24:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-04806fec-abb7-45ab-8a99-51187ca9e3cd tempest-SnapshotsActionsTest-1129268036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.eda06751-85a1-4850-b97d-d392a3ce012c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:05 devstack sudo[93929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.eda06751-85a1-4850-b97d-d392a3ce012c Jul 07 17:24:05 devstack sudo[93929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:05 devstack sudo[93929]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-04806fec-abb7-45ab-8a99-51187ca9e3cd tempest-SnapshotsActionsTest-1129268036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.eda06751-85a1-4850-b97d-d392a3ce012c" returned: 0 in 0.648s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-04806fec-abb7-45ab-8a99-51187ca9e3cd tempest-SnapshotsActionsTest-1129268036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.472s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-5ab855ff-819a-4d2e-a98d-c83b9f1b415c req-e94c5c07-a55a-45ea-a111-da506258cae2 tempest-VolumesSnapshotsTestJSON-1744798236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.373s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:05 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [req-5ab855ff-819a-4d2e-a98d-c83b9f1b415c req-e94c5c07-a55a-45ea-a111-da506258cae2 tempest-VolumesSnapshotsTestJSON-1744798236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-893060913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f87dbfe-2754-4121-9474-a81cf04e9579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef767b3db95a43c989b9bac215a24745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:24:03Z,use_quota=True,user_id='f8620475295442abb3689eb42c5aa789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:24:05 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [req-5ab855ff-819a-4d2e-a98d-c83b9f1b415c req-e94c5c07-a55a-45ea-a111-da506258cae2 tempest-VolumesSnapshotsTestJSON-1744798236 None] Creating volume 6f87dbfe-2754-4121-9474-a81cf04e9579 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:24:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-5ab855ff-819a-4d2e-a98d-c83b9f1b415c req-e94c5c07-a55a-45ea-a111-da506258cae2 tempest-VolumesSnapshotsTestJSON-1744798236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-5ab855ff-819a-4d2e-a98d-c83b9f1b415c req-e94c5c07-a55a-45ea-a111-da506258cae2 tempest-VolumesSnapshotsTestJSON-1744798236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:05 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [req-5ab855ff-819a-4d2e-a98d-c83b9f1b415c req-e94c5c07-a55a-45ea-a111-da506258cae2 tempest-VolumesSnapshotsTestJSON-1744798236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:24:05 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [req-5ab855ff-819a-4d2e-a98d-c83b9f1b415c req-e94c5c07-a55a-45ea-a111-da506258cae2 tempest-VolumesSnapshotsTestJSON-1744798236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:24:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-5ab855ff-819a-4d2e-a98d-c83b9f1b415c req-e94c5c07-a55a-45ea-a111-da506258cae2 tempest-VolumesSnapshotsTestJSON-1744798236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:05 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [req-5ab855ff-819a-4d2e-a98d-c83b9f1b415c req-e94c5c07-a55a-45ea-a111-da506258cae2 tempest-VolumesSnapshotsTestJSON-1744798236 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:24:05 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [req-5ab855ff-819a-4d2e-a98d-c83b9f1b415c req-e94c5c07-a55a-45ea-a111-da506258cae2 tempest-VolumesSnapshotsTestJSON-1744798236 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:24:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-5ab855ff-819a-4d2e-a98d-c83b9f1b415c req-e94c5c07-a55a-45ea-a111-da506258cae2 tempest-VolumesSnapshotsTestJSON-1744798236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6f87dbfe-2754-4121-9474-a81cf04e9579 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:05 devstack sudo[93932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6f87dbfe-2754-4121-9474-a81cf04e9579 1073741824 Jul 07 17:24:05 devstack sudo[93932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:05 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-04806fec-abb7-45ab-8a99-51187ca9e3cd tempest-SnapshotsActionsTest-1129268036 None] Create snapshot completed successfully Jul 07 17:24:06 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-dc0cccfc-8067-4bbe-ae16-f60ef0768d36 tempest-SnapshotsActionsTest-439353654 None] Acquiring lock "cinder-eda06751-85a1-4850-b97d-d392a3ce012c-delete_snapshot" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:06 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-dc0cccfc-8067-4bbe-ae16-f60ef0768d36 tempest-SnapshotsActionsTest-439353654 None] Lock "cinder-eda06751-85a1-4850-b97d-d392a3ce012c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:06 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-dc0cccfc-8067-4bbe-ae16-f60ef0768d36 tempest-SnapshotsActionsTest-439353654 None] Acquiring lock "cinder-quobyte-225b299e-fe3e-4903-821a-c7dc2c297238" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:06 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-dc0cccfc-8067-4bbe-ae16-f60ef0768d36 tempest-SnapshotsActionsTest-439353654 None] Lock "cinder-quobyte-225b299e-fe3e-4903-821a-c7dc2c297238" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:06 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-dc0cccfc-8067-4bbe-ae16-f60ef0768d36 tempest-SnapshotsActionsTest-439353654 None] Acquiring lock "cinder-quobyte-eda06751-85a1-4850-b97d-d392a3ce012c" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:06 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-dc0cccfc-8067-4bbe-ae16-f60ef0768d36 tempest-SnapshotsActionsTest-439353654 None] Lock "cinder-quobyte-eda06751-85a1-4850-b97d-d392a3ce012c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:06 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-dc0cccfc-8067-4bbe-ae16-f60ef0768d36 tempest-SnapshotsActionsTest-439353654 None] Deleting offline snapshot eda06751-85a1-4850-b97d-d392a3ce012c of volume 225b299e-fe3e-4903-821a-c7dc2c297238 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:24:06 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-dc0cccfc-8067-4bbe-ae16-f60ef0768d36 tempest-SnapshotsActionsTest-439353654 None] snapshot_file for this snap is: volume-225b299e-fe3e-4903-821a-c7dc2c297238.eda06751-85a1-4850-b97d-d392a3ce012c {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:24:06 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c514e1a4-213d-4f6d-8c76-500b7a71e714]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-dc0cccfc-8067-4bbe-ae16-f60ef0768d36 tempest-SnapshotsActionsTest-439353654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.eda06751-85a1-4850-b97d-d392a3ce012c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:06 devstack sudo[93932]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-5ab855ff-819a-4d2e-a98d-c83b9f1b415c req-e94c5c07-a55a-45ea-a111-da506258cae2 tempest-VolumesSnapshotsTestJSON-1744798236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6f87dbfe-2754-4121-9474-a81cf04e9579 1073741824" returned: 0 in 1.032s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:06 devstack sudo[93937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.eda06751-85a1-4850-b97d-d392a3ce012c Jul 07 17:24:06 devstack sudo[93937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-5ab855ff-819a-4d2e-a98d-c83b9f1b415c req-e94c5c07-a55a-45ea-a111-da506258cae2 tempest-VolumesSnapshotsTestJSON-1744798236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6f87dbfe-2754-4121-9474-a81cf04e9579 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:06 devstack sudo[93939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6f87dbfe-2754-4121-9474-a81cf04e9579 Jul 07 17:24:06 devstack sudo[93939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:07 devstack sudo[93939]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-5ab855ff-819a-4d2e-a98d-c83b9f1b415c req-e94c5c07-a55a-45ea-a111-da506258cae2 tempest-VolumesSnapshotsTestJSON-1744798236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6f87dbfe-2754-4121-9474-a81cf04e9579" returned: 0 in 0.709s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:07 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [req-5ab855ff-819a-4d2e-a98d-c83b9f1b415c req-e94c5c07-a55a-45ea-a111-da506258cae2 tempest-VolumesSnapshotsTestJSON-1744798236 None] <== create_volume: return (1801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:24:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-5ab855ff-819a-4d2e-a98d-c83b9f1b415c req-e94c5c07-a55a-45ea-a111-da506258cae2 tempest-VolumesSnapshotsTestJSON-1744798236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.805s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-50b2ab74-49c8-48e2-9ffe-1b3e3e626725 tempest-VolumesActionsTest-30875521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.380s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:07 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-50b2ab74-49c8-48e2-9ffe-1b3e3e626725 tempest-VolumesActionsTest-30875521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1073909375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0b7f251-ead1-4c5d-a160-d84c6e6247f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f6d3d3242cc4a0985413eb44decf459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:24:04Z,use_quota=True,user_id='3ad1ec1148104bd3b691c7bc15118fd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:24:07 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-50b2ab74-49c8-48e2-9ffe-1b3e3e626725 tempest-VolumesActionsTest-30875521 None] Creating volume a0b7f251-ead1-4c5d-a160-d84c6e6247f0 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:24:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-50b2ab74-49c8-48e2-9ffe-1b3e3e626725 tempest-VolumesActionsTest-30875521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-50b2ab74-49c8-48e2-9ffe-1b3e3e626725 tempest-VolumesActionsTest-30875521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:07 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-50b2ab74-49c8-48e2-9ffe-1b3e3e626725 tempest-VolumesActionsTest-30875521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:24:07 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-50b2ab74-49c8-48e2-9ffe-1b3e3e626725 tempest-VolumesActionsTest-30875521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:24:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-50b2ab74-49c8-48e2-9ffe-1b3e3e626725 tempest-VolumesActionsTest-30875521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:07 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-50b2ab74-49c8-48e2-9ffe-1b3e3e626725 tempest-VolumesActionsTest-30875521 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:24:07 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-50b2ab74-49c8-48e2-9ffe-1b3e3e626725 tempest-VolumesActionsTest-30875521 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:24:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-50b2ab74-49c8-48e2-9ffe-1b3e3e626725 tempest-VolumesActionsTest-30875521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0b7f251-ead1-4c5d-a160-d84c6e6247f0 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:07 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-5ab855ff-819a-4d2e-a98d-c83b9f1b415c req-e94c5c07-a55a-45ea-a111-da506258cae2 tempest-VolumesSnapshotsTestJSON-1744798236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7768d3d-c2e4-4ec0-976e-414dfc946df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f87dbfe-2754-4121-9474-a81cf04e9579', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:07 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-5ab855ff-819a-4d2e-a98d-c83b9f1b415c req-e94c5c07-a55a-45ea-a111-da506258cae2 tempest-VolumesSnapshotsTestJSON-1744798236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbaf9e40-c9a3-410e-99b6-e14c28dbe2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:07 devstack sudo[93968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0b7f251-ead1-4c5d-a160-d84c6e6247f0 1073741824 Jul 07 17:24:07 devstack sudo[93968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:07 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [req-5ab855ff-819a-4d2e-a98d-c83b9f1b415c req-e94c5c07-a55a-45ea-a111-da506258cae2 tempest-VolumesSnapshotsTestJSON-1744798236 None] Volume volume-6f87dbfe-2754-4121-9474-a81cf04e9579 (6f87dbfe-2754-4121-9474-a81cf04e9579): created successfully Jul 07 17:24:07 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-5ab855ff-819a-4d2e-a98d-c83b9f1b415c req-e94c5c07-a55a-45ea-a111-da506258cae2 tempest-VolumesSnapshotsTestJSON-1744798236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbaf9e40-c9a3-410e-99b6-e14c28dbe2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:07 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-5ab855ff-819a-4d2e-a98d-c83b9f1b415c req-e94c5c07-a55a-45ea-a111-da506258cae2 tempest-VolumesSnapshotsTestJSON-1744798236 None] Flow 'volume_create_manager' (ac406fe9-6d93-488c-9985-576249d8fdba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:24:07 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-5ab855ff-819a-4d2e-a98d-c83b9f1b415c req-e94c5c07-a55a-45ea-a111-da506258cae2 tempest-VolumesSnapshotsTestJSON-1744798236 None] Created volume successfully. Jul 07 17:24:07 devstack sudo[93937]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-dc0cccfc-8067-4bbe-ae16-f60ef0768d36 tempest-SnapshotsActionsTest-439353654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.eda06751-85a1-4850-b97d-d392a3ce012c" returned: 0 in 1.034s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:07 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-dc0cccfc-8067-4bbe-ae16-f60ef0768d36 tempest-SnapshotsActionsTest-439353654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-225b299e-fe3e-4903-821a-c7dc2c297238(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:24:07 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[266be627-18e5-498b-95d5-18fc175f6665]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-dc0cccfc-8067-4bbe-ae16-f60ef0768d36 tempest-SnapshotsActionsTest-439353654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:07 devstack sudo[93970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa Jul 07 17:24:07 devstack sudo[93970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:08 devstack sudo[93968]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-50b2ab74-49c8-48e2-9ffe-1b3e3e626725 tempest-VolumesActionsTest-30875521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0b7f251-ead1-4c5d-a160-d84c6e6247f0 1073741824" returned: 0 in 0.923s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:08 devstack sudo[93970]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-dc0cccfc-8067-4bbe-ae16-f60ef0768d36 tempest-SnapshotsActionsTest-439353654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa" returned: 0 in 0.781s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:08 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-dc0cccfc-8067-4bbe-ae16-f60ef0768d36 tempest-SnapshotsActionsTest-439353654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-225b299e-fe3e-4903-821a-c7dc2c297238(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:24:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-dc0cccfc-8067-4bbe-ae16-f60ef0768d36 tempest-SnapshotsActionsTest-439353654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.eda06751-85a1-4850-b97d-d392a3ce012c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-50b2ab74-49c8-48e2-9ffe-1b3e3e626725 tempest-VolumesActionsTest-30875521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0b7f251-ead1-4c5d-a160-d84c6e6247f0 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:08 devstack sudo[94015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.eda06751-85a1-4850-b97d-d392a3ce012c Jul 07 17:24:08 devstack sudo[94015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:08 devstack sudo[94016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0b7f251-ead1-4c5d-a160-d84c6e6247f0 Jul 07 17:24:08 devstack sudo[94016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-7aadeb68-e410-49ba-a7e2-b7c092381832 req-5b21247f-942a-4ec1-be7a-20dfe97ac980 tempest-VolumesSnapshotsTestJSON-1744798236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:09 devstack sudo[94016]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-50b2ab74-49c8-48e2-9ffe-1b3e3e626725 tempest-VolumesActionsTest-30875521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0b7f251-ead1-4c5d-a160-d84c6e6247f0" returned: 0 in 0.699s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:09 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-50b2ab74-49c8-48e2-9ffe-1b3e3e626725 tempest-VolumesActionsTest-30875521 None] <== create_volume: return (1689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:24:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-50b2ab74-49c8-48e2-9ffe-1b3e3e626725 tempest-VolumesActionsTest-30875521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.691s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-7aadeb68-e410-49ba-a7e2-b7c092381832 req-5b21247f-942a-4ec1-be7a-20dfe97ac980 tempest-VolumesSnapshotsTestJSON-1744798236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.214s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:09 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [req-7aadeb68-e410-49ba-a7e2-b7c092381832 req-5b21247f-942a-4ec1-be7a-20dfe97ac980 tempest-VolumesSnapshotsTestJSON-1744798236 None] Creating offline snapshot 71273301-6fb6-4ccc-bf25-0f88f8b5e113 of volume 6f87dbfe-2754-4121-9474-a81cf04e9579 {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:24:09 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-50b2ab74-49c8-48e2-9ffe-1b3e3e626725 tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26c20cd1-c549-4e9a-ae6f-9782d7fb831f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0b7f251-ead1-4c5d-a160-d84c6e6247f0', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:09 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-50b2ab74-49c8-48e2-9ffe-1b3e3e626725 tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d7c0e39-a38c-4a78-aac9-bdf4648d79b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:09 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e31f436-edda-4885-a614-099e6cfde2ea]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-7aadeb68-e410-49ba-a7e2-b7c092381832 req-5b21247f-942a-4ec1-be7a-20dfe97ac980 tempest-VolumesSnapshotsTestJSON-1744798236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6f87dbfe-2754-4121-9474-a81cf04e9579 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:09 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-50b2ab74-49c8-48e2-9ffe-1b3e3e626725 tempest-VolumesActionsTest-30875521 None] Volume volume-a0b7f251-ead1-4c5d-a160-d84c6e6247f0 (a0b7f251-ead1-4c5d-a160-d84c6e6247f0): created successfully Jul 07 17:24:09 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-50b2ab74-49c8-48e2-9ffe-1b3e3e626725 tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d7c0e39-a38c-4a78-aac9-bdf4648d79b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:09 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-50b2ab74-49c8-48e2-9ffe-1b3e3e626725 tempest-VolumesActionsTest-30875521 None] Flow 'volume_create_manager' (41543312-dd5f-4d23-a704-9ab27443dc12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:24:09 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-50b2ab74-49c8-48e2-9ffe-1b3e3e626725 tempest-VolumesActionsTest-30875521 None] Created volume successfully. Jul 07 17:24:09 devstack sudo[94015]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-dc0cccfc-8067-4bbe-ae16-f60ef0768d36 tempest-SnapshotsActionsTest-439353654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.eda06751-85a1-4850-b97d-d392a3ce012c" returned: 0 in 0.888s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-dc0cccfc-8067-4bbe-ae16-f60ef0768d36 tempest-SnapshotsActionsTest-439353654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.eda06751-85a1-4850-b97d-d392a3ce012c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:09 devstack sudo[94024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6f87dbfe-2754-4121-9474-a81cf04e9579 Jul 07 17:24:09 devstack sudo[94024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:09 devstack sudo[94026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.eda06751-85a1-4850-b97d-d392a3ce012c Jul 07 17:24:09 devstack sudo[94026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:09 devstack sudo[94024]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-7aadeb68-e410-49ba-a7e2-b7c092381832 req-5b21247f-942a-4ec1-be7a-20dfe97ac980 tempest-VolumesSnapshotsTestJSON-1744798236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6f87dbfe-2754-4121-9474-a81cf04e9579" returned: 0 in 0.760s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-7aadeb68-e410-49ba-a7e2-b7c092381832 req-5b21247f-942a-4ec1-be7a-20dfe97ac980 tempest-VolumesSnapshotsTestJSON-1744798236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6f87dbfe-2754-4121-9474-a81cf04e9579,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6f87dbfe-2754-4121-9474-a81cf04e9579.71273301-6fb6-4ccc-bf25-0f88f8b5e113 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:10 devstack sudo[94026]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-dc0cccfc-8067-4bbe-ae16-f60ef0768d36 tempest-SnapshotsActionsTest-439353654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.eda06751-85a1-4850-b97d-d392a3ce012c" returned: 0 in 0.656s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:10 devstack sudo[94033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6f87dbfe-2754-4121-9474-a81cf04e9579,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6f87dbfe-2754-4121-9474-a81cf04e9579.71273301-6fb6-4ccc-bf25-0f88f8b5e113 1G Jul 07 17:24:10 devstack sudo[94033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:10 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-dc0cccfc-8067-4bbe-ae16-f60ef0768d36 tempest-SnapshotsActionsTest-439353654 None] Lock "cinder-quobyte-eda06751-85a1-4850-b97d-d392a3ce012c" released by "_delete_snapshot" :: held 3.456s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:10 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-dc0cccfc-8067-4bbe-ae16-f60ef0768d36 tempest-SnapshotsActionsTest-439353654 None] Lock "cinder-quobyte-225b299e-fe3e-4903-821a-c7dc2c297238" released by "delete_snapshot" :: held 3.479s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:10 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-dc0cccfc-8067-4bbe-ae16-f60ef0768d36 tempest-SnapshotsActionsTest-439353654 None] Created reservations ['86ee8bac-613c-41e1-b28f-3ec4f75a29ee', '94f55590-21d0-4d50-9d6c-0efd1c4a7753', 'e4a9e964-1785-4e64-bf36-3b63e4d92076', '3005cf89-734f-4f74-b131-20b88ea63b0e'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:24:10 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-dc0cccfc-8067-4bbe-ae16-f60ef0768d36 tempest-SnapshotsActionsTest-439353654 None] Delete snapshot completed successfully. Jul 07 17:24:10 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-dc0cccfc-8067-4bbe-ae16-f60ef0768d36 tempest-SnapshotsActionsTest-439353654 None] Lock "cinder-eda06751-85a1-4850-b97d-d392a3ce012c-delete_snapshot" released by "delete_snapshot" :: held 3.628s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:10 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a65865c7-ee1a-4ae8-ac96-da3cf40bf675 tempest-VolumesActionsTest-1324430718 None] Acquiring lock "cinder-a0b7f251-ead1-4c5d-a160-d84c6e6247f0-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:10 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a65865c7-ee1a-4ae8-ac96-da3cf40bf675 tempest-VolumesActionsTest-1324430718 None] Lock "cinder-a0b7f251-ead1-4c5d-a160-d84c6e6247f0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:10 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a65865c7-ee1a-4ae8-ac96-da3cf40bf675 tempest-VolumesActionsTest-1324430718 None] Acquiring lock "cinder-quobyte-a0b7f251-ead1-4c5d-a160-d84c6e6247f0" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:10 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a65865c7-ee1a-4ae8-ac96-da3cf40bf675 tempest-VolumesActionsTest-1324430718 None] Lock "cinder-quobyte-a0b7f251-ead1-4c5d-a160-d84c6e6247f0" acquired by "delete_volume" :: waited 0.015s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:10 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4599b7da-287b-432d-a2a6-3835b076461a]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a65865c7-ee1a-4ae8-ac96-da3cf40bf675 tempest-VolumesActionsTest-1324430718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0b7f251-ead1-4c5d-a160-d84c6e6247f0 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:10 devstack sudo[94063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0b7f251-ead1-4c5d-a160-d84c6e6247f0 Jul 07 17:24:10 devstack sudo[94063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:10 devstack sudo[94033]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-7aadeb68-e410-49ba-a7e2-b7c092381832 req-5b21247f-942a-4ec1-be7a-20dfe97ac980 tempest-VolumesSnapshotsTestJSON-1744798236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6f87dbfe-2754-4121-9474-a81cf04e9579,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6f87dbfe-2754-4121-9474-a81cf04e9579.71273301-6fb6-4ccc-bf25-0f88f8b5e113 1G" returned: 0 in 0.827s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-7aadeb68-e410-49ba-a7e2-b7c092381832 req-5b21247f-942a-4ec1-be7a-20dfe97ac980 tempest-VolumesSnapshotsTestJSON-1744798236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f87dbfe-2754-4121-9474-a81cf04e9579 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6f87dbfe-2754-4121-9474-a81cf04e9579.71273301-6fb6-4ccc-bf25-0f88f8b5e113 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:10 devstack sudo[94065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f87dbfe-2754-4121-9474-a81cf04e9579 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6f87dbfe-2754-4121-9474-a81cf04e9579.71273301-6fb6-4ccc-bf25-0f88f8b5e113 Jul 07 17:24:10 devstack sudo[94065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:11 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-32710eb0-ae1f-4903-bdf1-bd31f5e45d66 tempest-SnapshotsActionsTest-1129268036 None] Acquiring lock "cinder-7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa-delete_snapshot" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:11 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-32710eb0-ae1f-4903-bdf1-bd31f5e45d66 tempest-SnapshotsActionsTest-1129268036 None] Lock "cinder-7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:11 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-32710eb0-ae1f-4903-bdf1-bd31f5e45d66 tempest-SnapshotsActionsTest-1129268036 None] Acquiring lock "cinder-quobyte-225b299e-fe3e-4903-821a-c7dc2c297238" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:11 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-32710eb0-ae1f-4903-bdf1-bd31f5e45d66 tempest-SnapshotsActionsTest-1129268036 None] Lock "cinder-quobyte-225b299e-fe3e-4903-821a-c7dc2c297238" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:11 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-32710eb0-ae1f-4903-bdf1-bd31f5e45d66 tempest-SnapshotsActionsTest-1129268036 None] Acquiring lock "cinder-quobyte-7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:11 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-32710eb0-ae1f-4903-bdf1-bd31f5e45d66 tempest-SnapshotsActionsTest-1129268036 None] Lock "cinder-quobyte-7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:11 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-32710eb0-ae1f-4903-bdf1-bd31f5e45d66 tempest-SnapshotsActionsTest-1129268036 None] Deleting offline snapshot 7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa of volume 225b299e-fe3e-4903-821a-c7dc2c297238 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:24:11 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-32710eb0-ae1f-4903-bdf1-bd31f5e45d66 tempest-SnapshotsActionsTest-1129268036 None] snapshot_file for this snap is: volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:24:11 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e9f38e-3b97-4510-8b3b-2b43744af9d4]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-32710eb0-ae1f-4903-bdf1-bd31f5e45d66 tempest-SnapshotsActionsTest-1129268036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:11 devstack sudo[94068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa Jul 07 17:24:11 devstack sudo[94068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:11 devstack sudo[94063]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a65865c7-ee1a-4ae8-ac96-da3cf40bf675 tempest-VolumesActionsTest-1324430718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0b7f251-ead1-4c5d-a160-d84c6e6247f0" returned: 0 in 0.811s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a65865c7-ee1a-4ae8-ac96-da3cf40bf675 tempest-VolumesActionsTest-1324430718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0b7f251-ead1-4c5d-a160-d84c6e6247f0 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:11 devstack sudo[94075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0b7f251-ead1-4c5d-a160-d84c6e6247f0 Jul 07 17:24:11 devstack sudo[94075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:11 devstack sudo[94065]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-7aadeb68-e410-49ba-a7e2-b7c092381832 req-5b21247f-942a-4ec1-be7a-20dfe97ac980 tempest-VolumesSnapshotsTestJSON-1744798236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f87dbfe-2754-4121-9474-a81cf04e9579 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6f87dbfe-2754-4121-9474-a81cf04e9579.71273301-6fb6-4ccc-bf25-0f88f8b5e113" returned: 0 in 0.725s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:11 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [req-7aadeb68-e410-49ba-a7e2-b7c092381832 req-5b21247f-942a-4ec1-be7a-20dfe97ac980 tempest-VolumesSnapshotsTestJSON-1744798236 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6f87dbfe-2754-4121-9474-a81cf04e9579.71273301-6fb6-4ccc-bf25-0f88f8b5e113 is being set with open permissions: ugo+rw Jul 07 17:24:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-7aadeb68-e410-49ba-a7e2-b7c092381832 req-5b21247f-942a-4ec1-be7a-20dfe97ac980 tempest-VolumesSnapshotsTestJSON-1744798236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6f87dbfe-2754-4121-9474-a81cf04e9579.71273301-6fb6-4ccc-bf25-0f88f8b5e113 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:11 devstack sudo[94077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6f87dbfe-2754-4121-9474-a81cf04e9579.71273301-6fb6-4ccc-bf25-0f88f8b5e113 Jul 07 17:24:11 devstack sudo[94077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:12 devstack sudo[94068]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-32710eb0-ae1f-4903-bdf1-bd31f5e45d66 tempest-SnapshotsActionsTest-1129268036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa" returned: 0 in 0.783s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:12 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-32710eb0-ae1f-4903-bdf1-bd31f5e45d66 tempest-SnapshotsActionsTest-1129268036 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-225b299e-fe3e-4903-821a-c7dc2c297238(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:24:12 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[668d0849-0edc-4e39-9b42-d785d44fcf2c]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-32710eb0-ae1f-4903-bdf1-bd31f5e45d66 tempest-SnapshotsActionsTest-1129268036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:12 devstack sudo[94075]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a65865c7-ee1a-4ae8-ac96-da3cf40bf675 tempest-VolumesActionsTest-1324430718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0b7f251-ead1-4c5d-a160-d84c6e6247f0" returned: 0 in 0.666s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:12 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a65865c7-ee1a-4ae8-ac96-da3cf40bf675 tempest-VolumesActionsTest-1324430718 None] Lock "cinder-quobyte-a0b7f251-ead1-4c5d-a160-d84c6e6247f0" released by "delete_volume" :: held 1.518s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:12 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-a65865c7-ee1a-4ae8-ac96-da3cf40bf675 tempest-VolumesActionsTest-1324430718 None] Created reservations ['c6c52fdd-6645-4d3a-9c4d-ddefa0c8d410', 'e92a5564-f638-4f87-a195-799ba680a995', 'ccf6d002-ca42-4ccf-8d80-59971a5f80b0', 'a1714fb2-8e3e-406f-bd12-373a893c4ea7'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:24:12 devstack sudo[94077]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-7aadeb68-e410-49ba-a7e2-b7c092381832 req-5b21247f-942a-4ec1-be7a-20dfe97ac980 tempest-VolumesSnapshotsTestJSON-1744798236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6f87dbfe-2754-4121-9474-a81cf04e9579.71273301-6fb6-4ccc-bf25-0f88f8b5e113" returned: 0 in 0.650s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:12 devstack sudo[94084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238 Jul 07 17:24:12 devstack sudo[94084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-7aadeb68-e410-49ba-a7e2-b7c092381832 req-5b21247f-942a-4ec1-be7a-20dfe97ac980 tempest-VolumesSnapshotsTestJSON-1744798236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6f87dbfe-2754-4121-9474-a81cf04e9579.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:12 devstack sudo[94086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6f87dbfe-2754-4121-9474-a81cf04e9579.info Jul 07 17:24:12 devstack sudo[94086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a65865c7-ee1a-4ae8-ac96-da3cf40bf675 tempest-VolumesActionsTest-1324430718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a65865c7-ee1a-4ae8-ac96-da3cf40bf675 tempest-VolumesActionsTest-1324430718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:12 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-a65865c7-ee1a-4ae8-ac96-da3cf40bf675 tempest-VolumesActionsTest-1324430718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:24:12 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-a65865c7-ee1a-4ae8-ac96-da3cf40bf675 tempest-VolumesActionsTest-1324430718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:24:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a65865c7-ee1a-4ae8-ac96-da3cf40bf675 tempest-VolumesActionsTest-1324430718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a65865c7-ee1a-4ae8-ac96-da3cf40bf675 tempest-VolumesActionsTest-1324430718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:12 devstack sudo[94088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:24:12 devstack sudo[94088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:12 devstack sudo[94084]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-32710eb0-ae1f-4903-bdf1-bd31f5e45d66 tempest-SnapshotsActionsTest-1129268036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238" returned: 0 in 0.898s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-32710eb0-ae1f-4903-bdf1-bd31f5e45d66 tempest-SnapshotsActionsTest-1129268036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:13 devstack sudo[94086]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-7aadeb68-e410-49ba-a7e2-b7c092381832 req-5b21247f-942a-4ec1-be7a-20dfe97ac980 tempest-VolumesSnapshotsTestJSON-1744798236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6f87dbfe-2754-4121-9474-a81cf04e9579.info" returned: 0 in 0.762s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:13 devstack sudo[94088]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:13 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [req-7aadeb68-e410-49ba-a7e2-b7c092381832 req-5b21247f-942a-4ec1-be7a-20dfe97ac980 tempest-VolumesSnapshotsTestJSON-1744798236 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6f87dbfe-2754-4121-9474-a81cf04e9579.info is being set with open permissions: ugo+rw Jul 07 17:24:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-7aadeb68-e410-49ba-a7e2-b7c092381832 req-5b21247f-942a-4ec1-be7a-20dfe97ac980 tempest-VolumesSnapshotsTestJSON-1744798236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6f87dbfe-2754-4121-9474-a81cf04e9579.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:13 devstack sudo[94096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa Jul 07 17:24:13 devstack sudo[94096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a65865c7-ee1a-4ae8-ac96-da3cf40bf675 tempest-VolumesActionsTest-1324430718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.724s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:13 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-a65865c7-ee1a-4ae8-ac96-da3cf40bf675 tempest-VolumesActionsTest-1324430718 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:24:13 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-a65865c7-ee1a-4ae8-ac96-da3cf40bf675 tempest-VolumesActionsTest-1324430718 None] Deleted volume successfully. Jul 07 17:24:13 devstack sudo[94097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6f87dbfe-2754-4121-9474-a81cf04e9579.info Jul 07 17:24:13 devstack sudo[94097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:13 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a65865c7-ee1a-4ae8-ac96-da3cf40bf675 tempest-VolumesActionsTest-1324430718 None] Lock "cinder-a0b7f251-ead1-4c5d-a160-d84c6e6247f0-delete_volume" released by "delete_volume" :: held 2.500s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:13 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-de608a58-cca6-42a8-b30b-c88176d2375c tempest-VolumesActionsTest-30875521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:24:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-de608a58-cca6-42a8-b30b-c88176d2375c tempest-VolumesActionsTest-30875521 None] Flow 'volume_create_manager' (2c0e02b4-3001-4879-ac76-f4d90fabef98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:24:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-de608a58-cca6-42a8-b30b-c88176d2375c tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45bfeaec-7b58-4794-9a2a-bb675684c1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-de608a58-cca6-42a8-b30b-c88176d2375c tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45bfeaec-7b58-4794-9a2a-bb675684c1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-848060949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d79d99d-f1e5-44f0-9925-c510044226bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f6d3d3242cc4a0985413eb44decf459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:24:13Z,use_quota=True,user_id='3ad1ec1148104bd3b691c7bc15118fd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-de608a58-cca6-42a8-b30b-c88176d2375c tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed216c88-bb68-49cb-ab72-a5e791e1c928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-de608a58-cca6-42a8-b30b-c88176d2375c tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed216c88-bb68-49cb-ab72-a5e791e1c928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-de608a58-cca6-42a8-b30b-c88176d2375c tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5fd754f-dfb1-44da-88cb-4da262abc15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-de608a58-cca6-42a8-b30b-c88176d2375c tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5fd754f-dfb1-44da-88cb-4da262abc15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d79d99d-f1e5-44f0-9925-c510044226bd', 'volume_name': 'volume-5d79d99d-f1e5-44f0-9925-c510044226bd', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-de608a58-cca6-42a8-b30b-c88176d2375c tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d5910a4-d58f-49f5-a829-ab4498ccd6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-de608a58-cca6-42a8-b30b-c88176d2375c tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d5910a4-d58f-49f5-a829-ab4498ccd6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-de608a58-cca6-42a8-b30b-c88176d2375c tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7636ed60-d852-40f9-8f0f-0ec2d3ffa8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:13 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-de608a58-cca6-42a8-b30b-c88176d2375c tempest-VolumesActionsTest-30875521 None] Volume 5d79d99d-f1e5-44f0-9925-c510044226bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d79d99d-f1e5-44f0-9925-c510044226bd', 'volume_size': 1} Jul 07 17:24:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-de608a58-cca6-42a8-b30b-c88176d2375c tempest-VolumesActionsTest-30875521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:13 devstack sudo[94097]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-7aadeb68-e410-49ba-a7e2-b7c092381832 req-5b21247f-942a-4ec1-be7a-20dfe97ac980 tempest-VolumesSnapshotsTestJSON-1744798236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6f87dbfe-2754-4121-9474-a81cf04e9579.info" returned: 0 in 0.687s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-7aadeb68-e410-49ba-a7e2-b7c092381832 req-5b21247f-942a-4ec1-be7a-20dfe97ac980 tempest-VolumesSnapshotsTestJSON-1744798236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.526s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-de608a58-cca6-42a8-b30b-c88176d2375c tempest-VolumesActionsTest-30875521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.286s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:13 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-de608a58-cca6-42a8-b30b-c88176d2375c tempest-VolumesActionsTest-30875521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-848060949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d79d99d-f1e5-44f0-9925-c510044226bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f6d3d3242cc4a0985413eb44decf459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:24:13Z,use_quota=True,user_id='3ad1ec1148104bd3b691c7bc15118fd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:24:13 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-de608a58-cca6-42a8-b30b-c88176d2375c tempest-VolumesActionsTest-30875521 None] Creating volume 5d79d99d-f1e5-44f0-9925-c510044226bd {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:24:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-de608a58-cca6-42a8-b30b-c88176d2375c tempest-VolumesActionsTest-30875521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-de608a58-cca6-42a8-b30b-c88176d2375c tempest-VolumesActionsTest-30875521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:13 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-de608a58-cca6-42a8-b30b-c88176d2375c tempest-VolumesActionsTest-30875521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:24:13 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-de608a58-cca6-42a8-b30b-c88176d2375c tempest-VolumesActionsTest-30875521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:24:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-de608a58-cca6-42a8-b30b-c88176d2375c tempest-VolumesActionsTest-30875521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:13 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-de608a58-cca6-42a8-b30b-c88176d2375c tempest-VolumesActionsTest-30875521 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:24:13 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-de608a58-cca6-42a8-b30b-c88176d2375c tempest-VolumesActionsTest-30875521 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:24:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-de608a58-cca6-42a8-b30b-c88176d2375c tempest-VolumesActionsTest-30875521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5d79d99d-f1e5-44f0-9925-c510044226bd 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:13 devstack sudo[94104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5d79d99d-f1e5-44f0-9925-c510044226bd 1073741824 Jul 07 17:24:13 devstack sudo[94104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:13 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-7aadeb68-e410-49ba-a7e2-b7c092381832 req-5b21247f-942a-4ec1-be7a-20dfe97ac980 tempest-VolumesSnapshotsTestJSON-1744798236 None] Create snapshot completed successfully Jul 07 17:24:13 devstack sudo[94096]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-32710eb0-ae1f-4903-bdf1-bd31f5e45d66 tempest-SnapshotsActionsTest-1129268036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa" returned: 0 in 0.810s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-32710eb0-ae1f-4903-bdf1-bd31f5e45d66 tempest-SnapshotsActionsTest-1129268036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:13 devstack sudo[94106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa Jul 07 17:24:13 devstack sudo[94106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:14 devstack sudo[94106]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-32710eb0-ae1f-4903-bdf1-bd31f5e45d66 tempest-SnapshotsActionsTest-1129268036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238.7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa" returned: 0 in 0.676s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:14 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-32710eb0-ae1f-4903-bdf1-bd31f5e45d66 tempest-SnapshotsActionsTest-1129268036 None] Lock "cinder-quobyte-7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa" released by "_delete_snapshot" :: held 3.294s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:14 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-32710eb0-ae1f-4903-bdf1-bd31f5e45d66 tempest-SnapshotsActionsTest-1129268036 None] Lock "cinder-quobyte-225b299e-fe3e-4903-821a-c7dc2c297238" released by "delete_snapshot" :: held 3.325s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:14 devstack cinder-volume[87233]: DEBUG cinder.coordination [req-f9c01ccd-8262-4de7-9b61-f33cef491156 req-8a094e50-e233-4d06-83ed-ca648a1b2d80 tempest-VolumesSnapshotsTestJSON-1744798236 None] Acquiring lock "cinder-71273301-6fb6-4ccc-bf25-0f88f8b5e113-delete_snapshot" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:14 devstack cinder-volume[87233]: DEBUG cinder.coordination [req-f9c01ccd-8262-4de7-9b61-f33cef491156 req-8a094e50-e233-4d06-83ed-ca648a1b2d80 tempest-VolumesSnapshotsTestJSON-1744798236 None] Lock "cinder-71273301-6fb6-4ccc-bf25-0f88f8b5e113-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:14 devstack cinder-volume[87233]: DEBUG cinder.coordination [req-f9c01ccd-8262-4de7-9b61-f33cef491156 req-8a094e50-e233-4d06-83ed-ca648a1b2d80 tempest-VolumesSnapshotsTestJSON-1744798236 None] Acquiring lock "cinder-quobyte-6f87dbfe-2754-4121-9474-a81cf04e9579" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:14 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-32710eb0-ae1f-4903-bdf1-bd31f5e45d66 tempest-SnapshotsActionsTest-1129268036 None] Created reservations ['77e727ce-d68b-49e4-8cf0-d5e6e1f0a73e', 'cc8e9c9b-985a-49b1-bbed-ce269a3d7541', 'c27db682-5c1c-4645-b4c6-89c42c0700bd', '4a1615b1-5160-4ed4-9b1e-44f428051758'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:24:14 devstack cinder-volume[87233]: DEBUG cinder.coordination [req-f9c01ccd-8262-4de7-9b61-f33cef491156 req-8a094e50-e233-4d06-83ed-ca648a1b2d80 tempest-VolumesSnapshotsTestJSON-1744798236 None] Lock "cinder-quobyte-6f87dbfe-2754-4121-9474-a81cf04e9579" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:14 devstack cinder-volume[87233]: DEBUG cinder.coordination [req-f9c01ccd-8262-4de7-9b61-f33cef491156 req-8a094e50-e233-4d06-83ed-ca648a1b2d80 tempest-VolumesSnapshotsTestJSON-1744798236 None] Acquiring lock "cinder-quobyte-71273301-6fb6-4ccc-bf25-0f88f8b5e113" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:14 devstack cinder-volume[87233]: DEBUG cinder.coordination [req-f9c01ccd-8262-4de7-9b61-f33cef491156 req-8a094e50-e233-4d06-83ed-ca648a1b2d80 tempest-VolumesSnapshotsTestJSON-1744798236 None] Lock "cinder-quobyte-71273301-6fb6-4ccc-bf25-0f88f8b5e113" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:14 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [req-f9c01ccd-8262-4de7-9b61-f33cef491156 req-8a094e50-e233-4d06-83ed-ca648a1b2d80 tempest-VolumesSnapshotsTestJSON-1744798236 None] Deleting offline snapshot 71273301-6fb6-4ccc-bf25-0f88f8b5e113 of volume 6f87dbfe-2754-4121-9474-a81cf04e9579 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:24:14 devstack sudo[94104]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:14 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [req-f9c01ccd-8262-4de7-9b61-f33cef491156 req-8a094e50-e233-4d06-83ed-ca648a1b2d80 tempest-VolumesSnapshotsTestJSON-1744798236 None] snapshot_file for this snap is: volume-6f87dbfe-2754-4121-9474-a81cf04e9579.71273301-6fb6-4ccc-bf25-0f88f8b5e113 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:24:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-de608a58-cca6-42a8-b30b-c88176d2375c tempest-VolumesActionsTest-30875521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5d79d99d-f1e5-44f0-9925-c510044226bd 1073741824" returned: 0 in 0.988s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:14 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c5d6dd-f4b4-4502-b464-70168dbbef4b]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-f9c01ccd-8262-4de7-9b61-f33cef491156 req-8a094e50-e233-4d06-83ed-ca648a1b2d80 tempest-VolumesSnapshotsTestJSON-1744798236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6f87dbfe-2754-4121-9474-a81cf04e9579.71273301-6fb6-4ccc-bf25-0f88f8b5e113 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-de608a58-cca6-42a8-b30b-c88176d2375c tempest-VolumesActionsTest-30875521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5d79d99d-f1e5-44f0-9925-c510044226bd {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:14 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-32710eb0-ae1f-4903-bdf1-bd31f5e45d66 tempest-SnapshotsActionsTest-1129268036 None] Delete snapshot completed successfully. Jul 07 17:24:14 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-32710eb0-ae1f-4903-bdf1-bd31f5e45d66 tempest-SnapshotsActionsTest-1129268036 None] Lock "cinder-7ae1f37a-b457-4c47-a1ef-5bc1c8704eaa-delete_snapshot" released by "delete_snapshot" :: held 3.610s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:14 devstack sudo[94114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5d79d99d-f1e5-44f0-9925-c510044226bd Jul 07 17:24:14 devstack sudo[94114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:14 devstack sudo[94113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6f87dbfe-2754-4121-9474-a81cf04e9579.71273301-6fb6-4ccc-bf25-0f88f8b5e113 Jul 07 17:24:14 devstack sudo[94113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:15 devstack sudo[94114]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:15 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-16e6262f-44c9-4306-9132-c985d9d36d91 tempest-SnapshotsActionsTest-1129268036 None] Acquiring lock "cinder-225b299e-fe3e-4903-821a-c7dc2c297238-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-de608a58-cca6-42a8-b30b-c88176d2375c tempest-VolumesActionsTest-30875521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5d79d99d-f1e5-44f0-9925-c510044226bd" returned: 0 in 0.737s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:15 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-de608a58-cca6-42a8-b30b-c88176d2375c tempest-VolumesActionsTest-30875521 None] <== create_volume: return (1799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:24:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-de608a58-cca6-42a8-b30b-c88176d2375c tempest-VolumesActionsTest-30875521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.804s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:15 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-16e6262f-44c9-4306-9132-c985d9d36d91 tempest-SnapshotsActionsTest-1129268036 None] Lock "cinder-225b299e-fe3e-4903-821a-c7dc2c297238-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:15 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-de608a58-cca6-42a8-b30b-c88176d2375c tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7636ed60-d852-40f9-8f0f-0ec2d3ffa8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d79d99d-f1e5-44f0-9925-c510044226bd', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:15 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-de608a58-cca6-42a8-b30b-c88176d2375c tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b3e179a-1c31-47de-b69c-b217e9302f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:15 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-de608a58-cca6-42a8-b30b-c88176d2375c tempest-VolumesActionsTest-30875521 None] Volume volume-5d79d99d-f1e5-44f0-9925-c510044226bd (5d79d99d-f1e5-44f0-9925-c510044226bd): created successfully Jul 07 17:24:15 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-de608a58-cca6-42a8-b30b-c88176d2375c tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b3e179a-1c31-47de-b69c-b217e9302f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:15 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-de608a58-cca6-42a8-b30b-c88176d2375c tempest-VolumesActionsTest-30875521 None] Flow 'volume_create_manager' (2c0e02b4-3001-4879-ac76-f4d90fabef98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:24:15 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-de608a58-cca6-42a8-b30b-c88176d2375c tempest-VolumesActionsTest-30875521 None] Created volume successfully. Jul 07 17:24:15 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-16e6262f-44c9-4306-9132-c985d9d36d91 tempest-SnapshotsActionsTest-1129268036 None] Acquiring lock "cinder-quobyte-225b299e-fe3e-4903-821a-c7dc2c297238" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:15 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-16e6262f-44c9-4306-9132-c985d9d36d91 tempest-SnapshotsActionsTest-1129268036 None] Lock "cinder-quobyte-225b299e-fe3e-4903-821a-c7dc2c297238" acquired by "delete_volume" :: waited 0.024s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:15 devstack sudo[94113]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-f9c01ccd-8262-4de7-9b61-f33cef491156 req-8a094e50-e233-4d06-83ed-ca648a1b2d80 tempest-VolumesSnapshotsTestJSON-1744798236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6f87dbfe-2754-4121-9474-a81cf04e9579.71273301-6fb6-4ccc-bf25-0f88f8b5e113" returned: 0 in 0.934s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:15 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [req-f9c01ccd-8262-4de7-9b61-f33cef491156 req-8a094e50-e233-4d06-83ed-ca648a1b2d80 tempest-VolumesSnapshotsTestJSON-1744798236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f87dbfe-2754-4121-9474-a81cf04e9579(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:24:15 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3aaeeda-16c4-4bda-a782-ceb99e84b707]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-16e6262f-44c9-4306-9132-c985d9d36d91 tempest-SnapshotsActionsTest-1129268036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:15 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3de166b-639b-4e1f-8430-a016e0f41ed2]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-f9c01ccd-8262-4de7-9b61-f33cef491156 req-8a094e50-e233-4d06-83ed-ca648a1b2d80 tempest-VolumesSnapshotsTestJSON-1744798236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6f87dbfe-2754-4121-9474-a81cf04e9579 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:15 devstack sudo[94121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238 Jul 07 17:24:15 devstack sudo[94121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:15 devstack sudo[94122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6f87dbfe-2754-4121-9474-a81cf04e9579 Jul 07 17:24:15 devstack sudo[94122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:16 devstack sudo[94122]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-f9c01ccd-8262-4de7-9b61-f33cef491156 req-8a094e50-e233-4d06-83ed-ca648a1b2d80 tempest-VolumesSnapshotsTestJSON-1744798236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6f87dbfe-2754-4121-9474-a81cf04e9579" returned: 0 in 0.824s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-f9c01ccd-8262-4de7-9b61-f33cef491156 req-8a094e50-e233-4d06-83ed-ca648a1b2d80 tempest-VolumesSnapshotsTestJSON-1744798236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6f87dbfe-2754-4121-9474-a81cf04e9579.71273301-6fb6-4ccc-bf25-0f88f8b5e113 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:16 devstack sudo[94133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6f87dbfe-2754-4121-9474-a81cf04e9579.71273301-6fb6-4ccc-bf25-0f88f8b5e113 Jul 07 17:24:16 devstack sudo[94133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:16 devstack sudo[94121]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-16e6262f-44c9-4306-9132-c985d9d36d91 tempest-SnapshotsActionsTest-1129268036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238" returned: 0 in 0.888s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-16e6262f-44c9-4306-9132-c985d9d36d91 tempest-SnapshotsActionsTest-1129268036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:16 devstack sudo[94135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238 Jul 07 17:24:16 devstack sudo[94135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:16 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9d44eb9a-3322-4341-b42b-8fdc15e7c7c7 tempest-VolumesActionsTest-1324430718 None] Acquiring lock "cinder-5d79d99d-f1e5-44f0-9925-c510044226bd-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:16 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9d44eb9a-3322-4341-b42b-8fdc15e7c7c7 tempest-VolumesActionsTest-1324430718 None] Lock "cinder-5d79d99d-f1e5-44f0-9925-c510044226bd-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:16 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9d44eb9a-3322-4341-b42b-8fdc15e7c7c7 tempest-VolumesActionsTest-1324430718 None] Acquiring lock "cinder-quobyte-5d79d99d-f1e5-44f0-9925-c510044226bd" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:16 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9d44eb9a-3322-4341-b42b-8fdc15e7c7c7 tempest-VolumesActionsTest-1324430718 None] Lock "cinder-quobyte-5d79d99d-f1e5-44f0-9925-c510044226bd" acquired by "delete_volume" :: waited 0.020s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:16 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0801f6-0901-43be-9b20-daf9bd233b1c]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9d44eb9a-3322-4341-b42b-8fdc15e7c7c7 tempest-VolumesActionsTest-1324430718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5d79d99d-f1e5-44f0-9925-c510044226bd {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:17 devstack sudo[94137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5d79d99d-f1e5-44f0-9925-c510044226bd Jul 07 17:24:17 devstack sudo[94137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:17 devstack sudo[94135]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-16e6262f-44c9-4306-9132-c985d9d36d91 tempest-SnapshotsActionsTest-1129268036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-225b299e-fe3e-4903-821a-c7dc2c297238" returned: 0 in 0.798s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:17 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-16e6262f-44c9-4306-9132-c985d9d36d91 tempest-SnapshotsActionsTest-1129268036 None] Lock "cinder-quobyte-225b299e-fe3e-4903-821a-c7dc2c297238" released by "delete_volume" :: held 1.770s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:17 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-16e6262f-44c9-4306-9132-c985d9d36d91 tempest-SnapshotsActionsTest-1129268036 None] Created reservations ['0cedd0d4-19af-4e56-8831-d58b3b1abccc', 'd754c8eb-54b2-4e7f-b760-ecdfca0ffd02', 'c41b61c0-51c8-4748-8d4b-1b84b5dcd264', '4e8760c3-12fc-468d-ad7e-95cb41dfff8e'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:24:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-16e6262f-44c9-4306-9132-c985d9d36d91 tempest-SnapshotsActionsTest-1129268036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-16e6262f-44c9-4306-9132-c985d9d36d91 tempest-SnapshotsActionsTest-1129268036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:17 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-16e6262f-44c9-4306-9132-c985d9d36d91 tempest-SnapshotsActionsTest-1129268036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:24:17 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-16e6262f-44c9-4306-9132-c985d9d36d91 tempest-SnapshotsActionsTest-1129268036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:24:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-16e6262f-44c9-4306-9132-c985d9d36d91 tempest-SnapshotsActionsTest-1129268036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-16e6262f-44c9-4306-9132-c985d9d36d91 tempest-SnapshotsActionsTest-1129268036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:17 devstack sudo[94133]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-f9c01ccd-8262-4de7-9b61-f33cef491156 req-8a094e50-e233-4d06-83ed-ca648a1b2d80 tempest-VolumesSnapshotsTestJSON-1744798236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6f87dbfe-2754-4121-9474-a81cf04e9579.71273301-6fb6-4ccc-bf25-0f88f8b5e113" returned: 0 in 1.067s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-f9c01ccd-8262-4de7-9b61-f33cef491156 req-8a094e50-e233-4d06-83ed-ca648a1b2d80 tempest-VolumesSnapshotsTestJSON-1744798236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6f87dbfe-2754-4121-9474-a81cf04e9579.71273301-6fb6-4ccc-bf25-0f88f8b5e113 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:17 devstack sudo[94144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:24:17 devstack sudo[94144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:17 devstack sudo[94146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6f87dbfe-2754-4121-9474-a81cf04e9579.71273301-6fb6-4ccc-bf25-0f88f8b5e113 Jul 07 17:24:17 devstack sudo[94146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:17 devstack sudo[94137]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9d44eb9a-3322-4341-b42b-8fdc15e7c7c7 tempest-VolumesActionsTest-1324430718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5d79d99d-f1e5-44f0-9925-c510044226bd" returned: 0 in 0.894s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9d44eb9a-3322-4341-b42b-8fdc15e7c7c7 tempest-VolumesActionsTest-1324430718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5d79d99d-f1e5-44f0-9925-c510044226bd {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:17 devstack sudo[94151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5d79d99d-f1e5-44f0-9925-c510044226bd Jul 07 17:24:17 devstack sudo[94151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:18 devstack sudo[94146]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-f9c01ccd-8262-4de7-9b61-f33cef491156 req-8a094e50-e233-4d06-83ed-ca648a1b2d80 tempest-VolumesSnapshotsTestJSON-1744798236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6f87dbfe-2754-4121-9474-a81cf04e9579.71273301-6fb6-4ccc-bf25-0f88f8b5e113" returned: 0 in 0.759s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:18 devstack sudo[94144]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-16e6262f-44c9-4306-9132-c985d9d36d91 tempest-SnapshotsActionsTest-1129268036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.814s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:18 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-16e6262f-44c9-4306-9132-c985d9d36d91 tempest-SnapshotsActionsTest-1129268036 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:24:18 devstack cinder-volume[87233]: DEBUG cinder.coordination [req-f9c01ccd-8262-4de7-9b61-f33cef491156 req-8a094e50-e233-4d06-83ed-ca648a1b2d80 tempest-VolumesSnapshotsTestJSON-1744798236 None] Lock "cinder-quobyte-71273301-6fb6-4ccc-bf25-0f88f8b5e113" released by "_delete_snapshot" :: held 3.732s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:18 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-16e6262f-44c9-4306-9132-c985d9d36d91 tempest-SnapshotsActionsTest-1129268036 None] Deleted volume successfully. Jul 07 17:24:18 devstack cinder-volume[87233]: DEBUG cinder.coordination [req-f9c01ccd-8262-4de7-9b61-f33cef491156 req-8a094e50-e233-4d06-83ed-ca648a1b2d80 tempest-VolumesSnapshotsTestJSON-1744798236 None] Lock "cinder-quobyte-6f87dbfe-2754-4121-9474-a81cf04e9579" released by "delete_snapshot" :: held 3.788s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:18 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-16e6262f-44c9-4306-9132-c985d9d36d91 tempest-SnapshotsActionsTest-1129268036 None] Lock "cinder-225b299e-fe3e-4903-821a-c7dc2c297238-delete_volume" released by "delete_volume" :: held 2.914s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:18 devstack cinder-volume[87233]: DEBUG cinder.quota [req-f9c01ccd-8262-4de7-9b61-f33cef491156 req-8a094e50-e233-4d06-83ed-ca648a1b2d80 tempest-VolumesSnapshotsTestJSON-1744798236 None] Created reservations ['b3c1501e-7f21-4a62-baf6-6e5cfcbd2f81', '72a54f38-0a2c-4f2f-81c3-5d43be0855e4', 'c3cb0588-9243-41d2-9240-2d1244cdd7f6', 'f5077d25-9dca-4091-92fd-d79741c45310'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:24:18 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-f9c01ccd-8262-4de7-9b61-f33cef491156 req-8a094e50-e233-4d06-83ed-ca648a1b2d80 tempest-VolumesSnapshotsTestJSON-1744798236 None] Delete snapshot completed successfully. Jul 07 17:24:18 devstack sudo[94151]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9d44eb9a-3322-4341-b42b-8fdc15e7c7c7 tempest-VolumesActionsTest-1324430718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5d79d99d-f1e5-44f0-9925-c510044226bd" returned: 0 in 0.803s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:18 devstack cinder-volume[87233]: DEBUG cinder.coordination [req-f9c01ccd-8262-4de7-9b61-f33cef491156 req-8a094e50-e233-4d06-83ed-ca648a1b2d80 tempest-VolumesSnapshotsTestJSON-1744798236 None] Lock "cinder-71273301-6fb6-4ccc-bf25-0f88f8b5e113-delete_snapshot" released by "delete_snapshot" :: held 3.973s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:18 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9d44eb9a-3322-4341-b42b-8fdc15e7c7c7 tempest-VolumesActionsTest-1324430718 None] Lock "cinder-quobyte-5d79d99d-f1e5-44f0-9925-c510044226bd" released by "delete_volume" :: held 1.756s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:18 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-9d44eb9a-3322-4341-b42b-8fdc15e7c7c7 tempest-VolumesActionsTest-1324430718 None] Created reservations ['e54736a8-7158-451d-a239-eb4926588af1', '1e979321-6a7f-49ac-adf2-01bd4dc9db3c', '4d3bbcdd-8d11-4ce2-a11b-66733adc353e', '357aa886-4968-4ea2-afe1-1bde10bf5738'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:24:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9d44eb9a-3322-4341-b42b-8fdc15e7c7c7 tempest-VolumesActionsTest-1324430718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9d44eb9a-3322-4341-b42b-8fdc15e7c7c7 tempest-VolumesActionsTest-1324430718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:18 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-9d44eb9a-3322-4341-b42b-8fdc15e7c7c7 tempest-VolumesActionsTest-1324430718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:24:18 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-9d44eb9a-3322-4341-b42b-8fdc15e7c7c7 tempest-VolumesActionsTest-1324430718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:24:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9d44eb9a-3322-4341-b42b-8fdc15e7c7c7 tempest-VolumesActionsTest-1324430718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9d44eb9a-3322-4341-b42b-8fdc15e7c7c7 tempest-VolumesActionsTest-1324430718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:18 devstack sudo[94156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:24:18 devstack sudo[94156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:19 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-3914a0da-ec4e-44c9-b288-37ad5164f363 req-abdb8d77-59e6-4c05-9e14-cab54454b808 tempest-ServerActionsTestOtherA-1544739102 None] Terminate volume connection completed successfully. Jul 07 17:24:19 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-3914a0da-ec4e-44c9-b288-37ad5164f363 req-abdb8d77-59e6-4c05-9e14-cab54454b808 tempest-ServerActionsTestOtherA-1544739102 None] Deleting attachment 168efdf0-bd7d-4c82-8eef-607fba30f077. {{(pid=87233) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:24:19 devstack cinder-volume[87233]: DEBUG cinder.coordination [req-f1bb1018-3a1d-4af9-8e9c-1824feb6539e req-5f936e69-acdc-4f6b-b89a-833d2a29c204 tempest-VolumesSnapshotsTestJSON-1744798236 None] Acquiring lock "cinder-6f87dbfe-2754-4121-9474-a81cf04e9579-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:19 devstack cinder-volume[87233]: DEBUG cinder.coordination [req-f1bb1018-3a1d-4af9-8e9c-1824feb6539e req-5f936e69-acdc-4f6b-b89a-833d2a29c204 tempest-VolumesSnapshotsTestJSON-1744798236 None] Lock "cinder-6f87dbfe-2754-4121-9474-a81cf04e9579-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:19 devstack cinder-volume[87233]: DEBUG cinder.coordination [req-f1bb1018-3a1d-4af9-8e9c-1824feb6539e req-5f936e69-acdc-4f6b-b89a-833d2a29c204 tempest-VolumesSnapshotsTestJSON-1744798236 None] Acquiring lock "cinder-quobyte-6f87dbfe-2754-4121-9474-a81cf04e9579" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:19 devstack cinder-volume[87233]: DEBUG cinder.coordination [req-f1bb1018-3a1d-4af9-8e9c-1824feb6539e req-5f936e69-acdc-4f6b-b89a-833d2a29c204 tempest-VolumesSnapshotsTestJSON-1744798236 None] Lock "cinder-quobyte-6f87dbfe-2754-4121-9474-a81cf04e9579" acquired by "delete_volume" :: waited 0.023s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:19 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[772a15f1-be06-4ec2-87d0-dea62fe0f37d]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-f1bb1018-3a1d-4af9-8e9c-1824feb6539e req-5f936e69-acdc-4f6b-b89a-833d2a29c204 tempest-VolumesSnapshotsTestJSON-1744798236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6f87dbfe-2754-4121-9474-a81cf04e9579 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:19 devstack sudo[94162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6f87dbfe-2754-4121-9474-a81cf04e9579 Jul 07 17:24:19 devstack sudo[94162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:19 devstack sudo[94156]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9d44eb9a-3322-4341-b42b-8fdc15e7c7c7 tempest-VolumesActionsTest-1324430718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.866s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:19 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-9d44eb9a-3322-4341-b42b-8fdc15e7c7c7 tempest-VolumesActionsTest-1324430718 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:24:19 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-9d44eb9a-3322-4341-b42b-8fdc15e7c7c7 tempest-VolumesActionsTest-1324430718 None] Deleted volume successfully. Jul 07 17:24:19 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9d44eb9a-3322-4341-b42b-8fdc15e7c7c7 tempest-VolumesActionsTest-1324430718 None] Lock "cinder-5d79d99d-f1e5-44f0-9925-c510044226bd-delete_volume" released by "delete_volume" :: held 2.938s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:19 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-931c0194-430b-4db3-a1fe-cc4e59022b16 tempest-VolumesActionsTest-30875521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:24:19 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-931c0194-430b-4db3-a1fe-cc4e59022b16 tempest-VolumesActionsTest-30875521 None] Flow 'volume_create_manager' (60a2a8f0-986f-4adc-b18f-5c9bb5e070b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:24:19 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-931c0194-430b-4db3-a1fe-cc4e59022b16 tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2bd0d05-aba4-4a0a-a2fc-e51f472f0675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:19 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-931c0194-430b-4db3-a1fe-cc4e59022b16 tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2bd0d05-aba4-4a0a-a2fc-e51f472f0675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1715351936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79da1aff-37aa-4970-914b-1936fc6af02e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f6d3d3242cc4a0985413eb44decf459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:24:20Z,use_quota=True,user_id='3ad1ec1148104bd3b691c7bc15118fd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:19 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-931c0194-430b-4db3-a1fe-cc4e59022b16 tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fc8f19a-e9b7-450b-b226-bd1decf511be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:19 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-931c0194-430b-4db3-a1fe-cc4e59022b16 tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fc8f19a-e9b7-450b-b226-bd1decf511be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:19 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-931c0194-430b-4db3-a1fe-cc4e59022b16 tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f400483a-a70b-4567-b337-d2833861856f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:19 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-931c0194-430b-4db3-a1fe-cc4e59022b16 tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f400483a-a70b-4567-b337-d2833861856f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79da1aff-37aa-4970-914b-1936fc6af02e', 'volume_name': 'volume-79da1aff-37aa-4970-914b-1936fc6af02e', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:19 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-931c0194-430b-4db3-a1fe-cc4e59022b16 tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29b8e7ee-d3c2-4e88-a322-8858c5464a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:19 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-931c0194-430b-4db3-a1fe-cc4e59022b16 tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29b8e7ee-d3c2-4e88-a322-8858c5464a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:19 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-931c0194-430b-4db3-a1fe-cc4e59022b16 tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af4ac0a1-6802-478e-adb5-15b26f8771d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:19 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-931c0194-430b-4db3-a1fe-cc4e59022b16 tempest-VolumesActionsTest-30875521 None] Volume 79da1aff-37aa-4970-914b-1936fc6af02e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79da1aff-37aa-4970-914b-1936fc6af02e', 'volume_size': 1} Jul 07 17:24:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-931c0194-430b-4db3-a1fe-cc4e59022b16 tempest-VolumesActionsTest-30875521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-931c0194-430b-4db3-a1fe-cc4e59022b16 tempest-VolumesActionsTest-30875521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:19 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-931c0194-430b-4db3-a1fe-cc4e59022b16 tempest-VolumesActionsTest-30875521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1715351936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79da1aff-37aa-4970-914b-1936fc6af02e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f6d3d3242cc4a0985413eb44decf459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:24:20Z,use_quota=True,user_id='3ad1ec1148104bd3b691c7bc15118fd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:24:19 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-931c0194-430b-4db3-a1fe-cc4e59022b16 tempest-VolumesActionsTest-30875521 None] Creating volume 79da1aff-37aa-4970-914b-1936fc6af02e {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:24:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-931c0194-430b-4db3-a1fe-cc4e59022b16 tempest-VolumesActionsTest-30875521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-931c0194-430b-4db3-a1fe-cc4e59022b16 tempest-VolumesActionsTest-30875521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:19 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-931c0194-430b-4db3-a1fe-cc4e59022b16 tempest-VolumesActionsTest-30875521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:24:19 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-931c0194-430b-4db3-a1fe-cc4e59022b16 tempest-VolumesActionsTest-30875521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:24:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-931c0194-430b-4db3-a1fe-cc4e59022b16 tempest-VolumesActionsTest-30875521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:19 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-931c0194-430b-4db3-a1fe-cc4e59022b16 tempest-VolumesActionsTest-30875521 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:24:19 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-931c0194-430b-4db3-a1fe-cc4e59022b16 tempest-VolumesActionsTest-30875521 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:24:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-931c0194-430b-4db3-a1fe-cc4e59022b16 tempest-VolumesActionsTest-30875521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-79da1aff-37aa-4970-914b-1936fc6af02e 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:19 devstack sudo[94166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-79da1aff-37aa-4970-914b-1936fc6af02e 1073741824 Jul 07 17:24:19 devstack sudo[94166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:20 devstack sudo[94162]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-f1bb1018-3a1d-4af9-8e9c-1824feb6539e req-5f936e69-acdc-4f6b-b89a-833d2a29c204 tempest-VolumesSnapshotsTestJSON-1744798236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6f87dbfe-2754-4121-9474-a81cf04e9579" returned: 0 in 1.001s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-f1bb1018-3a1d-4af9-8e9c-1824feb6539e req-5f936e69-acdc-4f6b-b89a-833d2a29c204 tempest-VolumesSnapshotsTestJSON-1744798236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6f87dbfe-2754-4121-9474-a81cf04e9579 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:20 devstack sudo[94177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6f87dbfe-2754-4121-9474-a81cf04e9579 Jul 07 17:24:20 devstack sudo[94177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:20 devstack sudo[94166]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-931c0194-430b-4db3-a1fe-cc4e59022b16 tempest-VolumesActionsTest-30875521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-79da1aff-37aa-4970-914b-1936fc6af02e 1073741824" returned: 0 in 1.045s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-931c0194-430b-4db3-a1fe-cc4e59022b16 tempest-VolumesActionsTest-30875521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-79da1aff-37aa-4970-914b-1936fc6af02e {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:21 devstack sudo[94185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-79da1aff-37aa-4970-914b-1936fc6af02e Jul 07 17:24:21 devstack sudo[94185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:21 devstack sudo[94177]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-f1bb1018-3a1d-4af9-8e9c-1824feb6539e req-5f936e69-acdc-4f6b-b89a-833d2a29c204 tempest-VolumesSnapshotsTestJSON-1744798236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6f87dbfe-2754-4121-9474-a81cf04e9579" returned: 0 in 0.803s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:21 devstack cinder-volume[87233]: DEBUG cinder.coordination [req-f1bb1018-3a1d-4af9-8e9c-1824feb6539e req-5f936e69-acdc-4f6b-b89a-833d2a29c204 tempest-VolumesSnapshotsTestJSON-1744798236 None] Lock "cinder-quobyte-6f87dbfe-2754-4121-9474-a81cf04e9579" released by "delete_volume" :: held 1.886s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:21 devstack cinder-volume[87233]: DEBUG cinder.quota [req-f1bb1018-3a1d-4af9-8e9c-1824feb6539e req-5f936e69-acdc-4f6b-b89a-833d2a29c204 tempest-VolumesSnapshotsTestJSON-1744798236 None] Created reservations ['88a048af-f0fc-4463-9b50-9621c9f16f07', '6b82a8c2-14f3-4d88-a310-ef4f7cbba44f', 'cfe26ddc-9349-44b7-9d83-3a80e270d261', '7b7a60de-0c62-45f5-b8c9-08a8d7dead1b'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:24:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-f1bb1018-3a1d-4af9-8e9c-1824feb6539e req-5f936e69-acdc-4f6b-b89a-833d2a29c204 tempest-VolumesSnapshotsTestJSON-1744798236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-f1bb1018-3a1d-4af9-8e9c-1824feb6539e req-5f936e69-acdc-4f6b-b89a-833d2a29c204 tempest-VolumesSnapshotsTestJSON-1744798236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:21 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [req-f1bb1018-3a1d-4af9-8e9c-1824feb6539e req-5f936e69-acdc-4f6b-b89a-833d2a29c204 tempest-VolumesSnapshotsTestJSON-1744798236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:24:21 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [req-f1bb1018-3a1d-4af9-8e9c-1824feb6539e req-5f936e69-acdc-4f6b-b89a-833d2a29c204 tempest-VolumesSnapshotsTestJSON-1744798236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:24:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-f1bb1018-3a1d-4af9-8e9c-1824feb6539e req-5f936e69-acdc-4f6b-b89a-833d2a29c204 tempest-VolumesSnapshotsTestJSON-1744798236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-f1bb1018-3a1d-4af9-8e9c-1824feb6539e req-5f936e69-acdc-4f6b-b89a-833d2a29c204 tempest-VolumesSnapshotsTestJSON-1744798236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:21 devstack sudo[94187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:24:21 devstack sudo[94187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:21 devstack sudo[94185]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-931c0194-430b-4db3-a1fe-cc4e59022b16 tempest-VolumesActionsTest-30875521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-79da1aff-37aa-4970-914b-1936fc6af02e" returned: 0 in 0.761s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:21 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-931c0194-430b-4db3-a1fe-cc4e59022b16 tempest-VolumesActionsTest-30875521 None] <== create_volume: return (1854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:24:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-931c0194-430b-4db3-a1fe-cc4e59022b16 tempest-VolumesActionsTest-30875521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.856s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:21 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-931c0194-430b-4db3-a1fe-cc4e59022b16 tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af4ac0a1-6802-478e-adb5-15b26f8771d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79da1aff-37aa-4970-914b-1936fc6af02e', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:21 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-931c0194-430b-4db3-a1fe-cc4e59022b16 tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc737022-c835-4212-ba4d-1da58c8924e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:21 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-931c0194-430b-4db3-a1fe-cc4e59022b16 tempest-VolumesActionsTest-30875521 None] Volume volume-79da1aff-37aa-4970-914b-1936fc6af02e (79da1aff-37aa-4970-914b-1936fc6af02e): created successfully Jul 07 17:24:21 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-931c0194-430b-4db3-a1fe-cc4e59022b16 tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc737022-c835-4212-ba4d-1da58c8924e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:21 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-931c0194-430b-4db3-a1fe-cc4e59022b16 tempest-VolumesActionsTest-30875521 None] Flow 'volume_create_manager' (60a2a8f0-986f-4adc-b18f-5c9bb5e070b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:24:21 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-931c0194-430b-4db3-a1fe-cc4e59022b16 tempest-VolumesActionsTest-30875521 None] Created volume successfully. Jul 07 17:24:22 devstack sudo[94187]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-f1bb1018-3a1d-4af9-8e9c-1824feb6539e req-5f936e69-acdc-4f6b-b89a-833d2a29c204 tempest-VolumesSnapshotsTestJSON-1744798236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.758s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:22 devstack cinder-volume[87233]: DEBUG cinder.manager [req-f1bb1018-3a1d-4af9-8e9c-1824feb6539e req-5f936e69-acdc-4f6b-b89a-833d2a29c204 tempest-VolumesSnapshotsTestJSON-1744798236 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:24:22 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-f1bb1018-3a1d-4af9-8e9c-1824feb6539e req-5f936e69-acdc-4f6b-b89a-833d2a29c204 tempest-VolumesSnapshotsTestJSON-1744798236 None] Deleted volume successfully. Jul 07 17:24:22 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:SELECT=127,cinder:UPDATE=144,cinder:DELETE=10,cinder:INSERT=36 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:24:22 devstack cinder-volume[87233]: DEBUG cinder.coordination [req-f1bb1018-3a1d-4af9-8e9c-1824feb6539e req-5f936e69-acdc-4f6b-b89a-833d2a29c204 tempest-VolumesSnapshotsTestJSON-1744798236 None] Lock "cinder-6f87dbfe-2754-4121-9474-a81cf04e9579-delete_volume" released by "delete_volume" :: held 2.959s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:23 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-286df929-1236-4a91-bf19-b6db944451d3 tempest-VolumesActionsTest-1324430718 None] Acquiring lock "cinder-79da1aff-37aa-4970-914b-1936fc6af02e-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:23 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-286df929-1236-4a91-bf19-b6db944451d3 tempest-VolumesActionsTest-1324430718 None] Lock "cinder-79da1aff-37aa-4970-914b-1936fc6af02e-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:23 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:SELECT=133,cinder:UPDATE=131,cinder:INSERT=34,cinder:DELETE=11 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:24:23 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-286df929-1236-4a91-bf19-b6db944451d3 tempest-VolumesActionsTest-1324430718 None] Acquiring lock "cinder-quobyte-79da1aff-37aa-4970-914b-1936fc6af02e" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:23 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-286df929-1236-4a91-bf19-b6db944451d3 tempest-VolumesActionsTest-1324430718 None] Lock "cinder-quobyte-79da1aff-37aa-4970-914b-1936fc6af02e" acquired by "delete_volume" :: waited 0.024s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:23 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec423e5d-1352-4ae8-bc90-6db2e7b157f0]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-286df929-1236-4a91-bf19-b6db944451d3 tempest-VolumesActionsTest-1324430718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-79da1aff-37aa-4970-914b-1936fc6af02e {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:23 devstack sudo[94215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-79da1aff-37aa-4970-914b-1936fc6af02e Jul 07 17:24:23 devstack sudo[94215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:24 devstack sudo[94215]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-286df929-1236-4a91-bf19-b6db944451d3 tempest-VolumesActionsTest-1324430718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-79da1aff-37aa-4970-914b-1936fc6af02e" returned: 0 in 1.154s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-286df929-1236-4a91-bf19-b6db944451d3 tempest-VolumesActionsTest-1324430718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-79da1aff-37aa-4970-914b-1936fc6af02e {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:24 devstack sudo[94225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-79da1aff-37aa-4970-914b-1936fc6af02e Jul 07 17:24:24 devstack sudo[94225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:24 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba306e8d-5c3b-428e-91f8-c4f4105bbac5 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:24:24 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ba306e8d-5c3b-428e-91f8-c4f4105bbac5 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] Flow 'volume_create_manager' (d5257c2d-c094-471f-b85d-2be07e21eece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:24:25 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ba306e8d-5c3b-428e-91f8-c4f4105bbac5 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cca1868d-085f-410e-a48c-f115f0577e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:25 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ba306e8d-5c3b-428e-91f8-c4f4105bbac5 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cca1868d-085f-410e-a48c-f115f0577e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-59105089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beaad1c2-1951-407b-80cf-d45150164c74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fd4a59cfcf94ee6ba1b0ec746c7c1e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:24:25Z,use_quota=True,user_id='c6ae33b005dd43db8c3f2cb8856a4bc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:25 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ba306e8d-5c3b-428e-91f8-c4f4105bbac5 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (373c80d4-dd87-4d2f-b7d4-e621182b665e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:25 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ba306e8d-5c3b-428e-91f8-c4f4105bbac5 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (373c80d4-dd87-4d2f-b7d4-e621182b665e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:25 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ba306e8d-5c3b-428e-91f8-c4f4105bbac5 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b21e036-baa6-47a4-a7b7-bca3f622c0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:25 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ba306e8d-5c3b-428e-91f8-c4f4105bbac5 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b21e036-baa6-47a4-a7b7-bca3f622c0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beaad1c2-1951-407b-80cf-d45150164c74', 'volume_name': 'volume-beaad1c2-1951-407b-80cf-d45150164c74', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:25 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ba306e8d-5c3b-428e-91f8-c4f4105bbac5 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad5858f3-36e4-4b3a-b328-731b5ba93d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:25 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ba306e8d-5c3b-428e-91f8-c4f4105bbac5 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad5858f3-36e4-4b3a-b328-731b5ba93d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:25 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ba306e8d-5c3b-428e-91f8-c4f4105bbac5 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad25a392-33c6-4623-8a8d-3eb5fe6a7262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:25 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-ba306e8d-5c3b-428e-91f8-c4f4105bbac5 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] Volume beaad1c2-1951-407b-80cf-d45150164c74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beaad1c2-1951-407b-80cf-d45150164c74', 'volume_size': 1} Jul 07 17:24:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ba306e8d-5c3b-428e-91f8-c4f4105bbac5 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ba306e8d-5c3b-428e-91f8-c4f4105bbac5 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:25 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ba306e8d-5c3b-428e-91f8-c4f4105bbac5 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-59105089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beaad1c2-1951-407b-80cf-d45150164c74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fd4a59cfcf94ee6ba1b0ec746c7c1e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:24:25Z,use_quota=True,user_id='c6ae33b005dd43db8c3f2cb8856a4bc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:24:25 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-ba306e8d-5c3b-428e-91f8-c4f4105bbac5 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] Creating volume beaad1c2-1951-407b-80cf-d45150164c74 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:24:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ba306e8d-5c3b-428e-91f8-c4f4105bbac5 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ba306e8d-5c3b-428e-91f8-c4f4105bbac5 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:25 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ba306e8d-5c3b-428e-91f8-c4f4105bbac5 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:24:25 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ba306e8d-5c3b-428e-91f8-c4f4105bbac5 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:24:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ba306e8d-5c3b-428e-91f8-c4f4105bbac5 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:25 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ba306e8d-5c3b-428e-91f8-c4f4105bbac5 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:24:25 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-ba306e8d-5c3b-428e-91f8-c4f4105bbac5 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:24:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ba306e8d-5c3b-428e-91f8-c4f4105bbac5 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-beaad1c2-1951-407b-80cf-d45150164c74 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:25 devstack sudo[94228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-beaad1c2-1951-407b-80cf-d45150164c74 1073741824 Jul 07 17:24:25 devstack sudo[94228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:25 devstack sudo[94225]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-286df929-1236-4a91-bf19-b6db944451d3 tempest-VolumesActionsTest-1324430718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-79da1aff-37aa-4970-914b-1936fc6af02e" returned: 0 in 0.816s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:25 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-286df929-1236-4a91-bf19-b6db944451d3 tempest-VolumesActionsTest-1324430718 None] Lock "cinder-quobyte-79da1aff-37aa-4970-914b-1936fc6af02e" released by "delete_volume" :: held 2.037s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:25 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-286df929-1236-4a91-bf19-b6db944451d3 tempest-VolumesActionsTest-1324430718 None] Created reservations ['a92558f5-a078-422f-9777-0cbdf2da01c7', '2e8715a7-71b0-4fec-bbc9-d0e4eb0f40b2', 'af409be7-d6f1-4fdb-8d38-ebced5a9a09d', 'f70f93db-4849-4e56-8e21-a6c98f73f8b2'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:24:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-286df929-1236-4a91-bf19-b6db944451d3 tempest-VolumesActionsTest-1324430718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-286df929-1236-4a91-bf19-b6db944451d3 tempest-VolumesActionsTest-1324430718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:25 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-286df929-1236-4a91-bf19-b6db944451d3 tempest-VolumesActionsTest-1324430718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:24:25 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-286df929-1236-4a91-bf19-b6db944451d3 tempest-VolumesActionsTest-1324430718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:24:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-286df929-1236-4a91-bf19-b6db944451d3 tempest-VolumesActionsTest-1324430718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-286df929-1236-4a91-bf19-b6db944451d3 tempest-VolumesActionsTest-1324430718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:25 devstack sudo[94234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:24:25 devstack sudo[94234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:26 devstack sudo[94228]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ba306e8d-5c3b-428e-91f8-c4f4105bbac5 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-beaad1c2-1951-407b-80cf-d45150164c74 1073741824" returned: 0 in 1.012s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ba306e8d-5c3b-428e-91f8-c4f4105bbac5 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-beaad1c2-1951-407b-80cf-d45150164c74 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:26 devstack sudo[94236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-beaad1c2-1951-407b-80cf-d45150164c74 Jul 07 17:24:26 devstack sudo[94236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:26 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3390298-07d6-41ad-8111-ce8ea33f13db tempest-VolumesActionsTest-30875521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:24:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b3390298-07d6-41ad-8111-ce8ea33f13db tempest-VolumesActionsTest-30875521 None] Flow 'volume_create_manager' (67c68d46-3f8d-4d58-b250-572a3fe47725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:24:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b3390298-07d6-41ad-8111-ce8ea33f13db tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40c1329c-f312-4342-a476-8a9f3521b198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b3390298-07d6-41ad-8111-ce8ea33f13db tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40c1329c-f312-4342-a476-8a9f3521b198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-465002930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceca7cfd-9786-4350-97e7-3d6584cd83ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f6d3d3242cc4a0985413eb44decf459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:24:26Z,use_quota=True,user_id='3ad1ec1148104bd3b691c7bc15118fd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:26 devstack sudo[94234]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b3390298-07d6-41ad-8111-ce8ea33f13db tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e54adc70-1353-4614-92ed-9a402b3f5a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b3390298-07d6-41ad-8111-ce8ea33f13db tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e54adc70-1353-4614-92ed-9a402b3f5a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b3390298-07d6-41ad-8111-ce8ea33f13db tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d136f15f-b5c4-4c20-839c-8d2d06ab8edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b3390298-07d6-41ad-8111-ce8ea33f13db tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d136f15f-b5c4-4c20-839c-8d2d06ab8edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ceca7cfd-9786-4350-97e7-3d6584cd83ca', 'volume_name': 'volume-ceca7cfd-9786-4350-97e7-3d6584cd83ca', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b3390298-07d6-41ad-8111-ce8ea33f13db tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (729042d0-0a44-40fc-81b4-bfcc78722920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b3390298-07d6-41ad-8111-ce8ea33f13db tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (729042d0-0a44-40fc-81b4-bfcc78722920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b3390298-07d6-41ad-8111-ce8ea33f13db tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b71ce9ca-7358-4cb2-add8-ae393b42c845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:26 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-b3390298-07d6-41ad-8111-ce8ea33f13db tempest-VolumesActionsTest-30875521 None] Volume ceca7cfd-9786-4350-97e7-3d6584cd83ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ceca7cfd-9786-4350-97e7-3d6584cd83ca', 'volume_size': 1} Jul 07 17:24:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b3390298-07d6-41ad-8111-ce8ea33f13db tempest-VolumesActionsTest-30875521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-286df929-1236-4a91-bf19-b6db944451d3 tempest-VolumesActionsTest-1324430718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.939s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:26 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-286df929-1236-4a91-bf19-b6db944451d3 tempest-VolumesActionsTest-1324430718 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:24:26 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-286df929-1236-4a91-bf19-b6db944451d3 tempest-VolumesActionsTest-1324430718 None] Deleted volume successfully. Jul 07 17:24:26 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-286df929-1236-4a91-bf19-b6db944451d3 tempest-VolumesActionsTest-1324430718 None] Lock "cinder-79da1aff-37aa-4970-914b-1936fc6af02e-delete_volume" released by "delete_volume" :: held 3.255s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:26 devstack sudo[94236]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ba306e8d-5c3b-428e-91f8-c4f4105bbac5 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-beaad1c2-1951-407b-80cf-d45150164c74" returned: 0 in 0.728s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:26 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ba306e8d-5c3b-428e-91f8-c4f4105bbac5 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] <== create_volume: return (1828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:24:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ba306e8d-5c3b-428e-91f8-c4f4105bbac5 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.830s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b3390298-07d6-41ad-8111-ce8ea33f13db tempest-VolumesActionsTest-30875521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.280s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:26 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b3390298-07d6-41ad-8111-ce8ea33f13db tempest-VolumesActionsTest-30875521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-465002930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceca7cfd-9786-4350-97e7-3d6584cd83ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f6d3d3242cc4a0985413eb44decf459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:24:26Z,use_quota=True,user_id='3ad1ec1148104bd3b691c7bc15118fd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:24:26 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-b3390298-07d6-41ad-8111-ce8ea33f13db tempest-VolumesActionsTest-30875521 None] Creating volume ceca7cfd-9786-4350-97e7-3d6584cd83ca {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:24:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b3390298-07d6-41ad-8111-ce8ea33f13db tempest-VolumesActionsTest-30875521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b3390298-07d6-41ad-8111-ce8ea33f13db tempest-VolumesActionsTest-30875521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:26 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b3390298-07d6-41ad-8111-ce8ea33f13db tempest-VolumesActionsTest-30875521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:24:26 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b3390298-07d6-41ad-8111-ce8ea33f13db tempest-VolumesActionsTest-30875521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:24:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b3390298-07d6-41ad-8111-ce8ea33f13db tempest-VolumesActionsTest-30875521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:26 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b3390298-07d6-41ad-8111-ce8ea33f13db tempest-VolumesActionsTest-30875521 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:24:26 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-b3390298-07d6-41ad-8111-ce8ea33f13db tempest-VolumesActionsTest-30875521 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:24:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b3390298-07d6-41ad-8111-ce8ea33f13db tempest-VolumesActionsTest-30875521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ceca7cfd-9786-4350-97e7-3d6584cd83ca 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:26 devstack sudo[94240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ceca7cfd-9786-4350-97e7-3d6584cd83ca 1073741824 Jul 07 17:24:26 devstack sudo[94240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ba306e8d-5c3b-428e-91f8-c4f4105bbac5 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad25a392-33c6-4623-8a8d-3eb5fe6a7262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beaad1c2-1951-407b-80cf-d45150164c74', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ba306e8d-5c3b-428e-91f8-c4f4105bbac5 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (082b3291-d396-4dd0-a90b-4ad5cc9523f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:26 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-ba306e8d-5c3b-428e-91f8-c4f4105bbac5 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] Volume volume-beaad1c2-1951-407b-80cf-d45150164c74 (beaad1c2-1951-407b-80cf-d45150164c74): created successfully Jul 07 17:24:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ba306e8d-5c3b-428e-91f8-c4f4105bbac5 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (082b3291-d396-4dd0-a90b-4ad5cc9523f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ba306e8d-5c3b-428e-91f8-c4f4105bbac5 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] Flow 'volume_create_manager' (d5257c2d-c094-471f-b85d-2be07e21eece) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:24:26 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-ba306e8d-5c3b-428e-91f8-c4f4105bbac5 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] Created volume successfully. Jul 07 17:24:27 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [req-7da2b53d-508e-414f-8cca-a2dacad3d4c5 req-a6651486-27c9-4ad9-b068-f82f476da275 tempest-VolumesGetTestJSON-1934992279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:24:27 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-7da2b53d-508e-414f-8cca-a2dacad3d4c5 req-a6651486-27c9-4ad9-b068-f82f476da275 tempest-VolumesGetTestJSON-1934992279 None] Flow 'volume_create_manager' (8716f4eb-7940-4ab3-9419-b3865872b352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:24:27 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-7da2b53d-508e-414f-8cca-a2dacad3d4c5 req-a6651486-27c9-4ad9-b068-f82f476da275 tempest-VolumesGetTestJSON-1934992279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a002e74-6bc7-4834-8a9f-5f19b1b1e63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:27 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-7da2b53d-508e-414f-8cca-a2dacad3d4c5 req-a6651486-27c9-4ad9-b068-f82f476da275 tempest-VolumesGetTestJSON-1934992279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a002e74-6bc7-4834-8a9f-5f19b1b1e63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1156205761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e69b6458-384a-4876-91c1-ca8513df1ba0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b92c0f11b1a44f85be29cf22e045de42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:24:27Z,use_quota=True,user_id='1e598f0539e7460a8ac334a32e513118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:27 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-7da2b53d-508e-414f-8cca-a2dacad3d4c5 req-a6651486-27c9-4ad9-b068-f82f476da275 tempest-VolumesGetTestJSON-1934992279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (359f977a-44cb-4681-8ca4-248e725a4186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:27 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-7da2b53d-508e-414f-8cca-a2dacad3d4c5 req-a6651486-27c9-4ad9-b068-f82f476da275 tempest-VolumesGetTestJSON-1934992279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (359f977a-44cb-4681-8ca4-248e725a4186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:27 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-7da2b53d-508e-414f-8cca-a2dacad3d4c5 req-a6651486-27c9-4ad9-b068-f82f476da275 tempest-VolumesGetTestJSON-1934992279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acc833cc-2445-419a-b4ee-499f34952ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:27 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-7da2b53d-508e-414f-8cca-a2dacad3d4c5 req-a6651486-27c9-4ad9-b068-f82f476da275 tempest-VolumesGetTestJSON-1934992279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acc833cc-2445-419a-b4ee-499f34952ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e69b6458-384a-4876-91c1-ca8513df1ba0', 'volume_name': 'volume-e69b6458-384a-4876-91c1-ca8513df1ba0', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:27 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-7da2b53d-508e-414f-8cca-a2dacad3d4c5 req-a6651486-27c9-4ad9-b068-f82f476da275 tempest-VolumesGetTestJSON-1934992279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dab99dd-ac29-4e2d-b482-b0d3d8a09581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:27 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-7da2b53d-508e-414f-8cca-a2dacad3d4c5 req-a6651486-27c9-4ad9-b068-f82f476da275 tempest-VolumesGetTestJSON-1934992279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dab99dd-ac29-4e2d-b482-b0d3d8a09581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:27 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-7da2b53d-508e-414f-8cca-a2dacad3d4c5 req-a6651486-27c9-4ad9-b068-f82f476da275 tempest-VolumesGetTestJSON-1934992279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bea7b58-6a08-474b-b981-77a2619273fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:27 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [req-7da2b53d-508e-414f-8cca-a2dacad3d4c5 req-a6651486-27c9-4ad9-b068-f82f476da275 tempest-VolumesGetTestJSON-1934992279 None] Volume e69b6458-384a-4876-91c1-ca8513df1ba0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e69b6458-384a-4876-91c1-ca8513df1ba0', 'volume_size': 1} Jul 07 17:24:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-7da2b53d-508e-414f-8cca-a2dacad3d4c5 req-a6651486-27c9-4ad9-b068-f82f476da275 tempest-VolumesGetTestJSON-1934992279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:27 devstack sudo[94240]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b3390298-07d6-41ad-8111-ce8ea33f13db tempest-VolumesActionsTest-30875521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ceca7cfd-9786-4350-97e7-3d6584cd83ca 1073741824" returned: 0 in 0.883s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b3390298-07d6-41ad-8111-ce8ea33f13db tempest-VolumesActionsTest-30875521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ceca7cfd-9786-4350-97e7-3d6584cd83ca {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:27 devstack sudo[94246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ceca7cfd-9786-4350-97e7-3d6584cd83ca Jul 07 17:24:27 devstack sudo[94246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:28 devstack sudo[94246]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b3390298-07d6-41ad-8111-ce8ea33f13db tempest-VolumesActionsTest-30875521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ceca7cfd-9786-4350-97e7-3d6584cd83ca" returned: 0 in 0.663s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:28 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b3390298-07d6-41ad-8111-ce8ea33f13db tempest-VolumesActionsTest-30875521 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:24:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b3390298-07d6-41ad-8111-ce8ea33f13db tempest-VolumesActionsTest-30875521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-7da2b53d-508e-414f-8cca-a2dacad3d4c5 req-a6651486-27c9-4ad9-b068-f82f476da275 tempest-VolumesGetTestJSON-1934992279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.986s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:28 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [req-7da2b53d-508e-414f-8cca-a2dacad3d4c5 req-a6651486-27c9-4ad9-b068-f82f476da275 tempest-VolumesGetTestJSON-1934992279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1156205761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e69b6458-384a-4876-91c1-ca8513df1ba0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b92c0f11b1a44f85be29cf22e045de42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:24:27Z,use_quota=True,user_id='1e598f0539e7460a8ac334a32e513118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:24:28 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [req-7da2b53d-508e-414f-8cca-a2dacad3d4c5 req-a6651486-27c9-4ad9-b068-f82f476da275 tempest-VolumesGetTestJSON-1934992279 None] Creating volume e69b6458-384a-4876-91c1-ca8513df1ba0 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:24:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-7da2b53d-508e-414f-8cca-a2dacad3d4c5 req-a6651486-27c9-4ad9-b068-f82f476da275 tempest-VolumesGetTestJSON-1934992279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-7da2b53d-508e-414f-8cca-a2dacad3d4c5 req-a6651486-27c9-4ad9-b068-f82f476da275 tempest-VolumesGetTestJSON-1934992279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:28 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [req-7da2b53d-508e-414f-8cca-a2dacad3d4c5 req-a6651486-27c9-4ad9-b068-f82f476da275 tempest-VolumesGetTestJSON-1934992279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:24:28 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [req-7da2b53d-508e-414f-8cca-a2dacad3d4c5 req-a6651486-27c9-4ad9-b068-f82f476da275 tempest-VolumesGetTestJSON-1934992279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:24:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-7da2b53d-508e-414f-8cca-a2dacad3d4c5 req-a6651486-27c9-4ad9-b068-f82f476da275 tempest-VolumesGetTestJSON-1934992279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:28 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [req-7da2b53d-508e-414f-8cca-a2dacad3d4c5 req-a6651486-27c9-4ad9-b068-f82f476da275 tempest-VolumesGetTestJSON-1934992279 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:24:28 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [req-7da2b53d-508e-414f-8cca-a2dacad3d4c5 req-a6651486-27c9-4ad9-b068-f82f476da275 tempest-VolumesGetTestJSON-1934992279 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:24:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-7da2b53d-508e-414f-8cca-a2dacad3d4c5 req-a6651486-27c9-4ad9-b068-f82f476da275 tempest-VolumesGetTestJSON-1934992279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e69b6458-384a-4876-91c1-ca8513df1ba0 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:28 devstack sudo[94249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e69b6458-384a-4876-91c1-ca8513df1ba0 1073741824 Jul 07 17:24:28 devstack sudo[94249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:28 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b3390298-07d6-41ad-8111-ce8ea33f13db tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b71ce9ca-7358-4cb2-add8-ae393b42c845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ceca7cfd-9786-4350-97e7-3d6584cd83ca', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:28 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b3390298-07d6-41ad-8111-ce8ea33f13db tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c65e139f-2b3a-4106-be25-2867460759b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:28 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-b3390298-07d6-41ad-8111-ce8ea33f13db tempest-VolumesActionsTest-30875521 None] Volume volume-ceca7cfd-9786-4350-97e7-3d6584cd83ca (ceca7cfd-9786-4350-97e7-3d6584cd83ca): created successfully Jul 07 17:24:28 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b3390298-07d6-41ad-8111-ce8ea33f13db tempest-VolumesActionsTest-30875521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c65e139f-2b3a-4106-be25-2867460759b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:28 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b3390298-07d6-41ad-8111-ce8ea33f13db tempest-VolumesActionsTest-30875521 None] Flow 'volume_create_manager' (67c68d46-3f8d-4d58-b250-572a3fe47725) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:24:28 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-b3390298-07d6-41ad-8111-ce8ea33f13db tempest-VolumesActionsTest-30875521 None] Created volume successfully. Jul 07 17:24:29 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3fc1b8c7-52ff-4e68-b630-438ef06f8485 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] Acquiring lock "cinder-beaad1c2-1951-407b-80cf-d45150164c74-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:29 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3fc1b8c7-52ff-4e68-b630-438ef06f8485 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] Lock "cinder-beaad1c2-1951-407b-80cf-d45150164c74-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:29 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3fc1b8c7-52ff-4e68-b630-438ef06f8485 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] Acquiring lock "cinder-quobyte-beaad1c2-1951-407b-80cf-d45150164c74" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:29 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3fc1b8c7-52ff-4e68-b630-438ef06f8485 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] Lock "cinder-quobyte-beaad1c2-1951-407b-80cf-d45150164c74" acquired by "delete_volume" :: waited 0.015s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:29 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[45daf611-7c7a-497d-b1a2-ad4074ebd1f0]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3fc1b8c7-52ff-4e68-b630-438ef06f8485 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-beaad1c2-1951-407b-80cf-d45150164c74 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:29 devstack sudo[94255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-beaad1c2-1951-407b-80cf-d45150164c74 Jul 07 17:24:29 devstack sudo[94255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:29 devstack sudo[94249]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-7da2b53d-508e-414f-8cca-a2dacad3d4c5 req-a6651486-27c9-4ad9-b068-f82f476da275 tempest-VolumesGetTestJSON-1934992279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e69b6458-384a-4876-91c1-ca8513df1ba0 1073741824" returned: 0 in 0.904s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-7da2b53d-508e-414f-8cca-a2dacad3d4c5 req-a6651486-27c9-4ad9-b068-f82f476da275 tempest-VolumesGetTestJSON-1934992279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e69b6458-384a-4876-91c1-ca8513df1ba0 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:29 devstack sudo[94257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e69b6458-384a-4876-91c1-ca8513df1ba0 Jul 07 17:24:29 devstack sudo[94257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:30 devstack sudo[94255]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3fc1b8c7-52ff-4e68-b630-438ef06f8485 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-beaad1c2-1951-407b-80cf-d45150164c74" returned: 0 in 0.868s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3fc1b8c7-52ff-4e68-b630-438ef06f8485 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-beaad1c2-1951-407b-80cf-d45150164c74 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:30 devstack sudo[94264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-beaad1c2-1951-407b-80cf-d45150164c74 Jul 07 17:24:30 devstack sudo[94264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:30 devstack sudo[94257]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-7da2b53d-508e-414f-8cca-a2dacad3d4c5 req-a6651486-27c9-4ad9-b068-f82f476da275 tempest-VolumesGetTestJSON-1934992279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e69b6458-384a-4876-91c1-ca8513df1ba0" returned: 0 in 0.755s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:30 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [req-7da2b53d-508e-414f-8cca-a2dacad3d4c5 req-a6651486-27c9-4ad9-b068-f82f476da275 tempest-VolumesGetTestJSON-1934992279 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:24:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-7da2b53d-508e-414f-8cca-a2dacad3d4c5 req-a6651486-27c9-4ad9-b068-f82f476da275 tempest-VolumesGetTestJSON-1934992279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.710s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:30 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-7da2b53d-508e-414f-8cca-a2dacad3d4c5 req-a6651486-27c9-4ad9-b068-f82f476da275 tempest-VolumesGetTestJSON-1934992279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bea7b58-6a08-474b-b981-77a2619273fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e69b6458-384a-4876-91c1-ca8513df1ba0', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:30 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-7da2b53d-508e-414f-8cca-a2dacad3d4c5 req-a6651486-27c9-4ad9-b068-f82f476da275 tempest-VolumesGetTestJSON-1934992279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb0e8f6d-4082-4f50-b7dc-3381b0f47b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:30 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [req-7da2b53d-508e-414f-8cca-a2dacad3d4c5 req-a6651486-27c9-4ad9-b068-f82f476da275 tempest-VolumesGetTestJSON-1934992279 None] Volume volume-e69b6458-384a-4876-91c1-ca8513df1ba0 (e69b6458-384a-4876-91c1-ca8513df1ba0): created successfully Jul 07 17:24:30 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-7da2b53d-508e-414f-8cca-a2dacad3d4c5 req-a6651486-27c9-4ad9-b068-f82f476da275 tempest-VolumesGetTestJSON-1934992279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb0e8f6d-4082-4f50-b7dc-3381b0f47b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:30 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-7da2b53d-508e-414f-8cca-a2dacad3d4c5 req-a6651486-27c9-4ad9-b068-f82f476da275 tempest-VolumesGetTestJSON-1934992279 None] Flow 'volume_create_manager' (8716f4eb-7940-4ab3-9419-b3865872b352) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:24:30 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-7da2b53d-508e-414f-8cca-a2dacad3d4c5 req-a6651486-27c9-4ad9-b068-f82f476da275 tempest-VolumesGetTestJSON-1934992279 None] Created volume successfully. Jul 07 17:24:30 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-30f41ac1-d0ec-4048-be93-573dc7a564c2 tempest-VolumesActionsTest-30875521 None] Acquiring lock "cinder-ceca7cfd-9786-4350-97e7-3d6584cd83ca-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:30 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-30f41ac1-d0ec-4048-be93-573dc7a564c2 tempest-VolumesActionsTest-30875521 None] Lock "cinder-ceca7cfd-9786-4350-97e7-3d6584cd83ca-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:30 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-10d0f47b-517b-4ab5-a0da-2d7911f048c6 tempest-ServerActionsTestOtherA-1544739102 None] Acquiring lock "cinder-c917cef4-2e9d-49b0-b74a-c67d8ddf006d-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:30 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-10d0f47b-517b-4ab5-a0da-2d7911f048c6 tempest-ServerActionsTestOtherA-1544739102 None] Lock "cinder-c917cef4-2e9d-49b0-b74a-c67d8ddf006d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:30 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-30f41ac1-d0ec-4048-be93-573dc7a564c2 tempest-VolumesActionsTest-30875521 None] Acquiring lock "cinder-quobyte-ceca7cfd-9786-4350-97e7-3d6584cd83ca" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:30 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-30f41ac1-d0ec-4048-be93-573dc7a564c2 tempest-VolumesActionsTest-30875521 None] Lock "cinder-quobyte-ceca7cfd-9786-4350-97e7-3d6584cd83ca" acquired by "delete_volume" :: waited 0.027s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:30 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-10d0f47b-517b-4ab5-a0da-2d7911f048c6 tempest-ServerActionsTestOtherA-1544739102 None] Acquiring lock "cinder-quobyte-c917cef4-2e9d-49b0-b74a-c67d8ddf006d" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:30 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-10d0f47b-517b-4ab5-a0da-2d7911f048c6 tempest-ServerActionsTestOtherA-1544739102 None] Lock "cinder-quobyte-c917cef4-2e9d-49b0-b74a-c67d8ddf006d" acquired by "delete_volume" :: waited 0.016s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:30 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67b0f07-b4f0-42f5-a2c4-c38f1322c527]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-30f41ac1-d0ec-4048-be93-573dc7a564c2 tempest-VolumesActionsTest-30875521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ceca7cfd-9786-4350-97e7-3d6584cd83ca {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:30 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a5089a-a355-4ccf-94aa-bf61e6e10eee]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-10d0f47b-517b-4ab5-a0da-2d7911f048c6 tempest-ServerActionsTestOtherA-1544739102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c917cef4-2e9d-49b0-b74a-c67d8ddf006d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:30 devstack sudo[94266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ceca7cfd-9786-4350-97e7-3d6584cd83ca Jul 07 17:24:30 devstack sudo[94266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:30 devstack sudo[94267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c917cef4-2e9d-49b0-b74a-c67d8ddf006d Jul 07 17:24:30 devstack sudo[94267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:30 devstack sudo[94264]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3fc1b8c7-52ff-4e68-b630-438ef06f8485 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-beaad1c2-1951-407b-80cf-d45150164c74" returned: 0 in 0.804s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:30 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3fc1b8c7-52ff-4e68-b630-438ef06f8485 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] Lock "cinder-quobyte-beaad1c2-1951-407b-80cf-d45150164c74" released by "delete_volume" :: held 1.722s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:30 devstack cinder-volume[87233]: DEBUG cinder.coordination [req-e2e72e13-fd7d-4054-a0de-1ae0a38b7dc1 req-fc8d3212-04ee-49e9-a7c1-654ca0bf4def tempest-VolumesGetTestJSON-1934992279 None] Acquiring lock "cinder-e69b6458-384a-4876-91c1-ca8513df1ba0-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:30 devstack cinder-volume[87233]: DEBUG cinder.coordination [req-e2e72e13-fd7d-4054-a0de-1ae0a38b7dc1 req-fc8d3212-04ee-49e9-a7c1-654ca0bf4def tempest-VolumesGetTestJSON-1934992279 None] Lock "cinder-e69b6458-384a-4876-91c1-ca8513df1ba0-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:31 devstack cinder-volume[87233]: DEBUG cinder.coordination [req-e2e72e13-fd7d-4054-a0de-1ae0a38b7dc1 req-fc8d3212-04ee-49e9-a7c1-654ca0bf4def tempest-VolumesGetTestJSON-1934992279 None] Acquiring lock "cinder-quobyte-e69b6458-384a-4876-91c1-ca8513df1ba0" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:31 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-3fc1b8c7-52ff-4e68-b630-438ef06f8485 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] Created reservations ['1b515772-b0d3-4127-8bfe-e91cb5d2f7fc', '1601db10-2a83-4c4e-a909-86b7d0b59c2f', 'c2ededf4-e69a-488d-ac53-0bdf3e4b8853', '03a6334b-332f-465d-a900-2711b3d3e28c'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:24:31 devstack cinder-volume[87233]: DEBUG cinder.coordination [req-e2e72e13-fd7d-4054-a0de-1ae0a38b7dc1 req-fc8d3212-04ee-49e9-a7c1-654ca0bf4def tempest-VolumesGetTestJSON-1934992279 None] Lock "cinder-quobyte-e69b6458-384a-4876-91c1-ca8513df1ba0" acquired by "delete_volume" :: waited 0.022s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:31 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b7137a-e81a-4a2d-a44d-b90a693c984d]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-e2e72e13-fd7d-4054-a0de-1ae0a38b7dc1 req-fc8d3212-04ee-49e9-a7c1-654ca0bf4def tempest-VolumesGetTestJSON-1934992279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e69b6458-384a-4876-91c1-ca8513df1ba0 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-3fc1b8c7-52ff-4e68-b630-438ef06f8485 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-3fc1b8c7-52ff-4e68-b630-438ef06f8485 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:31 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-3fc1b8c7-52ff-4e68-b630-438ef06f8485 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:24:31 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-3fc1b8c7-52ff-4e68-b630-438ef06f8485 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:24:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-3fc1b8c7-52ff-4e68-b630-438ef06f8485 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3fc1b8c7-52ff-4e68-b630-438ef06f8485 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:31 devstack sudo[94272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:24:31 devstack sudo[94272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:31 devstack sudo[94271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e69b6458-384a-4876-91c1-ca8513df1ba0 Jul 07 17:24:31 devstack sudo[94271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:31 devstack sudo[94266]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-30f41ac1-d0ec-4048-be93-573dc7a564c2 tempest-VolumesActionsTest-30875521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ceca7cfd-9786-4350-97e7-3d6584cd83ca" returned: 0 in 0.901s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-30f41ac1-d0ec-4048-be93-573dc7a564c2 tempest-VolumesActionsTest-30875521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ceca7cfd-9786-4350-97e7-3d6584cd83ca {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:31 devstack sudo[94281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ceca7cfd-9786-4350-97e7-3d6584cd83ca Jul 07 17:24:31 devstack sudo[94281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:31 devstack sudo[94267]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-10d0f47b-517b-4ab5-a0da-2d7911f048c6 tempest-ServerActionsTestOtherA-1544739102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c917cef4-2e9d-49b0-b74a-c67d8ddf006d" returned: 0 in 1.024s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-10d0f47b-517b-4ab5-a0da-2d7911f048c6 tempest-ServerActionsTestOtherA-1544739102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c917cef4-2e9d-49b0-b74a-c67d8ddf006d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:31 devstack sudo[94283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c917cef4-2e9d-49b0-b74a-c67d8ddf006d Jul 07 17:24:31 devstack sudo[94283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:31 devstack sudo[94272]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3fc1b8c7-52ff-4e68-b630-438ef06f8485 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.750s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:31 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-3fc1b8c7-52ff-4e68-b630-438ef06f8485 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:24:31 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-3fc1b8c7-52ff-4e68-b630-438ef06f8485 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] Deleted volume successfully. Jul 07 17:24:31 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3fc1b8c7-52ff-4e68-b630-438ef06f8485 tempest-VolumeQuotasNegativeTestJSON-1151146387 None] Lock "cinder-beaad1c2-1951-407b-80cf-d45150164c74-delete_volume" released by "delete_volume" :: held 2.801s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:32 devstack sudo[94271]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-e2e72e13-fd7d-4054-a0de-1ae0a38b7dc1 req-fc8d3212-04ee-49e9-a7c1-654ca0bf4def tempest-VolumesGetTestJSON-1934992279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e69b6458-384a-4876-91c1-ca8513df1ba0" returned: 0 in 1.135s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-e2e72e13-fd7d-4054-a0de-1ae0a38b7dc1 req-fc8d3212-04ee-49e9-a7c1-654ca0bf4def tempest-VolumesGetTestJSON-1934992279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e69b6458-384a-4876-91c1-ca8513df1ba0 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:32 devstack sudo[94289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e69b6458-384a-4876-91c1-ca8513df1ba0 Jul 07 17:24:32 devstack sudo[94289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:32 devstack sudo[94281]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-30f41ac1-d0ec-4048-be93-573dc7a564c2 tempest-VolumesActionsTest-30875521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ceca7cfd-9786-4350-97e7-3d6584cd83ca" returned: 0 in 0.796s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:32 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-30f41ac1-d0ec-4048-be93-573dc7a564c2 tempest-VolumesActionsTest-30875521 None] Lock "cinder-quobyte-ceca7cfd-9786-4350-97e7-3d6584cd83ca" released by "delete_volume" :: held 1.806s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:32 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-30f41ac1-d0ec-4048-be93-573dc7a564c2 tempest-VolumesActionsTest-30875521 None] Created reservations ['05d19ea2-156b-4431-b922-1dbcd75cf54f', '4934d686-759b-4f25-83cb-7ec0118e1ff9', '741edb0e-6902-4440-965a-d278e315e946', '93a4bf5f-d760-48b4-947c-03e10e18d24a'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:24:32 devstack sudo[94283]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-10d0f47b-517b-4ab5-a0da-2d7911f048c6 tempest-ServerActionsTestOtherA-1544739102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c917cef4-2e9d-49b0-b74a-c67d8ddf006d" returned: 0 in 0.800s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:32 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-10d0f47b-517b-4ab5-a0da-2d7911f048c6 tempest-ServerActionsTestOtherA-1544739102 None] Lock "cinder-quobyte-c917cef4-2e9d-49b0-b74a-c67d8ddf006d" released by "delete_volume" :: held 1.896s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-30f41ac1-d0ec-4048-be93-573dc7a564c2 tempest-VolumesActionsTest-30875521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-30f41ac1-d0ec-4048-be93-573dc7a564c2 tempest-VolumesActionsTest-30875521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:32 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-30f41ac1-d0ec-4048-be93-573dc7a564c2 tempest-VolumesActionsTest-30875521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:24:32 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-30f41ac1-d0ec-4048-be93-573dc7a564c2 tempest-VolumesActionsTest-30875521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:24:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-30f41ac1-d0ec-4048-be93-573dc7a564c2 tempest-VolumesActionsTest-30875521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-30f41ac1-d0ec-4048-be93-573dc7a564c2 tempest-VolumesActionsTest-30875521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:32 devstack sudo[94293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:24:32 devstack sudo[94293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:32 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-10d0f47b-517b-4ab5-a0da-2d7911f048c6 tempest-ServerActionsTestOtherA-1544739102 None] Created reservations ['15e14e48-982b-4714-bcba-f3aa939bfc89', '4613dbff-2182-418d-a954-3479659b3404', '2573b2a9-78f8-4cc2-bfea-b088b98f32ce', '811a1516-6154-469f-a6d8-61de7fb7f597'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:24:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-10d0f47b-517b-4ab5-a0da-2d7911f048c6 tempest-ServerActionsTestOtherA-1544739102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-10d0f47b-517b-4ab5-a0da-2d7911f048c6 tempest-ServerActionsTestOtherA-1544739102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:32 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-10d0f47b-517b-4ab5-a0da-2d7911f048c6 tempest-ServerActionsTestOtherA-1544739102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:24:32 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-10d0f47b-517b-4ab5-a0da-2d7911f048c6 tempest-ServerActionsTestOtherA-1544739102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:24:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-10d0f47b-517b-4ab5-a0da-2d7911f048c6 tempest-ServerActionsTestOtherA-1544739102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-10d0f47b-517b-4ab5-a0da-2d7911f048c6 tempest-ServerActionsTestOtherA-1544739102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:32 devstack sudo[94295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:24:32 devstack sudo[94295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:33 devstack sudo[94289]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-e2e72e13-fd7d-4054-a0de-1ae0a38b7dc1 req-fc8d3212-04ee-49e9-a7c1-654ca0bf4def tempest-VolumesGetTestJSON-1934992279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e69b6458-384a-4876-91c1-ca8513df1ba0" returned: 0 in 0.882s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:33 devstack cinder-volume[87233]: DEBUG cinder.coordination [req-e2e72e13-fd7d-4054-a0de-1ae0a38b7dc1 req-fc8d3212-04ee-49e9-a7c1-654ca0bf4def tempest-VolumesGetTestJSON-1934992279 None] Lock "cinder-quobyte-e69b6458-384a-4876-91c1-ca8513df1ba0" released by "delete_volume" :: held 2.101s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:33 devstack cinder-volume[87233]: DEBUG cinder.quota [req-e2e72e13-fd7d-4054-a0de-1ae0a38b7dc1 req-fc8d3212-04ee-49e9-a7c1-654ca0bf4def tempest-VolumesGetTestJSON-1934992279 None] Created reservations ['563d64fa-bac3-4607-82a3-eeb6bb5ac319', '3b6551da-42e7-41ce-8eed-f8e88e0cd2e6', 'ffc1f27e-8447-4e5f-9cdc-7f453412d35a', 'a21fa933-1e10-4575-aaa2-ddc523d76fdb'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:24:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-e2e72e13-fd7d-4054-a0de-1ae0a38b7dc1 req-fc8d3212-04ee-49e9-a7c1-654ca0bf4def tempest-VolumesGetTestJSON-1934992279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-e2e72e13-fd7d-4054-a0de-1ae0a38b7dc1 req-fc8d3212-04ee-49e9-a7c1-654ca0bf4def tempest-VolumesGetTestJSON-1934992279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:33 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [req-e2e72e13-fd7d-4054-a0de-1ae0a38b7dc1 req-fc8d3212-04ee-49e9-a7c1-654ca0bf4def tempest-VolumesGetTestJSON-1934992279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:24:33 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [req-e2e72e13-fd7d-4054-a0de-1ae0a38b7dc1 req-fc8d3212-04ee-49e9-a7c1-654ca0bf4def tempest-VolumesGetTestJSON-1934992279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:24:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-e2e72e13-fd7d-4054-a0de-1ae0a38b7dc1 req-fc8d3212-04ee-49e9-a7c1-654ca0bf4def tempest-VolumesGetTestJSON-1934992279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-e2e72e13-fd7d-4054-a0de-1ae0a38b7dc1 req-fc8d3212-04ee-49e9-a7c1-654ca0bf4def tempest-VolumesGetTestJSON-1934992279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:33 devstack sudo[94299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:24:33 devstack sudo[94299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:33 devstack sudo[94293]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-30f41ac1-d0ec-4048-be93-573dc7a564c2 tempest-VolumesActionsTest-30875521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.942s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:33 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-30f41ac1-d0ec-4048-be93-573dc7a564c2 tempest-VolumesActionsTest-30875521 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:24:33 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-30f41ac1-d0ec-4048-be93-573dc7a564c2 tempest-VolumesActionsTest-30875521 None] Deleted volume successfully. Jul 07 17:24:33 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-30f41ac1-d0ec-4048-be93-573dc7a564c2 tempest-VolumesActionsTest-30875521 None] Lock "cinder-ceca7cfd-9786-4350-97e7-3d6584cd83ca-delete_volume" released by "delete_volume" :: held 3.055s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:33 devstack sudo[94295]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-10d0f47b-517b-4ab5-a0da-2d7911f048c6 tempest-ServerActionsTestOtherA-1544739102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 1.131s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:33 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-10d0f47b-517b-4ab5-a0da-2d7911f048c6 tempest-ServerActionsTestOtherA-1544739102 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:24:33 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-10d0f47b-517b-4ab5-a0da-2d7911f048c6 tempest-ServerActionsTestOtherA-1544739102 None] Deleted volume successfully. Jul 07 17:24:33 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-10d0f47b-517b-4ab5-a0da-2d7911f048c6 tempest-ServerActionsTestOtherA-1544739102 None] Lock "cinder-c917cef4-2e9d-49b0-b74a-c67d8ddf006d-delete_volume" released by "delete_volume" :: held 3.350s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:34 devstack sudo[94299]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-e2e72e13-fd7d-4054-a0de-1ae0a38b7dc1 req-fc8d3212-04ee-49e9-a7c1-654ca0bf4def tempest-VolumesGetTestJSON-1934992279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.814s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:34 devstack cinder-volume[87233]: DEBUG cinder.manager [req-e2e72e13-fd7d-4054-a0de-1ae0a38b7dc1 req-fc8d3212-04ee-49e9-a7c1-654ca0bf4def tempest-VolumesGetTestJSON-1934992279 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:24:34 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-e2e72e13-fd7d-4054-a0de-1ae0a38b7dc1 req-fc8d3212-04ee-49e9-a7c1-654ca0bf4def tempest-VolumesGetTestJSON-1934992279 None] Deleted volume successfully. Jul 07 17:24:34 devstack cinder-volume[87233]: DEBUG cinder.coordination [req-e2e72e13-fd7d-4054-a0de-1ae0a38b7dc1 req-fc8d3212-04ee-49e9-a7c1-654ca0bf4def tempest-VolumesGetTestJSON-1934992279 None] Lock "cinder-e69b6458-384a-4876-91c1-ca8513df1ba0-delete_volume" released by "delete_volume" :: held 3.256s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:39 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-becc4048-0f9f-4d79-8be6-7e762a667e86 tempest-VolumesServicesTestJSON-1131980934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:24:39 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-becc4048-0f9f-4d79-8be6-7e762a667e86 tempest-VolumesServicesTestJSON-1131980934 None] Flow 'volume_create_manager' (7cf24058-b219-4783-93b2-fed5ba33952b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:24:39 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-becc4048-0f9f-4d79-8be6-7e762a667e86 tempest-VolumesServicesTestJSON-1131980934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1723701-7ee1-4ee1-817d-59893b6c42e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:39 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-becc4048-0f9f-4d79-8be6-7e762a667e86 tempest-VolumesServicesTestJSON-1131980934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1723701-7ee1-4ee1-817d-59893b6c42e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2128359301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=383369d9-9b10-4506-a825-87b75877eb83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9242271ceb80429abca4a930436878d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:24:39Z,use_quota=True,user_id='2f03a3bbed644fe1b0cdef0ae5864487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:39 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-becc4048-0f9f-4d79-8be6-7e762a667e86 tempest-VolumesServicesTestJSON-1131980934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c98c0585-1cba-4fcb-90a9-3933ae88e612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:39 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-becc4048-0f9f-4d79-8be6-7e762a667e86 tempest-VolumesServicesTestJSON-1131980934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c98c0585-1cba-4fcb-90a9-3933ae88e612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:39 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-becc4048-0f9f-4d79-8be6-7e762a667e86 tempest-VolumesServicesTestJSON-1131980934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7be036a5-4b7b-481a-8f47-0e38377b751c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:39 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-becc4048-0f9f-4d79-8be6-7e762a667e86 tempest-VolumesServicesTestJSON-1131980934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7be036a5-4b7b-481a-8f47-0e38377b751c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '383369d9-9b10-4506-a825-87b75877eb83', 'volume_name': 'volume-383369d9-9b10-4506-a825-87b75877eb83', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:39 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-becc4048-0f9f-4d79-8be6-7e762a667e86 tempest-VolumesServicesTestJSON-1131980934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58322f16-3cc0-4613-bd1f-109240bd9825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:39 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-becc4048-0f9f-4d79-8be6-7e762a667e86 tempest-VolumesServicesTestJSON-1131980934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58322f16-3cc0-4613-bd1f-109240bd9825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:39 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-becc4048-0f9f-4d79-8be6-7e762a667e86 tempest-VolumesServicesTestJSON-1131980934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77d19238-dc1d-4a13-8eda-5e0f796dd3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:39 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-becc4048-0f9f-4d79-8be6-7e762a667e86 tempest-VolumesServicesTestJSON-1131980934 None] Volume 383369d9-9b10-4506-a825-87b75877eb83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-383369d9-9b10-4506-a825-87b75877eb83', 'volume_size': 1} Jul 07 17:24:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-becc4048-0f9f-4d79-8be6-7e762a667e86 tempest-VolumesServicesTestJSON-1131980934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-becc4048-0f9f-4d79-8be6-7e762a667e86 tempest-VolumesServicesTestJSON-1131980934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:39 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-becc4048-0f9f-4d79-8be6-7e762a667e86 tempest-VolumesServicesTestJSON-1131980934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2128359301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=383369d9-9b10-4506-a825-87b75877eb83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9242271ceb80429abca4a930436878d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:24:39Z,use_quota=True,user_id='2f03a3bbed644fe1b0cdef0ae5864487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:24:39 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-becc4048-0f9f-4d79-8be6-7e762a667e86 tempest-VolumesServicesTestJSON-1131980934 None] Creating volume 383369d9-9b10-4506-a825-87b75877eb83 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:24:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-becc4048-0f9f-4d79-8be6-7e762a667e86 tempest-VolumesServicesTestJSON-1131980934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-becc4048-0f9f-4d79-8be6-7e762a667e86 tempest-VolumesServicesTestJSON-1131980934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:39 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-becc4048-0f9f-4d79-8be6-7e762a667e86 tempest-VolumesServicesTestJSON-1131980934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:24:39 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-becc4048-0f9f-4d79-8be6-7e762a667e86 tempest-VolumesServicesTestJSON-1131980934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:24:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-becc4048-0f9f-4d79-8be6-7e762a667e86 tempest-VolumesServicesTestJSON-1131980934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:39 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-becc4048-0f9f-4d79-8be6-7e762a667e86 tempest-VolumesServicesTestJSON-1131980934 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:24:39 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-becc4048-0f9f-4d79-8be6-7e762a667e86 tempest-VolumesServicesTestJSON-1131980934 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:24:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-becc4048-0f9f-4d79-8be6-7e762a667e86 tempest-VolumesServicesTestJSON-1131980934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-383369d9-9b10-4506-a825-87b75877eb83 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:39 devstack sudo[94331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-383369d9-9b10-4506-a825-87b75877eb83 1073741824 Jul 07 17:24:39 devstack sudo[94331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:40 devstack sudo[94331]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-becc4048-0f9f-4d79-8be6-7e762a667e86 tempest-VolumesServicesTestJSON-1131980934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-383369d9-9b10-4506-a825-87b75877eb83 1073741824" returned: 0 in 0.936s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-becc4048-0f9f-4d79-8be6-7e762a667e86 tempest-VolumesServicesTestJSON-1131980934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-383369d9-9b10-4506-a825-87b75877eb83 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:40 devstack sudo[94341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-383369d9-9b10-4506-a825-87b75877eb83 Jul 07 17:24:40 devstack sudo[94341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:40 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fcf52b0d-968b-4b66-bcb4-085a0c2e67b8 tempest-BackendsCapabilitiesAdminTestsJSON-197608403 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577667236328, 'free_capacity_gb': 1775.7577667236328, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87233) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 07 17:24:41 devstack sudo[94341]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-becc4048-0f9f-4d79-8be6-7e762a667e86 tempest-VolumesServicesTestJSON-1131980934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-383369d9-9b10-4506-a825-87b75877eb83" returned: 0 in 0.699s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:41 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-becc4048-0f9f-4d79-8be6-7e762a667e86 tempest-VolumesServicesTestJSON-1131980934 None] <== create_volume: return (1681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:24:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-becc4048-0f9f-4d79-8be6-7e762a667e86 tempest-VolumesServicesTestJSON-1131980934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:41 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-becc4048-0f9f-4d79-8be6-7e762a667e86 tempest-VolumesServicesTestJSON-1131980934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77d19238-dc1d-4a13-8eda-5e0f796dd3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-383369d9-9b10-4506-a825-87b75877eb83', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:41 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-becc4048-0f9f-4d79-8be6-7e762a667e86 tempest-VolumesServicesTestJSON-1131980934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85579011-2126-490e-88da-f7071509cf30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:41 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-becc4048-0f9f-4d79-8be6-7e762a667e86 tempest-VolumesServicesTestJSON-1131980934 None] Volume volume-383369d9-9b10-4506-a825-87b75877eb83 (383369d9-9b10-4506-a825-87b75877eb83): created successfully Jul 07 17:24:41 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-becc4048-0f9f-4d79-8be6-7e762a667e86 tempest-VolumesServicesTestJSON-1131980934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85579011-2126-490e-88da-f7071509cf30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:41 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-becc4048-0f9f-4d79-8be6-7e762a667e86 tempest-VolumesServicesTestJSON-1131980934 None] Flow 'volume_create_manager' (7cf24058-b219-4783-93b2-fed5ba33952b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:24:41 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-becc4048-0f9f-4d79-8be6-7e762a667e86 tempest-VolumesServicesTestJSON-1131980934 None] Created volume successfully. Jul 07 17:24:41 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d6740170-d2e9-46a7-b2c4-bc26d0f87284 tempest-BackendsCapabilitiesAdminTestsJSON-197608403 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577667236328, 'free_capacity_gb': 1775.7577667236328, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87233) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 07 17:24:41 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-77a6bafb-c8c4-4809-87bc-5a71340c2a0d tempest-VolumesServicesTestJSON-1131980934 None] Acquiring lock "cinder-383369d9-9b10-4506-a825-87b75877eb83-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:41 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-77a6bafb-c8c4-4809-87bc-5a71340c2a0d tempest-VolumesServicesTestJSON-1131980934 None] Lock "cinder-383369d9-9b10-4506-a825-87b75877eb83-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:41 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-77a6bafb-c8c4-4809-87bc-5a71340c2a0d tempest-VolumesServicesTestJSON-1131980934 None] Acquiring lock "cinder-quobyte-383369d9-9b10-4506-a825-87b75877eb83" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:41 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-77a6bafb-c8c4-4809-87bc-5a71340c2a0d tempest-VolumesServicesTestJSON-1131980934 None] Lock "cinder-quobyte-383369d9-9b10-4506-a825-87b75877eb83" acquired by "delete_volume" :: waited 0.018s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:41 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0b8aa1-bf32-447d-bb3e-02c655823bd4]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-77a6bafb-c8c4-4809-87bc-5a71340c2a0d tempest-VolumesServicesTestJSON-1131980934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-383369d9-9b10-4506-a825-87b75877eb83 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:41 devstack sudo[94344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-383369d9-9b10-4506-a825-87b75877eb83 Jul 07 17:24:41 devstack sudo[94344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:42 devstack sudo[94344]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-77a6bafb-c8c4-4809-87bc-5a71340c2a0d tempest-VolumesServicesTestJSON-1131980934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-383369d9-9b10-4506-a825-87b75877eb83" returned: 0 in 0.994s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-77a6bafb-c8c4-4809-87bc-5a71340c2a0d tempest-VolumesServicesTestJSON-1131980934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-383369d9-9b10-4506-a825-87b75877eb83 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:42 devstack sudo[94350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-383369d9-9b10-4506-a825-87b75877eb83 Jul 07 17:24:42 devstack sudo[94350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:43 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:24:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:24:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:24:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:43 devstack sudo[94353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:24:43 devstack sudo[94353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:43 devstack sudo[94350]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-77a6bafb-c8c4-4809-87bc-5a71340c2a0d tempest-VolumesServicesTestJSON-1131980934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-383369d9-9b10-4506-a825-87b75877eb83" returned: 0 in 0.777s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:43 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-77a6bafb-c8c4-4809-87bc-5a71340c2a0d tempest-VolumesServicesTestJSON-1131980934 None] Lock "cinder-quobyte-383369d9-9b10-4506-a825-87b75877eb83" released by "delete_volume" :: held 1.856s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:43 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-77a6bafb-c8c4-4809-87bc-5a71340c2a0d tempest-VolumesServicesTestJSON-1131980934 None] Created reservations ['7d45493c-79d9-4d31-abe8-b4058fcd8773', '76a6db1e-ce84-4fd3-a72d-53c1c5621872', '77550c06-02d6-4570-a044-6ab5a0b56420', 'f6cc763b-bec3-4514-a8b9-372437645ff9'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:24:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-77a6bafb-c8c4-4809-87bc-5a71340c2a0d tempest-VolumesServicesTestJSON-1131980934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-77a6bafb-c8c4-4809-87bc-5a71340c2a0d tempest-VolumesServicesTestJSON-1131980934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-77a6bafb-c8c4-4809-87bc-5a71340c2a0d tempest-VolumesServicesTestJSON-1131980934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:24:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-77a6bafb-c8c4-4809-87bc-5a71340c2a0d tempest-VolumesServicesTestJSON-1131980934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:24:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-77a6bafb-c8c4-4809-87bc-5a71340c2a0d tempest-VolumesServicesTestJSON-1131980934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-77a6bafb-c8c4-4809-87bc-5a71340c2a0d tempest-VolumesServicesTestJSON-1131980934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:43 devstack sudo[94355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:24:43 devstack sudo[94355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:44 devstack sudo[94353]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.918s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:44 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:24:44 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:24:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread count: 8 {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:24:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread info: [<_MainThread(MainThread, started 126077716062336)>, , , , , , , ] {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:24:44 devstack sudo[94355]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-77a6bafb-c8c4-4809-87bc-5a71340c2a0d tempest-VolumesServicesTestJSON-1131980934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.983s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:44 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-77a6bafb-c8c4-4809-87bc-5a71340c2a0d tempest-VolumesServicesTestJSON-1131980934 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:24:44 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-77a6bafb-c8c4-4809-87bc-5a71340c2a0d tempest-VolumesServicesTestJSON-1131980934 None] Deleted volume successfully. Jul 07 17:24:44 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-77a6bafb-c8c4-4809-87bc-5a71340c2a0d tempest-VolumesServicesTestJSON-1131980934 None] Lock "cinder-383369d9-9b10-4506-a825-87b75877eb83-delete_volume" released by "delete_volume" :: held 3.109s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:53 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0549484-1038-4da1-a137-59aed5bfb383 tempest-VolumesListAdminTestJSON-1524773903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:24:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e0549484-1038-4da1-a137-59aed5bfb383 tempest-VolumesListAdminTestJSON-1524773903 None] Flow 'volume_create_manager' (fc8949a0-f351-4ab0-8d0b-390974ca3774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:24:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e0549484-1038-4da1-a137-59aed5bfb383 tempest-VolumesListAdminTestJSON-1524773903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b79fdbea-4c66-4703-acbd-d045a50efa5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e0549484-1038-4da1-a137-59aed5bfb383 tempest-VolumesListAdminTestJSON-1524773903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b79fdbea-4c66-4703-acbd-d045a50efa5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1464221404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9b4ca57-801d-4c55-a022-526fe4d33c64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bde672955edc4d668309d9bd5bf11d0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:24:53Z,use_quota=True,user_id='8319f9786b0f419495cfe05808ecac82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e0549484-1038-4da1-a137-59aed5bfb383 tempest-VolumesListAdminTestJSON-1524773903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f5ec8dd-e00a-4f59-b248-67aba1a07127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e0549484-1038-4da1-a137-59aed5bfb383 tempest-VolumesListAdminTestJSON-1524773903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f5ec8dd-e00a-4f59-b248-67aba1a07127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e0549484-1038-4da1-a137-59aed5bfb383 tempest-VolumesListAdminTestJSON-1524773903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a0dbe52-bab3-4152-93dc-49ff78d56fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e0549484-1038-4da1-a137-59aed5bfb383 tempest-VolumesListAdminTestJSON-1524773903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a0dbe52-bab3-4152-93dc-49ff78d56fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9b4ca57-801d-4c55-a022-526fe4d33c64', 'volume_name': 'volume-e9b4ca57-801d-4c55-a022-526fe4d33c64', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e0549484-1038-4da1-a137-59aed5bfb383 tempest-VolumesListAdminTestJSON-1524773903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ae347f3-90f9-4107-96a4-f1daba4e19f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e0549484-1038-4da1-a137-59aed5bfb383 tempest-VolumesListAdminTestJSON-1524773903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ae347f3-90f9-4107-96a4-f1daba4e19f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e0549484-1038-4da1-a137-59aed5bfb383 tempest-VolumesListAdminTestJSON-1524773903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fcc2259-cc5e-47a9-9d16-39bc40f5035f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:53 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-e0549484-1038-4da1-a137-59aed5bfb383 tempest-VolumesListAdminTestJSON-1524773903 None] Volume e9b4ca57-801d-4c55-a022-526fe4d33c64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9b4ca57-801d-4c55-a022-526fe4d33c64', 'volume_size': 1} Jul 07 17:24:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e0549484-1038-4da1-a137-59aed5bfb383 tempest-VolumesListAdminTestJSON-1524773903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e0549484-1038-4da1-a137-59aed5bfb383 tempest-VolumesListAdminTestJSON-1524773903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:53 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-e0549484-1038-4da1-a137-59aed5bfb383 tempest-VolumesListAdminTestJSON-1524773903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1464221404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9b4ca57-801d-4c55-a022-526fe4d33c64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bde672955edc4d668309d9bd5bf11d0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:24:53Z,use_quota=True,user_id='8319f9786b0f419495cfe05808ecac82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:24:53 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-e0549484-1038-4da1-a137-59aed5bfb383 tempest-VolumesListAdminTestJSON-1524773903 None] Creating volume e9b4ca57-801d-4c55-a022-526fe4d33c64 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:24:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e0549484-1038-4da1-a137-59aed5bfb383 tempest-VolumesListAdminTestJSON-1524773903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e0549484-1038-4da1-a137-59aed5bfb383 tempest-VolumesListAdminTestJSON-1524773903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:53 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-e0549484-1038-4da1-a137-59aed5bfb383 tempest-VolumesListAdminTestJSON-1524773903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:24:53 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-e0549484-1038-4da1-a137-59aed5bfb383 tempest-VolumesListAdminTestJSON-1524773903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:24:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e0549484-1038-4da1-a137-59aed5bfb383 tempest-VolumesListAdminTestJSON-1524773903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:53 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-e0549484-1038-4da1-a137-59aed5bfb383 tempest-VolumesListAdminTestJSON-1524773903 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:24:53 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-e0549484-1038-4da1-a137-59aed5bfb383 tempest-VolumesListAdminTestJSON-1524773903 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:24:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e0549484-1038-4da1-a137-59aed5bfb383 tempest-VolumesListAdminTestJSON-1524773903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e9b4ca57-801d-4c55-a022-526fe4d33c64 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:53 devstack sudo[94367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e9b4ca57-801d-4c55-a022-526fe4d33c64 1073741824 Jul 07 17:24:53 devstack sudo[94367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:54 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fe6ed32-ee25-40a3-b002-fb2529c52aca tempest-VolumesDeleteCascade-2018765742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:24:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0fe6ed32-ee25-40a3-b002-fb2529c52aca tempest-VolumesDeleteCascade-2018765742 None] Flow 'volume_create_manager' (311ee286-56a9-42be-a751-1a0589985de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:24:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0fe6ed32-ee25-40a3-b002-fb2529c52aca tempest-VolumesDeleteCascade-2018765742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4d39417-a937-4389-a614-54dcb64d5553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0fe6ed32-ee25-40a3-b002-fb2529c52aca tempest-VolumesDeleteCascade-2018765742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4d39417-a937-4389-a614-54dcb64d5553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1812037670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32e71cc7-40a6-41c1-8bf6-fc902add7c77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='127f9a16b0404ac2996a1e6af019f788',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:24:54Z,use_quota=True,user_id='e86e1e97683a4d0c9ad01c76afbd9d28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0fe6ed32-ee25-40a3-b002-fb2529c52aca tempest-VolumesDeleteCascade-2018765742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a388b266-85fc-4649-8232-522cdce4b005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0fe6ed32-ee25-40a3-b002-fb2529c52aca tempest-VolumesDeleteCascade-2018765742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a388b266-85fc-4649-8232-522cdce4b005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0fe6ed32-ee25-40a3-b002-fb2529c52aca tempest-VolumesDeleteCascade-2018765742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7bd35f5-2b3b-4abb-8724-911cddcf8067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0fe6ed32-ee25-40a3-b002-fb2529c52aca tempest-VolumesDeleteCascade-2018765742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7bd35f5-2b3b-4abb-8724-911cddcf8067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32e71cc7-40a6-41c1-8bf6-fc902add7c77', 'volume_name': 'volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0fe6ed32-ee25-40a3-b002-fb2529c52aca tempest-VolumesDeleteCascade-2018765742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c20b4074-9443-4ff8-b836-2e554f6b1d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0fe6ed32-ee25-40a3-b002-fb2529c52aca tempest-VolumesDeleteCascade-2018765742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c20b4074-9443-4ff8-b836-2e554f6b1d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0fe6ed32-ee25-40a3-b002-fb2529c52aca tempest-VolumesDeleteCascade-2018765742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9eceb36-0473-4aee-b027-638be851e8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:54 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-0fe6ed32-ee25-40a3-b002-fb2529c52aca tempest-VolumesDeleteCascade-2018765742 None] Volume 32e71cc7-40a6-41c1-8bf6-fc902add7c77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77', 'volume_size': 1} Jul 07 17:24:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0fe6ed32-ee25-40a3-b002-fb2529c52aca tempest-VolumesDeleteCascade-2018765742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:54 devstack sudo[94367]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e0549484-1038-4da1-a137-59aed5bfb383 tempest-VolumesListAdminTestJSON-1524773903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e9b4ca57-801d-4c55-a022-526fe4d33c64 1073741824" returned: 0 in 1.069s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e0549484-1038-4da1-a137-59aed5bfb383 tempest-VolumesListAdminTestJSON-1524773903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e9b4ca57-801d-4c55-a022-526fe4d33c64 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:54 devstack sudo[94373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e9b4ca57-801d-4c55-a022-526fe4d33c64 Jul 07 17:24:54 devstack sudo[94373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:55 devstack sudo[94373]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e0549484-1038-4da1-a137-59aed5bfb383 tempest-VolumesListAdminTestJSON-1524773903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e9b4ca57-801d-4c55-a022-526fe4d33c64" returned: 0 in 0.711s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:55 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-e0549484-1038-4da1-a137-59aed5bfb383 tempest-VolumesListAdminTestJSON-1524773903 None] <== create_volume: return (2148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:24:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e0549484-1038-4da1-a137-59aed5bfb383 tempest-VolumesListAdminTestJSON-1524773903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.153s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0fe6ed32-ee25-40a3-b002-fb2529c52aca tempest-VolumesDeleteCascade-2018765742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.303s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:55 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-0fe6ed32-ee25-40a3-b002-fb2529c52aca tempest-VolumesDeleteCascade-2018765742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1812037670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32e71cc7-40a6-41c1-8bf6-fc902add7c77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='127f9a16b0404ac2996a1e6af019f788',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:24:54Z,use_quota=True,user_id='e86e1e97683a4d0c9ad01c76afbd9d28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:24:55 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-0fe6ed32-ee25-40a3-b002-fb2529c52aca tempest-VolumesDeleteCascade-2018765742 None] Creating volume 32e71cc7-40a6-41c1-8bf6-fc902add7c77 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:24:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0fe6ed32-ee25-40a3-b002-fb2529c52aca tempest-VolumesDeleteCascade-2018765742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0fe6ed32-ee25-40a3-b002-fb2529c52aca tempest-VolumesDeleteCascade-2018765742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:55 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-0fe6ed32-ee25-40a3-b002-fb2529c52aca tempest-VolumesDeleteCascade-2018765742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:24:55 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-0fe6ed32-ee25-40a3-b002-fb2529c52aca tempest-VolumesDeleteCascade-2018765742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:24:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0fe6ed32-ee25-40a3-b002-fb2529c52aca tempest-VolumesDeleteCascade-2018765742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:55 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-0fe6ed32-ee25-40a3-b002-fb2529c52aca tempest-VolumesDeleteCascade-2018765742 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:24:55 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-0fe6ed32-ee25-40a3-b002-fb2529c52aca tempest-VolumesDeleteCascade-2018765742 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:24:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0fe6ed32-ee25-40a3-b002-fb2529c52aca tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:55 devstack sudo[94376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77 1073741824 Jul 07 17:24:55 devstack sudo[94376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:55 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e0549484-1038-4da1-a137-59aed5bfb383 tempest-VolumesListAdminTestJSON-1524773903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fcc2259-cc5e-47a9-9d16-39bc40f5035f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9b4ca57-801d-4c55-a022-526fe4d33c64', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:55 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e0549484-1038-4da1-a137-59aed5bfb383 tempest-VolumesListAdminTestJSON-1524773903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c98952d3-ef67-4d5e-8d29-74ae75a5584c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:55 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-e0549484-1038-4da1-a137-59aed5bfb383 tempest-VolumesListAdminTestJSON-1524773903 None] Volume volume-e9b4ca57-801d-4c55-a022-526fe4d33c64 (e9b4ca57-801d-4c55-a022-526fe4d33c64): created successfully Jul 07 17:24:55 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e0549484-1038-4da1-a137-59aed5bfb383 tempest-VolumesListAdminTestJSON-1524773903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c98952d3-ef67-4d5e-8d29-74ae75a5584c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:55 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e0549484-1038-4da1-a137-59aed5bfb383 tempest-VolumesListAdminTestJSON-1524773903 None] Flow 'volume_create_manager' (fc8949a0-f351-4ab0-8d0b-390974ca3774) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:24:55 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-e0549484-1038-4da1-a137-59aed5bfb383 tempest-VolumesListAdminTestJSON-1524773903 None] Created volume successfully. Jul 07 17:24:56 devstack sudo[94376]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0fe6ed32-ee25-40a3-b002-fb2529c52aca tempest-VolumesDeleteCascade-2018765742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77 1073741824" returned: 0 in 1.060s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0fe6ed32-ee25-40a3-b002-fb2529c52aca tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:59 devstack sudo[94381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77 Jul 07 17:24:59 devstack sudo[94381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:59 devstack sudo[94381]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0fe6ed32-ee25-40a3-b002-fb2529c52aca tempest-VolumesDeleteCascade-2018765742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77" returned: 0 in 0.625s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:59 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-0fe6ed32-ee25-40a3-b002-fb2529c52aca tempest-VolumesDeleteCascade-2018765742 None] <== create_volume: return (4295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:24:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0fe6ed32-ee25-40a3-b002-fb2529c52aca tempest-VolumesDeleteCascade-2018765742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.300s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:01 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0fe6ed32-ee25-40a3-b002-fb2529c52aca tempest-VolumesDeleteCascade-2018765742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9eceb36-0473-4aee-b027-638be851e8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:01 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0fe6ed32-ee25-40a3-b002-fb2529c52aca tempest-VolumesDeleteCascade-2018765742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbe60bca-183d-4c1c-88fc-ea9e932b4afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:01 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-0fe6ed32-ee25-40a3-b002-fb2529c52aca tempest-VolumesDeleteCascade-2018765742 None] Volume volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77 (32e71cc7-40a6-41c1-8bf6-fc902add7c77): created successfully Jul 07 17:25:01 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0fe6ed32-ee25-40a3-b002-fb2529c52aca tempest-VolumesDeleteCascade-2018765742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbe60bca-183d-4c1c-88fc-ea9e932b4afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:01 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0fe6ed32-ee25-40a3-b002-fb2529c52aca tempest-VolumesDeleteCascade-2018765742 None] Flow 'volume_create_manager' (311ee286-56a9-42be-a751-1a0589985de6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:25:01 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-0fe6ed32-ee25-40a3-b002-fb2529c52aca tempest-VolumesDeleteCascade-2018765742 None] Created volume successfully. Jul 07 17:25:01 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfcfb228-44e5-4e92-88b2-147af71d2fa2 tempest-VolumesListAdminTestJSON-1524773903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:25:02 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-dfcfb228-44e5-4e92-88b2-147af71d2fa2 tempest-VolumesListAdminTestJSON-1524773903 None] Flow 'volume_create_manager' (ad5f7ebd-d35d-4da0-bd8c-258cc619c68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:25:02 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-dfcfb228-44e5-4e92-88b2-147af71d2fa2 tempest-VolumesListAdminTestJSON-1524773903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3a56078-ac3c-4176-bfa4-38fe602f6a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:02 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-dfcfb228-44e5-4e92-88b2-147af71d2fa2 tempest-VolumesListAdminTestJSON-1524773903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3a56078-ac3c-4176-bfa4-38fe602f6a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-223526928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0478990e-b412-449c-a2fb-d0abd33a61fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bde672955edc4d668309d9bd5bf11d0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:25:02Z,use_quota=True,user_id='8319f9786b0f419495cfe05808ecac82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:02 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-dfcfb228-44e5-4e92-88b2-147af71d2fa2 tempest-VolumesListAdminTestJSON-1524773903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6bed467-13d4-4cc6-8171-af7b8292127e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:02 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-dfcfb228-44e5-4e92-88b2-147af71d2fa2 tempest-VolumesListAdminTestJSON-1524773903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6bed467-13d4-4cc6-8171-af7b8292127e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:02 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-dfcfb228-44e5-4e92-88b2-147af71d2fa2 tempest-VolumesListAdminTestJSON-1524773903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (585bd09b-5f18-4906-bfcf-a674cbf7afce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:02 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-dfcfb228-44e5-4e92-88b2-147af71d2fa2 tempest-VolumesListAdminTestJSON-1524773903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (585bd09b-5f18-4906-bfcf-a674cbf7afce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0478990e-b412-449c-a2fb-d0abd33a61fe', 'volume_name': 'volume-0478990e-b412-449c-a2fb-d0abd33a61fe', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:02 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-dfcfb228-44e5-4e92-88b2-147af71d2fa2 tempest-VolumesListAdminTestJSON-1524773903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1a006ee-3e72-42fe-a3f4-a8b05f24f1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:02 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-dfcfb228-44e5-4e92-88b2-147af71d2fa2 tempest-VolumesListAdminTestJSON-1524773903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1a006ee-3e72-42fe-a3f4-a8b05f24f1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:02 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-dfcfb228-44e5-4e92-88b2-147af71d2fa2 tempest-VolumesListAdminTestJSON-1524773903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (139f0ca1-fb51-4b3c-9046-eefc93bc46e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:02 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-dfcfb228-44e5-4e92-88b2-147af71d2fa2 tempest-VolumesListAdminTestJSON-1524773903 None] Volume 0478990e-b412-449c-a2fb-d0abd33a61fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0478990e-b412-449c-a2fb-d0abd33a61fe', 'volume_size': 1} Jul 07 17:25:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-dfcfb228-44e5-4e92-88b2-147af71d2fa2 tempest-VolumesListAdminTestJSON-1524773903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-dfcfb228-44e5-4e92-88b2-147af71d2fa2 tempest-VolumesListAdminTestJSON-1524773903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:02 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-dfcfb228-44e5-4e92-88b2-147af71d2fa2 tempest-VolumesListAdminTestJSON-1524773903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-223526928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0478990e-b412-449c-a2fb-d0abd33a61fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bde672955edc4d668309d9bd5bf11d0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:25:02Z,use_quota=True,user_id='8319f9786b0f419495cfe05808ecac82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:25:02 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-dfcfb228-44e5-4e92-88b2-147af71d2fa2 tempest-VolumesListAdminTestJSON-1524773903 None] Creating volume 0478990e-b412-449c-a2fb-d0abd33a61fe {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:25:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-dfcfb228-44e5-4e92-88b2-147af71d2fa2 tempest-VolumesListAdminTestJSON-1524773903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-dfcfb228-44e5-4e92-88b2-147af71d2fa2 tempest-VolumesListAdminTestJSON-1524773903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:02 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-dfcfb228-44e5-4e92-88b2-147af71d2fa2 tempest-VolumesListAdminTestJSON-1524773903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:25:02 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-dfcfb228-44e5-4e92-88b2-147af71d2fa2 tempest-VolumesListAdminTestJSON-1524773903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:25:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-dfcfb228-44e5-4e92-88b2-147af71d2fa2 tempest-VolumesListAdminTestJSON-1524773903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:02 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-dfcfb228-44e5-4e92-88b2-147af71d2fa2 tempest-VolumesListAdminTestJSON-1524773903 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:25:02 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-dfcfb228-44e5-4e92-88b2-147af71d2fa2 tempest-VolumesListAdminTestJSON-1524773903 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:25:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-dfcfb228-44e5-4e92-88b2-147af71d2fa2 tempest-VolumesListAdminTestJSON-1524773903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0478990e-b412-449c-a2fb-d0abd33a61fe 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:02 devstack sudo[94388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0478990e-b412-449c-a2fb-d0abd33a61fe 1073741824 Jul 07 17:25:02 devstack sudo[94388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9587639c-2cc1-4390-8f3d-3221bc30ecc5 tempest-VolumesDeleteCascade-2018765742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:03 devstack sudo[94388]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-dfcfb228-44e5-4e92-88b2-147af71d2fa2 tempest-VolumesListAdminTestJSON-1524773903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0478990e-b412-449c-a2fb-d0abd33a61fe 1073741824" returned: 0 in 1.252s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-dfcfb228-44e5-4e92-88b2-147af71d2fa2 tempest-VolumesListAdminTestJSON-1524773903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0478990e-b412-449c-a2fb-d0abd33a61fe {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:03 devstack sudo[94395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0478990e-b412-449c-a2fb-d0abd33a61fe Jul 07 17:25:03 devstack sudo[94395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:04 devstack sudo[94395]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-dfcfb228-44e5-4e92-88b2-147af71d2fa2 tempest-VolumesListAdminTestJSON-1524773903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0478990e-b412-449c-a2fb-d0abd33a61fe" returned: 0 in 0.782s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:04 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-dfcfb228-44e5-4e92-88b2-147af71d2fa2 tempest-VolumesListAdminTestJSON-1524773903 None] <== create_volume: return (2098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:25:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-dfcfb228-44e5-4e92-88b2-147af71d2fa2 tempest-VolumesListAdminTestJSON-1524773903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.103s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9587639c-2cc1-4390-8f3d-3221bc30ecc5 tempest-VolumesDeleteCascade-2018765742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.889s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:04 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-9587639c-2cc1-4390-8f3d-3221bc30ecc5 tempest-VolumesDeleteCascade-2018765742 None] Creating offline snapshot 025f08be-1bc5-4804-91e9-8c3042ed53aa of volume 32e71cc7-40a6-41c1-8bf6-fc902add7c77 {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:25:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-dfcfb228-44e5-4e92-88b2-147af71d2fa2 tempest-VolumesListAdminTestJSON-1524773903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (139f0ca1-fb51-4b3c-9046-eefc93bc46e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0478990e-b412-449c-a2fb-d0abd33a61fe', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-dfcfb228-44e5-4e92-88b2-147af71d2fa2 tempest-VolumesListAdminTestJSON-1524773903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d39055b-fb86-469a-a8e7-f06aa9c84c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:04 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08ba53c-3f8f-4cbe-84eb-cf1180ff12b5]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9587639c-2cc1-4390-8f3d-3221bc30ecc5 tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:04 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-dfcfb228-44e5-4e92-88b2-147af71d2fa2 tempest-VolumesListAdminTestJSON-1524773903 None] Volume volume-0478990e-b412-449c-a2fb-d0abd33a61fe (0478990e-b412-449c-a2fb-d0abd33a61fe): created successfully Jul 07 17:25:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-dfcfb228-44e5-4e92-88b2-147af71d2fa2 tempest-VolumesListAdminTestJSON-1524773903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d39055b-fb86-469a-a8e7-f06aa9c84c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-dfcfb228-44e5-4e92-88b2-147af71d2fa2 tempest-VolumesListAdminTestJSON-1524773903 None] Flow 'volume_create_manager' (ad5f7ebd-d35d-4da0-bd8c-258cc619c68f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:25:04 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-dfcfb228-44e5-4e92-88b2-147af71d2fa2 tempest-VolumesListAdminTestJSON-1524773903 None] Created volume successfully. Jul 07 17:25:04 devstack sudo[94398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77 Jul 07 17:25:04 devstack sudo[94398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:05 devstack sudo[94398]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9587639c-2cc1-4390-8f3d-3221bc30ecc5 tempest-VolumesDeleteCascade-2018765742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77" returned: 0 in 0.899s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9587639c-2cc1-4390-8f3d-3221bc30ecc5 tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.025f08be-1bc5-4804-91e9-8c3042ed53aa 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:05 devstack sudo[94403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.025f08be-1bc5-4804-91e9-8c3042ed53aa 1G Jul 07 17:25:05 devstack sudo[94403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:05 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5e390cb-5ffb-4189-bf1b-902ecb991ac8 tempest-VolumesListAdminTestJSON-1524773903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:25:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e5e390cb-5ffb-4189-bf1b-902ecb991ac8 tempest-VolumesListAdminTestJSON-1524773903 None] Flow 'volume_create_manager' (e5d403fc-925b-4135-afab-1c93cea119a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:25:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e5e390cb-5ffb-4189-bf1b-902ecb991ac8 tempest-VolumesListAdminTestJSON-1524773903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (084acad3-04ac-4151-856a-6c091813ae28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e5e390cb-5ffb-4189-bf1b-902ecb991ac8 tempest-VolumesListAdminTestJSON-1524773903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (084acad3-04ac-4151-856a-6c091813ae28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-68985619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e86840a-976d-4177-b28d-8e5a035c699b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bde672955edc4d668309d9bd5bf11d0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:25:06Z,use_quota=True,user_id='8319f9786b0f419495cfe05808ecac82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e5e390cb-5ffb-4189-bf1b-902ecb991ac8 tempest-VolumesListAdminTestJSON-1524773903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05ca3fbe-b886-4de9-b22e-0256b9a0102b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e5e390cb-5ffb-4189-bf1b-902ecb991ac8 tempest-VolumesListAdminTestJSON-1524773903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05ca3fbe-b886-4de9-b22e-0256b9a0102b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e5e390cb-5ffb-4189-bf1b-902ecb991ac8 tempest-VolumesListAdminTestJSON-1524773903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (349b438e-ec84-4054-9bb4-ee93a984e3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e5e390cb-5ffb-4189-bf1b-902ecb991ac8 tempest-VolumesListAdminTestJSON-1524773903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (349b438e-ec84-4054-9bb4-ee93a984e3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e86840a-976d-4177-b28d-8e5a035c699b', 'volume_name': 'volume-4e86840a-976d-4177-b28d-8e5a035c699b', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e5e390cb-5ffb-4189-bf1b-902ecb991ac8 tempest-VolumesListAdminTestJSON-1524773903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c1ac352-befa-472e-a3b7-72a6fe67b571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e5e390cb-5ffb-4189-bf1b-902ecb991ac8 tempest-VolumesListAdminTestJSON-1524773903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c1ac352-befa-472e-a3b7-72a6fe67b571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e5e390cb-5ffb-4189-bf1b-902ecb991ac8 tempest-VolumesListAdminTestJSON-1524773903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edc3809d-6c26-4537-a6c7-33f284398502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:05 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-e5e390cb-5ffb-4189-bf1b-902ecb991ac8 tempest-VolumesListAdminTestJSON-1524773903 None] Volume 4e86840a-976d-4177-b28d-8e5a035c699b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e86840a-976d-4177-b28d-8e5a035c699b', 'volume_size': 1} Jul 07 17:25:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e5e390cb-5ffb-4189-bf1b-902ecb991ac8 tempest-VolumesListAdminTestJSON-1524773903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:06 devstack sudo[94403]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9587639c-2cc1-4390-8f3d-3221bc30ecc5 tempest-VolumesDeleteCascade-2018765742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.025f08be-1bc5-4804-91e9-8c3042ed53aa 1G" returned: 0 in 1.263s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9587639c-2cc1-4390-8f3d-3221bc30ecc5 tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.025f08be-1bc5-4804-91e9-8c3042ed53aa {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:06 devstack sudo[94409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.025f08be-1bc5-4804-91e9-8c3042ed53aa Jul 07 17:25:06 devstack sudo[94409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:07 devstack sudo[94409]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9587639c-2cc1-4390-8f3d-3221bc30ecc5 tempest-VolumesDeleteCascade-2018765742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.025f08be-1bc5-4804-91e9-8c3042ed53aa" returned: 0 in 0.865s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:07 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-9587639c-2cc1-4390-8f3d-3221bc30ecc5 tempest-VolumesDeleteCascade-2018765742 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.025f08be-1bc5-4804-91e9-8c3042ed53aa is being set with open permissions: ugo+rw Jul 07 17:25:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9587639c-2cc1-4390-8f3d-3221bc30ecc5 tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.025f08be-1bc5-4804-91e9-8c3042ed53aa {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:07 devstack sudo[94414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.025f08be-1bc5-4804-91e9-8c3042ed53aa Jul 07 17:25:07 devstack sudo[94414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:07 devstack sudo[94414]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9587639c-2cc1-4390-8f3d-3221bc30ecc5 tempest-VolumesDeleteCascade-2018765742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.025f08be-1bc5-4804-91e9-8c3042ed53aa" returned: 0 in 0.701s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9587639c-2cc1-4390-8f3d-3221bc30ecc5 tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:08 devstack sudo[94417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.info Jul 07 17:25:08 devstack sudo[94417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:08 devstack sudo[94417]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9587639c-2cc1-4390-8f3d-3221bc30ecc5 tempest-VolumesDeleteCascade-2018765742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.info" returned: 0 in 0.912s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:08 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-9587639c-2cc1-4390-8f3d-3221bc30ecc5 tempest-VolumesDeleteCascade-2018765742 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.info is being set with open permissions: ugo+rw Jul 07 17:25:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9587639c-2cc1-4390-8f3d-3221bc30ecc5 tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:08 devstack sudo[94649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.info Jul 07 17:25:08 devstack sudo[94649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:09 devstack sudo[94649]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9587639c-2cc1-4390-8f3d-3221bc30ecc5 tempest-VolumesDeleteCascade-2018765742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.info" returned: 0 in 0.805s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9587639c-2cc1-4390-8f3d-3221bc30ecc5 tempest-VolumesDeleteCascade-2018765742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.593s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e5e390cb-5ffb-4189-bf1b-902ecb991ac8 tempest-VolumesListAdminTestJSON-1524773903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.893s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:09 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-e5e390cb-5ffb-4189-bf1b-902ecb991ac8 tempest-VolumesListAdminTestJSON-1524773903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-68985619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e86840a-976d-4177-b28d-8e5a035c699b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bde672955edc4d668309d9bd5bf11d0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:25:06Z,use_quota=True,user_id='8319f9786b0f419495cfe05808ecac82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:25:09 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-e5e390cb-5ffb-4189-bf1b-902ecb991ac8 tempest-VolumesListAdminTestJSON-1524773903 None] Creating volume 4e86840a-976d-4177-b28d-8e5a035c699b {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:25:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e5e390cb-5ffb-4189-bf1b-902ecb991ac8 tempest-VolumesListAdminTestJSON-1524773903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e5e390cb-5ffb-4189-bf1b-902ecb991ac8 tempest-VolumesListAdminTestJSON-1524773903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:09 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-e5e390cb-5ffb-4189-bf1b-902ecb991ac8 tempest-VolumesListAdminTestJSON-1524773903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:25:09 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-e5e390cb-5ffb-4189-bf1b-902ecb991ac8 tempest-VolumesListAdminTestJSON-1524773903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:25:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e5e390cb-5ffb-4189-bf1b-902ecb991ac8 tempest-VolumesListAdminTestJSON-1524773903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:09 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-e5e390cb-5ffb-4189-bf1b-902ecb991ac8 tempest-VolumesListAdminTestJSON-1524773903 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:25:09 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-e5e390cb-5ffb-4189-bf1b-902ecb991ac8 tempest-VolumesListAdminTestJSON-1524773903 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:25:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e5e390cb-5ffb-4189-bf1b-902ecb991ac8 tempest-VolumesListAdminTestJSON-1524773903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4e86840a-976d-4177-b28d-8e5a035c699b 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:09 devstack sudo[94789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4e86840a-976d-4177-b28d-8e5a035c699b 1073741824 Jul 07 17:25:09 devstack sudo[94789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:09 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-9587639c-2cc1-4390-8f3d-3221bc30ecc5 tempest-VolumesDeleteCascade-2018765742 None] Create snapshot completed successfully Jul 07 17:25:10 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-433a7a85-5ca6-4e6c-9d55-5750838f6424 tempest-GroupsTest-1200662718 None] Group tempest-Group1-1743991446: creating Jul 07 17:25:10 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-433a7a85-5ca6-4e6c-9d55-5750838f6424 tempest-GroupsTest-1200662718 None] Group tempest-Group1-1743991446: created successfully Jul 07 17:25:10 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-433a7a85-5ca6-4e6c-9d55-5750838f6424 tempest-GroupsTest-1200662718 None] Create group completed successfully. Jul 07 17:25:10 devstack sudo[94789]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e5e390cb-5ffb-4189-bf1b-902ecb991ac8 tempest-VolumesListAdminTestJSON-1524773903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4e86840a-976d-4177-b28d-8e5a035c699b 1073741824" returned: 0 in 1.037s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e5e390cb-5ffb-4189-bf1b-902ecb991ac8 tempest-VolumesListAdminTestJSON-1524773903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4e86840a-976d-4177-b28d-8e5a035c699b {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:10 devstack sudo[94796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4e86840a-976d-4177-b28d-8e5a035c699b Jul 07 17:25:10 devstack sudo[94796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-8c669aec-4590-407b-93a6-3c88167eb0e4 tempest-VolumesDeleteCascade-2018765742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:11 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-2342f02a-a98e-463e-a352-25ad79c1c10d tempest-GroupsTest-1200662718 None] Group tempest-Group2-548529540: creating Jul 07 17:25:11 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-2342f02a-a98e-463e-a352-25ad79c1c10d tempest-GroupsTest-1200662718 None] Group tempest-Group2-548529540: created successfully Jul 07 17:25:11 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-2342f02a-a98e-463e-a352-25ad79c1c10d tempest-GroupsTest-1200662718 None] Create group completed successfully. Jul 07 17:25:11 devstack sudo[94796]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e5e390cb-5ffb-4189-bf1b-902ecb991ac8 tempest-VolumesListAdminTestJSON-1524773903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4e86840a-976d-4177-b28d-8e5a035c699b" returned: 0 in 0.795s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:11 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-e5e390cb-5ffb-4189-bf1b-902ecb991ac8 tempest-VolumesListAdminTestJSON-1524773903 None] <== create_volume: return (1882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:25:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e5e390cb-5ffb-4189-bf1b-902ecb991ac8 tempest-VolumesListAdminTestJSON-1524773903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.886s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-8c669aec-4590-407b-93a6-3c88167eb0e4 tempest-VolumesDeleteCascade-2018765742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.651s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:11 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-8c669aec-4590-407b-93a6-3c88167eb0e4 tempest-VolumesDeleteCascade-2018765742 None] Creating offline snapshot 5bb11329-363d-43b0-b19f-0cc310c2b6a7 of volume 32e71cc7-40a6-41c1-8bf6-fc902add7c77 {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:25:11 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e5e390cb-5ffb-4189-bf1b-902ecb991ac8 tempest-VolumesListAdminTestJSON-1524773903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edc3809d-6c26-4537-a6c7-33f284398502) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e86840a-976d-4177-b28d-8e5a035c699b', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:11 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e5e390cb-5ffb-4189-bf1b-902ecb991ac8 tempest-VolumesListAdminTestJSON-1524773903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44ed1416-d72a-4762-a496-1b9cfe96daac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:11 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0edbae60-ba8c-4a12-8ef8-8388264828a5]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8c669aec-4590-407b-93a6-3c88167eb0e4 tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.025f08be-1bc5-4804-91e9-8c3042ed53aa {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:11 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-e5e390cb-5ffb-4189-bf1b-902ecb991ac8 tempest-VolumesListAdminTestJSON-1524773903 None] Volume volume-4e86840a-976d-4177-b28d-8e5a035c699b (4e86840a-976d-4177-b28d-8e5a035c699b): created successfully Jul 07 17:25:11 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e5e390cb-5ffb-4189-bf1b-902ecb991ac8 tempest-VolumesListAdminTestJSON-1524773903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44ed1416-d72a-4762-a496-1b9cfe96daac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:11 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e5e390cb-5ffb-4189-bf1b-902ecb991ac8 tempest-VolumesListAdminTestJSON-1524773903 None] Flow 'volume_create_manager' (e5d403fc-925b-4135-afab-1c93cea119a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:25:11 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-e5e390cb-5ffb-4189-bf1b-902ecb991ac8 tempest-VolumesListAdminTestJSON-1524773903 None] Created volume successfully. Jul 07 17:25:11 devstack sudo[94803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.025f08be-1bc5-4804-91e9-8c3042ed53aa Jul 07 17:25:11 devstack sudo[94803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:12 devstack sudo[94803]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8c669aec-4590-407b-93a6-3c88167eb0e4 tempest-VolumesDeleteCascade-2018765742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.025f08be-1bc5-4804-91e9-8c3042ed53aa" returned: 0 in 0.832s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:12 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-8c669aec-4590-407b-93a6-3c88167eb0e4 tempest-VolumesDeleteCascade-2018765742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:25:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8c669aec-4590-407b-93a6-3c88167eb0e4 tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.025f08be-1bc5-4804-91e9-8c3042ed53aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.5bb11329-363d-43b0-b19f-0cc310c2b6a7 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:12 devstack sudo[94808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.025f08be-1bc5-4804-91e9-8c3042ed53aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.5bb11329-363d-43b0-b19f-0cc310c2b6a7 1G Jul 07 17:25:12 devstack sudo[94808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:13 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-c83fc664-6904-4d17-a50a-19586968e186 tempest-VolumesListAdminTestJSON-2125404058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:25:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c83fc664-6904-4d17-a50a-19586968e186 tempest-VolumesListAdminTestJSON-2125404058 None] Flow 'volume_create_manager' (897a85c3-cb2a-4c7d-8d5e-54619e6e5e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:25:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c83fc664-6904-4d17-a50a-19586968e186 tempest-VolumesListAdminTestJSON-2125404058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ea4b977-e421-43b6-b7e5-3fe5f42f9076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c83fc664-6904-4d17-a50a-19586968e186 tempest-VolumesListAdminTestJSON-2125404058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ea4b977-e421-43b6-b7e5-3fe5f42f9076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5d0fd5b-a0d3-4f90-9704-76b02e5fd84d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae2ea574e8724a648125bcfcff6c30c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:25:13Z,use_quota=True,user_id='4c1d44863cb84c799a6c8e7b51f5592e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c83fc664-6904-4d17-a50a-19586968e186 tempest-VolumesListAdminTestJSON-2125404058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27c047ab-6238-4a66-8b40-eb3e56f1511d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c83fc664-6904-4d17-a50a-19586968e186 tempest-VolumesListAdminTestJSON-2125404058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27c047ab-6238-4a66-8b40-eb3e56f1511d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c83fc664-6904-4d17-a50a-19586968e186 tempest-VolumesListAdminTestJSON-2125404058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bc9f782-132a-437b-bd6d-6d625bcae1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c83fc664-6904-4d17-a50a-19586968e186 tempest-VolumesListAdminTestJSON-2125404058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bc9f782-132a-437b-bd6d-6d625bcae1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5d0fd5b-a0d3-4f90-9704-76b02e5fd84d', 'volume_name': 'volume-c5d0fd5b-a0d3-4f90-9704-76b02e5fd84d', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c83fc664-6904-4d17-a50a-19586968e186 tempest-VolumesListAdminTestJSON-2125404058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fae72b52-c27f-4924-916f-73b6d4400eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c83fc664-6904-4d17-a50a-19586968e186 tempest-VolumesListAdminTestJSON-2125404058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fae72b52-c27f-4924-916f-73b6d4400eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c83fc664-6904-4d17-a50a-19586968e186 tempest-VolumesListAdminTestJSON-2125404058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b87375e-2678-4041-a53c-3dcd797cb961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:13 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-c83fc664-6904-4d17-a50a-19586968e186 tempest-VolumesListAdminTestJSON-2125404058 None] Volume c5d0fd5b-a0d3-4f90-9704-76b02e5fd84d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5d0fd5b-a0d3-4f90-9704-76b02e5fd84d', 'volume_size': 1} Jul 07 17:25:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c83fc664-6904-4d17-a50a-19586968e186 tempest-VolumesListAdminTestJSON-2125404058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:13 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-586f79e2-104b-4ffa-a2f0-273ff6756879 tempest-GroupsTest-1200662718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:25:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-586f79e2-104b-4ffa-a2f0-273ff6756879 tempest-GroupsTest-1200662718 None] Flow 'volume_create_manager' (ce7c27f8-34d7-4951-881d-27098890681a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:25:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-586f79e2-104b-4ffa-a2f0-273ff6756879 tempest-GroupsTest-1200662718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c574773-6da8-461b-bef6-3b2ea1076ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-586f79e2-104b-4ffa-a2f0-273ff6756879 tempest-GroupsTest-1200662718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c574773-6da8-461b-bef6-3b2ea1076ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1768962279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=94a537d5-3c8f-45d1-9646-7534e8519593,host='devstack@QuobyteHD#QuobyteHD',id=8b0aa567-f628-43da-a075-34ca6b02a745,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d33931ceb44f40c5ae678cc440289abe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:25:13Z,use_quota=True,user_id='5b880e5483a241e59f4c12f455181642',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4adba214-7b37-4823-884c-c4a38b1c89c4),volume_type_id=4adba214-7b37-4823-884c-c4a38b1c89c4)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-586f79e2-104b-4ffa-a2f0-273ff6756879 tempest-GroupsTest-1200662718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0f8424f-9747-4a56-9bf4-ee51affc93f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-586f79e2-104b-4ffa-a2f0-273ff6756879 tempest-GroupsTest-1200662718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0f8424f-9747-4a56-9bf4-ee51affc93f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-586f79e2-104b-4ffa-a2f0-273ff6756879 tempest-GroupsTest-1200662718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b36dae1-57c4-4862-bf00-882ac509976a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-586f79e2-104b-4ffa-a2f0-273ff6756879 tempest-GroupsTest-1200662718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b36dae1-57c4-4862-bf00-882ac509976a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b0aa567-f628-43da-a075-34ca6b02a745', 'volume_name': 'volume-8b0aa567-f628-43da-a075-34ca6b02a745', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-586f79e2-104b-4ffa-a2f0-273ff6756879 tempest-GroupsTest-1200662718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6005a636-3553-4b8a-9dc5-6da59e971ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-586f79e2-104b-4ffa-a2f0-273ff6756879 tempest-GroupsTest-1200662718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6005a636-3553-4b8a-9dc5-6da59e971ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-586f79e2-104b-4ffa-a2f0-273ff6756879 tempest-GroupsTest-1200662718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (569ed59f-52d1-4bd5-a1fb-9dafd3f57e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:13 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-586f79e2-104b-4ffa-a2f0-273ff6756879 tempest-GroupsTest-1200662718 None] Volume 8b0aa567-f628-43da-a075-34ca6b02a745: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b0aa567-f628-43da-a075-34ca6b02a745', 'volume_size': 1} Jul 07 17:25:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-586f79e2-104b-4ffa-a2f0-273ff6756879 tempest-GroupsTest-1200662718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:13 devstack sudo[94808]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8c669aec-4590-407b-93a6-3c88167eb0e4 tempest-VolumesDeleteCascade-2018765742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.025f08be-1bc5-4804-91e9-8c3042ed53aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.5bb11329-363d-43b0-b19f-0cc310c2b6a7 1G" returned: 0 in 0.999s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8c669aec-4590-407b-93a6-3c88167eb0e4 tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.025f08be-1bc5-4804-91e9-8c3042ed53aa -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.5bb11329-363d-43b0-b19f-0cc310c2b6a7 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:13 devstack sudo[94813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.025f08be-1bc5-4804-91e9-8c3042ed53aa -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.5bb11329-363d-43b0-b19f-0cc310c2b6a7 Jul 07 17:25:13 devstack sudo[94813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:14 devstack sudo[94813]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8c669aec-4590-407b-93a6-3c88167eb0e4 tempest-VolumesDeleteCascade-2018765742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.025f08be-1bc5-4804-91e9-8c3042ed53aa -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.5bb11329-363d-43b0-b19f-0cc310c2b6a7" returned: 0 in 0.661s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:14 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-8c669aec-4590-407b-93a6-3c88167eb0e4 tempest-VolumesDeleteCascade-2018765742 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.5bb11329-363d-43b0-b19f-0cc310c2b6a7 is being set with open permissions: ugo+rw Jul 07 17:25:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8c669aec-4590-407b-93a6-3c88167eb0e4 tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.5bb11329-363d-43b0-b19f-0cc310c2b6a7 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:14 devstack sudo[94818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.5bb11329-363d-43b0-b19f-0cc310c2b6a7 Jul 07 17:25:14 devstack sudo[94818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:14 devstack sudo[94818]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8c669aec-4590-407b-93a6-3c88167eb0e4 tempest-VolumesDeleteCascade-2018765742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.5bb11329-363d-43b0-b19f-0cc310c2b6a7" returned: 0 in 0.602s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-8c669aec-4590-407b-93a6-3c88167eb0e4 tempest-VolumesDeleteCascade-2018765742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.238s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c83fc664-6904-4d17-a50a-19586968e186 tempest-VolumesListAdminTestJSON-2125404058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.683s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:14 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c83fc664-6904-4d17-a50a-19586968e186 tempest-VolumesListAdminTestJSON-2125404058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5d0fd5b-a0d3-4f90-9704-76b02e5fd84d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae2ea574e8724a648125bcfcff6c30c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:25:13Z,use_quota=True,user_id='4c1d44863cb84c799a6c8e7b51f5592e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:25:14 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-c83fc664-6904-4d17-a50a-19586968e186 tempest-VolumesListAdminTestJSON-2125404058 None] Creating volume c5d0fd5b-a0d3-4f90-9704-76b02e5fd84d {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:25:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c83fc664-6904-4d17-a50a-19586968e186 tempest-VolumesListAdminTestJSON-2125404058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c83fc664-6904-4d17-a50a-19586968e186 tempest-VolumesListAdminTestJSON-2125404058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:14 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c83fc664-6904-4d17-a50a-19586968e186 tempest-VolumesListAdminTestJSON-2125404058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:25:14 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c83fc664-6904-4d17-a50a-19586968e186 tempest-VolumesListAdminTestJSON-2125404058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:25:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c83fc664-6904-4d17-a50a-19586968e186 tempest-VolumesListAdminTestJSON-2125404058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:14 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c83fc664-6904-4d17-a50a-19586968e186 tempest-VolumesListAdminTestJSON-2125404058 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:25:14 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-c83fc664-6904-4d17-a50a-19586968e186 tempest-VolumesListAdminTestJSON-2125404058 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:25:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c83fc664-6904-4d17-a50a-19586968e186 tempest-VolumesListAdminTestJSON-2125404058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c5d0fd5b-a0d3-4f90-9704-76b02e5fd84d 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:14 devstack sudo[94821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c5d0fd5b-a0d3-4f90-9704-76b02e5fd84d 1073741824 Jul 07 17:25:14 devstack sudo[94821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:14 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-8c669aec-4590-407b-93a6-3c88167eb0e4 tempest-VolumesDeleteCascade-2018765742 None] Create snapshot completed successfully Jul 07 17:25:15 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Acquiring lock "cinder-32e71cc7-40a6-41c1-8bf6-fc902add7c77-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:25:15 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Lock "cinder-32e71cc7-40a6-41c1-8bf6-fc902add7c77-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:25:15 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Performing cascade delete. {{(pid=87233) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 07 17:25:15 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Acquiring lock "cinder-025f08be-1bc5-4804-91e9-8c3042ed53aa-delete_snapshot" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:25:15 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Lock "cinder-025f08be-1bc5-4804-91e9-8c3042ed53aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:25:15 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Acquiring lock "cinder-quobyte-32e71cc7-40a6-41c1-8bf6-fc902add7c77" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:25:15 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Lock "cinder-quobyte-32e71cc7-40a6-41c1-8bf6-fc902add7c77" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:25:15 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Acquiring lock "cinder-quobyte-025f08be-1bc5-4804-91e9-8c3042ed53aa" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:25:15 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Lock "cinder-quobyte-025f08be-1bc5-4804-91e9-8c3042ed53aa" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:25:15 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Deleting offline snapshot 025f08be-1bc5-4804-91e9-8c3042ed53aa of volume 32e71cc7-40a6-41c1-8bf6-fc902add7c77 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:25:15 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] snapshot_file for this snap is: volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.025f08be-1bc5-4804-91e9-8c3042ed53aa {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:25:15 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e723041e-2f9c-49b5-8a22-5895ccda36e3]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.025f08be-1bc5-4804-91e9-8c3042ed53aa {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:15 devstack sudo[94823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.025f08be-1bc5-4804-91e9-8c3042ed53aa Jul 07 17:25:15 devstack sudo[94823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:15 devstack sudo[94821]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c83fc664-6904-4d17-a50a-19586968e186 tempest-VolumesListAdminTestJSON-2125404058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c5d0fd5b-a0d3-4f90-9704-76b02e5fd84d 1073741824" returned: 0 in 0.975s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c83fc664-6904-4d17-a50a-19586968e186 tempest-VolumesListAdminTestJSON-2125404058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c5d0fd5b-a0d3-4f90-9704-76b02e5fd84d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:15 devstack sudo[94829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c5d0fd5b-a0d3-4f90-9704-76b02e5fd84d Jul 07 17:25:15 devstack sudo[94829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:16 devstack sudo[94823]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.025f08be-1bc5-4804-91e9-8c3042ed53aa" returned: 0 in 0.875s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:16 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:25:16 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2385d7d4-7395-4bb8-ba73-8ee5d8f8028a]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:16 devstack sudo[94835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77 Jul 07 17:25:16 devstack sudo[94835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:16 devstack sudo[94829]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c83fc664-6904-4d17-a50a-19586968e186 tempest-VolumesListAdminTestJSON-2125404058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c5d0fd5b-a0d3-4f90-9704-76b02e5fd84d" returned: 0 in 0.825s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:16 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c83fc664-6904-4d17-a50a-19586968e186 tempest-VolumesListAdminTestJSON-2125404058 None] <== create_volume: return (1849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:25:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c83fc664-6904-4d17-a50a-19586968e186 tempest-VolumesListAdminTestJSON-2125404058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.852s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-586f79e2-104b-4ffa-a2f0-273ff6756879 tempest-GroupsTest-1200662718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.394s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:16 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-586f79e2-104b-4ffa-a2f0-273ff6756879 tempest-GroupsTest-1200662718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=94a537d5-3c8f-45d1-9646-7534e8519593,created_at=2026-07-07T15:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1768962279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=94a537d5-3c8f-45d1-9646-7534e8519593,host='devstack@QuobyteHD#QuobyteHD',id=8b0aa567-f628-43da-a075-34ca6b02a745,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d33931ceb44f40c5ae678cc440289abe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:25:13Z,use_quota=True,user_id='5b880e5483a241e59f4c12f455181642',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4adba214-7b37-4823-884c-c4a38b1c89c4),volume_type_id=4adba214-7b37-4823-884c-c4a38b1c89c4)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:25:16 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-586f79e2-104b-4ffa-a2f0-273ff6756879 tempest-GroupsTest-1200662718 None] Creating volume 8b0aa567-f628-43da-a075-34ca6b02a745 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:25:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-586f79e2-104b-4ffa-a2f0-273ff6756879 tempest-GroupsTest-1200662718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-586f79e2-104b-4ffa-a2f0-273ff6756879 tempest-GroupsTest-1200662718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:16 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-586f79e2-104b-4ffa-a2f0-273ff6756879 tempest-GroupsTest-1200662718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:25:16 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-586f79e2-104b-4ffa-a2f0-273ff6756879 tempest-GroupsTest-1200662718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:25:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-586f79e2-104b-4ffa-a2f0-273ff6756879 tempest-GroupsTest-1200662718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:16 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-586f79e2-104b-4ffa-a2f0-273ff6756879 tempest-GroupsTest-1200662718 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:25:16 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-586f79e2-104b-4ffa-a2f0-273ff6756879 tempest-GroupsTest-1200662718 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:25:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-586f79e2-104b-4ffa-a2f0-273ff6756879 tempest-GroupsTest-1200662718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8b0aa567-f628-43da-a075-34ca6b02a745 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:16 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c83fc664-6904-4d17-a50a-19586968e186 tempest-VolumesListAdminTestJSON-2125404058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b87375e-2678-4041-a53c-3dcd797cb961) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5d0fd5b-a0d3-4f90-9704-76b02e5fd84d', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:16 devstack sudo[94838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8b0aa567-f628-43da-a075-34ca6b02a745 1073741824 Jul 07 17:25:16 devstack sudo[94838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:16 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c83fc664-6904-4d17-a50a-19586968e186 tempest-VolumesListAdminTestJSON-2125404058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ed48a9a-4762-43ff-9e5f-94a2909baf9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:16 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-c83fc664-6904-4d17-a50a-19586968e186 tempest-VolumesListAdminTestJSON-2125404058 None] Volume volume-c5d0fd5b-a0d3-4f90-9704-76b02e5fd84d (c5d0fd5b-a0d3-4f90-9704-76b02e5fd84d): created successfully Jul 07 17:25:16 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c83fc664-6904-4d17-a50a-19586968e186 tempest-VolumesListAdminTestJSON-2125404058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ed48a9a-4762-43ff-9e5f-94a2909baf9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:16 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c83fc664-6904-4d17-a50a-19586968e186 tempest-VolumesListAdminTestJSON-2125404058 None] Flow 'volume_create_manager' (897a85c3-cb2a-4c7d-8d5e-54619e6e5e33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:25:16 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-c83fc664-6904-4d17-a50a-19586968e186 tempest-VolumesListAdminTestJSON-2125404058 None] Created volume successfully. Jul 07 17:25:17 devstack sudo[94835]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77" returned: 0 in 1.013s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:17 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-26fc51d6-6241-43e6-b140-7e9b5bffaa01 tempest-VolumesListAdminTestJSON-2125404058 None] Acquiring lock "cinder-c5d0fd5b-a0d3-4f90-9704-76b02e5fd84d-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:25:17 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-26fc51d6-6241-43e6-b140-7e9b5bffaa01 tempest-VolumesListAdminTestJSON-2125404058 None] Lock "cinder-c5d0fd5b-a0d3-4f90-9704-76b02e5fd84d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:25:17 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6782f9a7-a37c-4d9b-9481-8d4999d05652]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.5bb11329-363d-43b0-b19f-0cc310c2b6a7 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:17 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-26fc51d6-6241-43e6-b140-7e9b5bffaa01 tempest-VolumesListAdminTestJSON-2125404058 None] Acquiring lock "cinder-quobyte-c5d0fd5b-a0d3-4f90-9704-76b02e5fd84d" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:25:17 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-26fc51d6-6241-43e6-b140-7e9b5bffaa01 tempest-VolumesListAdminTestJSON-2125404058 None] Lock "cinder-quobyte-c5d0fd5b-a0d3-4f90-9704-76b02e5fd84d" acquired by "delete_volume" :: waited 0.035s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:25:17 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d261294b-c4c1-43bd-b849-4e44444df0c8]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-26fc51d6-6241-43e6-b140-7e9b5bffaa01 tempest-VolumesListAdminTestJSON-2125404058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c5d0fd5b-a0d3-4f90-9704-76b02e5fd84d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:17 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-fe56233b-f3ea-4e31-b33e-585355e71e2f tempest-VolumesListAdminTestJSON-1524773903 None] Acquiring lock "cinder-4e86840a-976d-4177-b28d-8e5a035c699b-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:25:17 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-fe56233b-f3ea-4e31-b33e-585355e71e2f tempest-VolumesListAdminTestJSON-1524773903 None] Lock "cinder-4e86840a-976d-4177-b28d-8e5a035c699b-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:25:17 devstack sudo[94843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.5bb11329-363d-43b0-b19f-0cc310c2b6a7 Jul 07 17:25:17 devstack sudo[94843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:17 devstack sudo[94848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c5d0fd5b-a0d3-4f90-9704-76b02e5fd84d Jul 07 17:25:17 devstack sudo[94848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:17 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-fe56233b-f3ea-4e31-b33e-585355e71e2f tempest-VolumesListAdminTestJSON-1524773903 None] Acquiring lock "cinder-quobyte-4e86840a-976d-4177-b28d-8e5a035c699b" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:25:17 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-fe56233b-f3ea-4e31-b33e-585355e71e2f tempest-VolumesListAdminTestJSON-1524773903 None] Lock "cinder-quobyte-4e86840a-976d-4177-b28d-8e5a035c699b" acquired by "delete_volume" :: waited 0.049s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:25:17 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[89cd6561-e362-4d13-93a3-400cd8477802]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fe56233b-f3ea-4e31-b33e-585355e71e2f tempest-VolumesListAdminTestJSON-1524773903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4e86840a-976d-4177-b28d-8e5a035c699b {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:18 devstack sudo[94854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4e86840a-976d-4177-b28d-8e5a035c699b Jul 07 17:25:18 devstack sudo[94854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:18 devstack sudo[94838]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-586f79e2-104b-4ffa-a2f0-273ff6756879 tempest-GroupsTest-1200662718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8b0aa567-f628-43da-a075-34ca6b02a745 1073741824" returned: 0 in 1.392s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-586f79e2-104b-4ffa-a2f0-273ff6756879 tempest-GroupsTest-1200662718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8b0aa567-f628-43da-a075-34ca6b02a745 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:18 devstack sudo[94863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8b0aa567-f628-43da-a075-34ca6b02a745 Jul 07 17:25:18 devstack sudo[94863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:18 devstack sudo[94843]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.5bb11329-363d-43b0-b19f-0cc310c2b6a7" returned: 0 in 1.289s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:18 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:25:18 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6790a48-9989-4d2b-9f3a-237fefec9399]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.025f08be-1bc5-4804-91e9-8c3042ed53aa {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:18 devstack sudo[94848]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-26fc51d6-6241-43e6-b140-7e9b5bffaa01 tempest-VolumesListAdminTestJSON-2125404058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c5d0fd5b-a0d3-4f90-9704-76b02e5fd84d" returned: 0 in 1.199s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-26fc51d6-6241-43e6-b140-7e9b5bffaa01 tempest-VolumesListAdminTestJSON-2125404058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c5d0fd5b-a0d3-4f90-9704-76b02e5fd84d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:18 devstack sudo[94879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c5d0fd5b-a0d3-4f90-9704-76b02e5fd84d Jul 07 17:25:18 devstack sudo[94879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:18 devstack sudo[94878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.025f08be-1bc5-4804-91e9-8c3042ed53aa Jul 07 17:25:18 devstack sudo[94878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:19 devstack sudo[94854]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fe56233b-f3ea-4e31-b33e-585355e71e2f tempest-VolumesListAdminTestJSON-1524773903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4e86840a-976d-4177-b28d-8e5a035c699b" returned: 0 in 1.183s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fe56233b-f3ea-4e31-b33e-585355e71e2f tempest-VolumesListAdminTestJSON-1524773903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4e86840a-976d-4177-b28d-8e5a035c699b {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:19 devstack sudo[94886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4e86840a-976d-4177-b28d-8e5a035c699b Jul 07 17:25:19 devstack sudo[94886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:19 devstack sudo[94863]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-586f79e2-104b-4ffa-a2f0-273ff6756879 tempest-GroupsTest-1200662718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8b0aa567-f628-43da-a075-34ca6b02a745" returned: 0 in 0.958s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:19 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-586f79e2-104b-4ffa-a2f0-273ff6756879 tempest-GroupsTest-1200662718 None] <== create_volume: return (2433ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:25:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-586f79e2-104b-4ffa-a2f0-273ff6756879 tempest-GroupsTest-1200662718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.437s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:19 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-586f79e2-104b-4ffa-a2f0-273ff6756879 tempest-GroupsTest-1200662718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (569ed59f-52d1-4bd5-a1fb-9dafd3f57e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b0aa567-f628-43da-a075-34ca6b02a745', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:19 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-586f79e2-104b-4ffa-a2f0-273ff6756879 tempest-GroupsTest-1200662718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54090fbe-d1bd-4f28-a7af-15a8010bb2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:19 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-586f79e2-104b-4ffa-a2f0-273ff6756879 tempest-GroupsTest-1200662718 None] Volume volume-8b0aa567-f628-43da-a075-34ca6b02a745 (8b0aa567-f628-43da-a075-34ca6b02a745): created successfully Jul 07 17:25:19 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-586f79e2-104b-4ffa-a2f0-273ff6756879 tempest-GroupsTest-1200662718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54090fbe-d1bd-4f28-a7af-15a8010bb2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:19 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-586f79e2-104b-4ffa-a2f0-273ff6756879 tempest-GroupsTest-1200662718 None] Flow 'volume_create_manager' (ce7c27f8-34d7-4951-881d-27098890681a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:25:19 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-586f79e2-104b-4ffa-a2f0-273ff6756879 tempest-GroupsTest-1200662718 None] Created volume successfully. Jul 07 17:25:19 devstack sudo[94879]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-26fc51d6-6241-43e6-b140-7e9b5bffaa01 tempest-VolumesListAdminTestJSON-2125404058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c5d0fd5b-a0d3-4f90-9704-76b02e5fd84d" returned: 0 in 0.724s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:19 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-26fc51d6-6241-43e6-b140-7e9b5bffaa01 tempest-VolumesListAdminTestJSON-2125404058 None] Lock "cinder-quobyte-c5d0fd5b-a0d3-4f90-9704-76b02e5fd84d" released by "delete_volume" :: held 1.988s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:25:19 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-26fc51d6-6241-43e6-b140-7e9b5bffaa01 tempest-VolumesListAdminTestJSON-2125404058 None] Created reservations ['3aecc6ea-f3d6-4b66-ad69-24852d4ecace', '69ed6db2-4bd0-4e18-b906-5a14dee53db3', '2bb53dcb-d4d5-4d8a-ae55-1e55897d7295', '0d7bd05d-9bf8-489f-929f-b33c245ac806'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:25:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-26fc51d6-6241-43e6-b140-7e9b5bffaa01 tempest-VolumesListAdminTestJSON-2125404058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-26fc51d6-6241-43e6-b140-7e9b5bffaa01 tempest-VolumesListAdminTestJSON-2125404058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:19 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-26fc51d6-6241-43e6-b140-7e9b5bffaa01 tempest-VolumesListAdminTestJSON-2125404058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:25:19 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-26fc51d6-6241-43e6-b140-7e9b5bffaa01 tempest-VolumesListAdminTestJSON-2125404058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:25:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-26fc51d6-6241-43e6-b140-7e9b5bffaa01 tempest-VolumesListAdminTestJSON-2125404058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-26fc51d6-6241-43e6-b140-7e9b5bffaa01 tempest-VolumesListAdminTestJSON-2125404058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:19 devstack sudo[94892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:25:19 devstack sudo[94892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:19 devstack sudo[94878]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.025f08be-1bc5-4804-91e9-8c3042ed53aa" returned: 0 in 1.032s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:19 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:25:19 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0986cf57-c0cb-4c7e-bc1d-7de9ba6f63a2]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:19 devstack sudo[94886]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fe56233b-f3ea-4e31-b33e-585355e71e2f tempest-VolumesListAdminTestJSON-1524773903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4e86840a-976d-4177-b28d-8e5a035c699b" returned: 0 in 0.843s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:19 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-fe56233b-f3ea-4e31-b33e-585355e71e2f tempest-VolumesListAdminTestJSON-1524773903 None] Lock "cinder-quobyte-4e86840a-976d-4177-b28d-8e5a035c699b" released by "delete_volume" :: held 2.107s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:25:19 devstack sudo[94895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77 Jul 07 17:25:19 devstack sudo[94895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:19 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-fe56233b-f3ea-4e31-b33e-585355e71e2f tempest-VolumesListAdminTestJSON-1524773903 None] Created reservations ['473ebc89-4f56-4494-a5f4-c752a73794ca', '68f48787-389c-4d8b-aa9a-1fc9e35dee95', '63d68fd6-a5d2-4bc7-af2d-0ef3ed0ab87c', 'f855fab0-4d4b-49b7-9adc-13ed7f5f1d2a'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:25:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-fe56233b-f3ea-4e31-b33e-585355e71e2f tempest-VolumesListAdminTestJSON-1524773903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-fe56233b-f3ea-4e31-b33e-585355e71e2f tempest-VolumesListAdminTestJSON-1524773903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:20 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-fe56233b-f3ea-4e31-b33e-585355e71e2f tempest-VolumesListAdminTestJSON-1524773903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:25:20 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-fe56233b-f3ea-4e31-b33e-585355e71e2f tempest-VolumesListAdminTestJSON-1524773903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:25:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-fe56233b-f3ea-4e31-b33e-585355e71e2f tempest-VolumesListAdminTestJSON-1524773903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fe56233b-f3ea-4e31-b33e-585355e71e2f tempest-VolumesListAdminTestJSON-1524773903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:20 devstack sudo[94898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:25:20 devstack sudo[94898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:20 devstack sudo[94892]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-26fc51d6-6241-43e6-b140-7e9b5bffaa01 tempest-VolumesListAdminTestJSON-2125404058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.872s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:20 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-26fc51d6-6241-43e6-b140-7e9b5bffaa01 tempest-VolumesListAdminTestJSON-2125404058 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:25:20 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-26fc51d6-6241-43e6-b140-7e9b5bffaa01 tempest-VolumesListAdminTestJSON-2125404058 None] Deleted volume successfully. Jul 07 17:25:20 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-26fc51d6-6241-43e6-b140-7e9b5bffaa01 tempest-VolumesListAdminTestJSON-2125404058 None] Lock "cinder-c5d0fd5b-a0d3-4f90-9704-76b02e5fd84d-delete_volume" released by "delete_volume" :: held 3.165s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:25:20 devstack sudo[94895]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77" returned: 0 in 0.925s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.025f08be-1bc5-4804-91e9-8c3042ed53aa {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:20 devstack sudo[94911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.025f08be-1bc5-4804-91e9-8c3042ed53aa Jul 07 17:25:20 devstack sudo[94911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:20 devstack sudo[94898]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fe56233b-f3ea-4e31-b33e-585355e71e2f tempest-VolumesListAdminTestJSON-1524773903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.772s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:20 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-fe56233b-f3ea-4e31-b33e-585355e71e2f tempest-VolumesListAdminTestJSON-1524773903 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:25:20 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-fe56233b-f3ea-4e31-b33e-585355e71e2f tempest-VolumesListAdminTestJSON-1524773903 None] Deleted volume successfully. Jul 07 17:25:20 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-fe56233b-f3ea-4e31-b33e-585355e71e2f tempest-VolumesListAdminTestJSON-1524773903 None] Lock "cinder-4e86840a-976d-4177-b28d-8e5a035c699b-delete_volume" released by "delete_volume" :: held 3.208s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:25:21 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ad438b4b-d4e9-4b33-bdd0-99814e19e215 tempest-VolumesListAdminTestJSON-1524773903 None] Acquiring lock "cinder-0478990e-b412-449c-a2fb-d0abd33a61fe-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:25:21 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ad438b4b-d4e9-4b33-bdd0-99814e19e215 tempest-VolumesListAdminTestJSON-1524773903 None] Lock "cinder-0478990e-b412-449c-a2fb-d0abd33a61fe-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:25:21 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ad438b4b-d4e9-4b33-bdd0-99814e19e215 tempest-VolumesListAdminTestJSON-1524773903 None] Acquiring lock "cinder-quobyte-0478990e-b412-449c-a2fb-d0abd33a61fe" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:25:21 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ad438b4b-d4e9-4b33-bdd0-99814e19e215 tempest-VolumesListAdminTestJSON-1524773903 None] Lock "cinder-quobyte-0478990e-b412-449c-a2fb-d0abd33a61fe" acquired by "delete_volume" :: waited 0.023s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:25:21 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e214fe9-f414-4160-8957-30b63cb42d0c]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ad438b4b-d4e9-4b33-bdd0-99814e19e215 tempest-VolumesListAdminTestJSON-1524773903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0478990e-b412-449c-a2fb-d0abd33a61fe {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:21 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-124e6dba-213e-4f7d-85cf-bdf25152518c tempest-GroupsTest-1200662718 None] Acquiring lock "cinder-quobyte-8b0aa567-f628-43da-a075-34ca6b02a745" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:25:21 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-124e6dba-213e-4f7d-85cf-bdf25152518c tempest-GroupsTest-1200662718 None] Lock "cinder-quobyte-8b0aa567-f628-43da-a075-34ca6b02a745" acquired by "delete_volume" :: waited 0.028s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:25:21 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5cd07fa-318e-43c9-83d9-a4ecaaba56a7]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-124e6dba-213e-4f7d-85cf-bdf25152518c tempest-GroupsTest-1200662718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8b0aa567-f628-43da-a075-34ca6b02a745 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:21 devstack sudo[94914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0478990e-b412-449c-a2fb-d0abd33a61fe Jul 07 17:25:21 devstack sudo[94914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:21 devstack sudo[94916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8b0aa567-f628-43da-a075-34ca6b02a745 Jul 07 17:25:21 devstack sudo[94916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:21 devstack sudo[94911]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.025f08be-1bc5-4804-91e9-8c3042ed53aa" returned: 0 in 0.868s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.025f08be-1bc5-4804-91e9-8c3042ed53aa {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:21 devstack sudo[94921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.025f08be-1bc5-4804-91e9-8c3042ed53aa Jul 07 17:25:21 devstack sudo[94921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:22 devstack sudo[94914]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ad438b4b-d4e9-4b33-bdd0-99814e19e215 tempest-VolumesListAdminTestJSON-1524773903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0478990e-b412-449c-a2fb-d0abd33a61fe" returned: 0 in 1.192s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ad438b4b-d4e9-4b33-bdd0-99814e19e215 tempest-VolumesListAdminTestJSON-1524773903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0478990e-b412-449c-a2fb-d0abd33a61fe {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:22 devstack sudo[95048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0478990e-b412-449c-a2fb-d0abd33a61fe Jul 07 17:25:22 devstack sudo[95048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:22 devstack sudo[94916]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-124e6dba-213e-4f7d-85cf-bdf25152518c tempest-GroupsTest-1200662718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8b0aa567-f628-43da-a075-34ca6b02a745" returned: 0 in 1.263s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-124e6dba-213e-4f7d-85cf-bdf25152518c tempest-GroupsTest-1200662718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8b0aa567-f628-43da-a075-34ca6b02a745 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:22 devstack sudo[95056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8b0aa567-f628-43da-a075-34ca6b02a745 Jul 07 17:25:22 devstack sudo[95056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:22 devstack sudo[94921]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.025f08be-1bc5-4804-91e9-8c3042ed53aa" returned: 0 in 1.101s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.5bb11329-363d-43b0-b19f-0cc310c2b6a7 -F qcow2 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:22 devstack sudo[95062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.5bb11329-363d-43b0-b19f-0cc310c2b6a7 -F qcow2 Jul 07 17:25:22 devstack sudo[95062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:23 devstack sudo[95048]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ad438b4b-d4e9-4b33-bdd0-99814e19e215 tempest-VolumesListAdminTestJSON-1524773903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0478990e-b412-449c-a2fb-d0abd33a61fe" returned: 0 in 0.988s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:23 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ad438b4b-d4e9-4b33-bdd0-99814e19e215 tempest-VolumesListAdminTestJSON-1524773903 None] Lock "cinder-quobyte-0478990e-b412-449c-a2fb-d0abd33a61fe" released by "delete_volume" :: held 2.241s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:25:23 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:UPDATE=91,cinder:SELECT=73,cinder:INSERT=25,cinder:DELETE=15 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:25:23 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-ad438b4b-d4e9-4b33-bdd0-99814e19e215 tempest-VolumesListAdminTestJSON-1524773903 None] Created reservations ['6815101f-0d40-4a07-a02b-dcee552aabdb', 'cb4863c6-a1c9-4ad8-8000-5b3688a6cfe1', '9b16cc38-e4ec-43bd-9028-a4f0a5130388', '9a7d4ff2-572f-497e-966a-3618fc949ed6'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:25:23 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:UPDATE=111,cinder:SELECT=77,cinder:INSERT=20,cinder:DELETE=5 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:25:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ad438b4b-d4e9-4b33-bdd0-99814e19e215 tempest-VolumesListAdminTestJSON-1524773903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ad438b4b-d4e9-4b33-bdd0-99814e19e215 tempest-VolumesListAdminTestJSON-1524773903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:23 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ad438b4b-d4e9-4b33-bdd0-99814e19e215 tempest-VolumesListAdminTestJSON-1524773903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:25:23 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ad438b4b-d4e9-4b33-bdd0-99814e19e215 tempest-VolumesListAdminTestJSON-1524773903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:25:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ad438b4b-d4e9-4b33-bdd0-99814e19e215 tempest-VolumesListAdminTestJSON-1524773903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ad438b4b-d4e9-4b33-bdd0-99814e19e215 tempest-VolumesListAdminTestJSON-1524773903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:23 devstack sudo[95085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:25:23 devstack sudo[95085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:23 devstack sudo[95056]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-124e6dba-213e-4f7d-85cf-bdf25152518c tempest-GroupsTest-1200662718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8b0aa567-f628-43da-a075-34ca6b02a745" returned: 0 in 1.053s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:23 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-124e6dba-213e-4f7d-85cf-bdf25152518c tempest-GroupsTest-1200662718 None] Lock "cinder-quobyte-8b0aa567-f628-43da-a075-34ca6b02a745" released by "delete_volume" :: held 2.383s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:25:23 devstack sudo[95062]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.5bb11329-363d-43b0-b19f-0cc310c2b6a7 -F qcow2" returned: 0 in 1.009s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:23 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Lock "cinder-quobyte-025f08be-1bc5-4804-91e9-8c3042ed53aa" released by "_delete_snapshot" :: held 8.423s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:25:23 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Lock "cinder-quobyte-32e71cc7-40a6-41c1-8bf6-fc902add7c77" released by "delete_snapshot" :: held 8.455s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:25:24 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Created reservations ['fe363ca2-1b91-45ba-be38-6ca985c4b1e9', '168ed606-74d1-44e3-bbdd-6c7bd6474656', '9eabe139-b5a2-48ea-ab13-0f4d82bb7940', 'e1303187-fd98-4133-9a5f-25ff171743ee'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:25:24 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-124e6dba-213e-4f7d-85cf-bdf25152518c tempest-GroupsTest-1200662718 None] Created reservations ['8112b400-1d68-410c-b859-c11e2e99a127'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:25:24 devstack cinder-volume[87233]: WARNING cinder.quota [None req-124e6dba-213e-4f7d-85cf-bdf25152518c tempest-GroupsTest-1200662718 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-986368465 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-986368465, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:25:24 devstack cinder-volume[87233]: WARNING cinder.quota [None req-124e6dba-213e-4f7d-85cf-bdf25152518c tempest-GroupsTest-1200662718 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-986368465 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-986368465, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:25:24 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Delete snapshot completed successfully. Jul 07 17:25:24 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Lock "cinder-025f08be-1bc5-4804-91e9-8c3042ed53aa-delete_snapshot" released by "delete_snapshot" :: held 8.851s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:25:24 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Acquiring lock "cinder-5bb11329-363d-43b0-b19f-0cc310c2b6a7-delete_snapshot" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:25:24 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-124e6dba-213e-4f7d-85cf-bdf25152518c tempest-GroupsTest-1200662718 None] Created reservations ['229dc548-f3c9-47a8-90e9-635947d841e4', '549d5908-ff5c-4f5d-bb00-82c69179ec36', '9cc66abd-3560-4ec1-886c-372db363f4d2', '1261c15f-39bb-405e-85ae-b9b2fabd1a90'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:25:24 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Lock "cinder-5bb11329-363d-43b0-b19f-0cc310c2b6a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:25:24 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Acquiring lock "cinder-quobyte-32e71cc7-40a6-41c1-8bf6-fc902add7c77" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:25:24 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Lock "cinder-quobyte-32e71cc7-40a6-41c1-8bf6-fc902add7c77" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:25:24 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Acquiring lock "cinder-quobyte-5bb11329-363d-43b0-b19f-0cc310c2b6a7" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:25:24 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Lock "cinder-quobyte-5bb11329-363d-43b0-b19f-0cc310c2b6a7" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:25:24 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Deleting offline snapshot 5bb11329-363d-43b0-b19f-0cc310c2b6a7 of volume 32e71cc7-40a6-41c1-8bf6-fc902add7c77 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:25:24 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] snapshot_file for this snap is: volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.5bb11329-363d-43b0-b19f-0cc310c2b6a7 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:25:24 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d055090-6ad5-49cf-b31d-81e2c9f9a6cd]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.5bb11329-363d-43b0-b19f-0cc310c2b6a7 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-124e6dba-213e-4f7d-85cf-bdf25152518c tempest-GroupsTest-1200662718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-124e6dba-213e-4f7d-85cf-bdf25152518c tempest-GroupsTest-1200662718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:24 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-124e6dba-213e-4f7d-85cf-bdf25152518c tempest-GroupsTest-1200662718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:25:24 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-124e6dba-213e-4f7d-85cf-bdf25152518c tempest-GroupsTest-1200662718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:25:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-124e6dba-213e-4f7d-85cf-bdf25152518c tempest-GroupsTest-1200662718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-124e6dba-213e-4f7d-85cf-bdf25152518c tempest-GroupsTest-1200662718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:24 devstack sudo[95103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:25:24 devstack sudo[95103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:24 devstack sudo[95085]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ad438b4b-d4e9-4b33-bdd0-99814e19e215 tempest-VolumesListAdminTestJSON-1524773903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.866s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:24 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-ad438b4b-d4e9-4b33-bdd0-99814e19e215 tempest-VolumesListAdminTestJSON-1524773903 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:25:24 devstack sudo[95102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.5bb11329-363d-43b0-b19f-0cc310c2b6a7 Jul 07 17:25:24 devstack sudo[95102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:24 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-ad438b4b-d4e9-4b33-bdd0-99814e19e215 tempest-VolumesListAdminTestJSON-1524773903 None] Deleted volume successfully. Jul 07 17:25:24 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ad438b4b-d4e9-4b33-bdd0-99814e19e215 tempest-VolumesListAdminTestJSON-1524773903 None] Lock "cinder-0478990e-b412-449c-a2fb-d0abd33a61fe-delete_volume" released by "delete_volume" :: held 3.411s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:25:24 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a766a3f0-d8e4-4340-8656-2a19a976f86a tempest-VolumesListAdminTestJSON-1524773903 None] Acquiring lock "cinder-e9b4ca57-801d-4c55-a022-526fe4d33c64-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:25:24 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a766a3f0-d8e4-4340-8656-2a19a976f86a tempest-VolumesListAdminTestJSON-1524773903 None] Lock "cinder-e9b4ca57-801d-4c55-a022-526fe4d33c64-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:25:24 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a766a3f0-d8e4-4340-8656-2a19a976f86a tempest-VolumesListAdminTestJSON-1524773903 None] Acquiring lock "cinder-quobyte-e9b4ca57-801d-4c55-a022-526fe4d33c64" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:25:24 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a766a3f0-d8e4-4340-8656-2a19a976f86a tempest-VolumesListAdminTestJSON-1524773903 None] Lock "cinder-quobyte-e9b4ca57-801d-4c55-a022-526fe4d33c64" acquired by "delete_volume" :: waited 0.030s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:25:24 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6b2132-3ee7-4d6a-8a63-197bb9b24462]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a766a3f0-d8e4-4340-8656-2a19a976f86a tempest-VolumesListAdminTestJSON-1524773903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e9b4ca57-801d-4c55-a022-526fe4d33c64 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:24 devstack sudo[95106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e9b4ca57-801d-4c55-a022-526fe4d33c64 Jul 07 17:25:24 devstack sudo[95106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:25 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-42231a79-7a95-4bf4-80cd-1bbe11398bb1 tempest-GroupsTest-1200662718 None] Created reservations ['7ec0dcde-e2f6-4999-ad87-9e41ebe54e62'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:25:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-42231a79-7a95-4bf4-80cd-1bbe11398bb1 tempest-GroupsTest-1200662718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-42231a79-7a95-4bf4-80cd-1bbe11398bb1 tempest-GroupsTest-1200662718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:25 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-42231a79-7a95-4bf4-80cd-1bbe11398bb1 tempest-GroupsTest-1200662718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:25:25 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-42231a79-7a95-4bf4-80cd-1bbe11398bb1 tempest-GroupsTest-1200662718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:25:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-42231a79-7a95-4bf4-80cd-1bbe11398bb1 tempest-GroupsTest-1200662718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-42231a79-7a95-4bf4-80cd-1bbe11398bb1 tempest-GroupsTest-1200662718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:25 devstack sudo[95112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:25:25 devstack sudo[95112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:25 devstack sudo[95103]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-124e6dba-213e-4f7d-85cf-bdf25152518c tempest-GroupsTest-1200662718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 1.316s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:25 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-124e6dba-213e-4f7d-85cf-bdf25152518c tempest-GroupsTest-1200662718 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:25:25 devstack sudo[95102]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.5bb11329-363d-43b0-b19f-0cc310c2b6a7" returned: 0 in 1.411s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:25 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:25:25 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-124e6dba-213e-4f7d-85cf-bdf25152518c tempest-GroupsTest-1200662718 None] Delete group completed successfully. Jul 07 17:25:25 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e5f32e-fd3e-418f-aef5-c93374a538f3]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:25 devstack sudo[95116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77 Jul 07 17:25:25 devstack sudo[95116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:26 devstack sudo[95106]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a766a3f0-d8e4-4340-8656-2a19a976f86a tempest-VolumesListAdminTestJSON-1524773903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e9b4ca57-801d-4c55-a022-526fe4d33c64" returned: 0 in 1.307s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a766a3f0-d8e4-4340-8656-2a19a976f86a tempest-VolumesListAdminTestJSON-1524773903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e9b4ca57-801d-4c55-a022-526fe4d33c64 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:26 devstack sudo[95123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e9b4ca57-801d-4c55-a022-526fe4d33c64 Jul 07 17:25:26 devstack sudo[95123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:26 devstack sudo[95112]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-42231a79-7a95-4bf4-80cd-1bbe11398bb1 tempest-GroupsTest-1200662718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.948s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:26 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-42231a79-7a95-4bf4-80cd-1bbe11398bb1 tempest-GroupsTest-1200662718 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:25:26 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-42231a79-7a95-4bf4-80cd-1bbe11398bb1 tempest-GroupsTest-1200662718 None] Delete group completed successfully. Jul 07 17:25:26 devstack sudo[95116]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77" returned: 0 in 0.973s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.5bb11329-363d-43b0-b19f-0cc310c2b6a7 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:26 devstack sudo[95128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.5bb11329-363d-43b0-b19f-0cc310c2b6a7 Jul 07 17:25:26 devstack sudo[95128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:27 devstack sudo[95123]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a766a3f0-d8e4-4340-8656-2a19a976f86a tempest-VolumesListAdminTestJSON-1524773903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e9b4ca57-801d-4c55-a022-526fe4d33c64" returned: 0 in 1.015s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:27 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a766a3f0-d8e4-4340-8656-2a19a976f86a tempest-VolumesListAdminTestJSON-1524773903 None] Lock "cinder-quobyte-e9b4ca57-801d-4c55-a022-526fe4d33c64" released by "delete_volume" :: held 2.383s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:25:27 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-a766a3f0-d8e4-4340-8656-2a19a976f86a tempest-VolumesListAdminTestJSON-1524773903 None] Created reservations ['aea9ac33-19b7-4165-b637-f42190311c9e', 'bd0a4f91-eb7d-4d87-be32-ad4d0e43d17f', '7a48cdfa-b4f4-4369-baf6-409a9a8320da', '83e661f2-6d30-4ab8-b0cd-6f9e11f59af9'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:25:27 devstack sudo[95128]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.5bb11329-363d-43b0-b19f-0cc310c2b6a7" returned: 0 in 0.951s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.5bb11329-363d-43b0-b19f-0cc310c2b6a7 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:27 devstack sudo[95135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.5bb11329-363d-43b0-b19f-0cc310c2b6a7 Jul 07 17:25:27 devstack sudo[95135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a766a3f0-d8e4-4340-8656-2a19a976f86a tempest-VolumesListAdminTestJSON-1524773903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a766a3f0-d8e4-4340-8656-2a19a976f86a tempest-VolumesListAdminTestJSON-1524773903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:27 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-a766a3f0-d8e4-4340-8656-2a19a976f86a tempest-VolumesListAdminTestJSON-1524773903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:25:27 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-a766a3f0-d8e4-4340-8656-2a19a976f86a tempest-VolumesListAdminTestJSON-1524773903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:25:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a766a3f0-d8e4-4340-8656-2a19a976f86a tempest-VolumesListAdminTestJSON-1524773903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a766a3f0-d8e4-4340-8656-2a19a976f86a tempest-VolumesListAdminTestJSON-1524773903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:27 devstack sudo[95137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:25:27 devstack sudo[95137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:28 devstack sudo[95135]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77.5bb11329-363d-43b0-b19f-0cc310c2b6a7" returned: 0 in 0.867s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:28 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Lock "cinder-quobyte-5bb11329-363d-43b0-b19f-0cc310c2b6a7" released by "_delete_snapshot" :: held 4.342s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:25:28 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Lock "cinder-quobyte-32e71cc7-40a6-41c1-8bf6-fc902add7c77" released by "delete_snapshot" :: held 4.384s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:25:28 devstack sudo[95137]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a766a3f0-d8e4-4340-8656-2a19a976f86a tempest-VolumesListAdminTestJSON-1524773903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.801s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:28 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-a766a3f0-d8e4-4340-8656-2a19a976f86a tempest-VolumesListAdminTestJSON-1524773903 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:25:28 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-a766a3f0-d8e4-4340-8656-2a19a976f86a tempest-VolumesListAdminTestJSON-1524773903 None] Deleted volume successfully. Jul 07 17:25:31 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Created reservations ['78abe285-d464-4ed6-bdc4-10284b51db18', '08f5182c-fa09-41f8-abd7-867a75068856', '6eef9445-6b66-47df-906e-a86a9fcfcce8', 'eb82d826-7fc3-4477-8191-310714ad3401'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:25:31 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-83c79689-1e09-4502-91cd-9856ae012fb6 tempest-GroupsTest-1200662718 None] Group tempest-GroupsTest-Group-122299031: creating Jul 07 17:25:31 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a766a3f0-d8e4-4340-8656-2a19a976f86a tempest-VolumesListAdminTestJSON-1524773903 None] Lock "cinder-e9b4ca57-801d-4c55-a022-526fe4d33c64-delete_volume" released by "delete_volume" :: held 6.763s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:25:31 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-83c79689-1e09-4502-91cd-9856ae012fb6 tempest-GroupsTest-1200662718 None] Group tempest-GroupsTest-Group-122299031: created successfully Jul 07 17:25:31 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-83c79689-1e09-4502-91cd-9856ae012fb6 tempest-GroupsTest-1200662718 None] Create group completed successfully. Jul 07 17:25:31 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Delete snapshot completed successfully. Jul 07 17:25:31 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Lock "cinder-5bb11329-363d-43b0-b19f-0cc310c2b6a7-delete_snapshot" released by "delete_snapshot" :: held 7.392s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:25:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Snapshots deleted, issuing volume delete {{(pid=87233) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 07 17:25:31 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Acquiring lock "cinder-quobyte-32e71cc7-40a6-41c1-8bf6-fc902add7c77" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:25:31 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Lock "cinder-quobyte-32e71cc7-40a6-41c1-8bf6-fc902add7c77" acquired by "delete_volume" :: waited 0.032s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:25:31 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d8da1c-3bf8-43ad-9f17-959a4d11c59d]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:31 devstack sudo[95143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77 Jul 07 17:25:31 devstack sudo[95143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:32 devstack sudo[95143]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77" returned: 0 in 1.115s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:32 devstack sudo[95149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77 Jul 07 17:25:32 devstack sudo[95149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:33 devstack sudo[95149]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-32e71cc7-40a6-41c1-8bf6-fc902add7c77" returned: 0 in 0.982s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:33 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Lock "cinder-quobyte-32e71cc7-40a6-41c1-8bf6-fc902add7c77" released by "delete_volume" :: held 2.190s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:25:33 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-93d03854-9d55-41b7-b538-5488df4a0665 tempest-GroupsTest-1200662718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:25:33 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-93d03854-9d55-41b7-b538-5488df4a0665 tempest-GroupsTest-1200662718 None] Flow 'volume_create_manager' (a103f662-0f8b-4c40-bfd5-4b71437603f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:25:33 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-93d03854-9d55-41b7-b538-5488df4a0665 tempest-GroupsTest-1200662718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a9eb747-efb0-4dae-b46f-e92378edacfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:33 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-93d03854-9d55-41b7-b538-5488df4a0665 tempest-GroupsTest-1200662718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a9eb747-efb0-4dae-b46f-e92378edacfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1106378203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1ccf17cd-a43b-4486-827e-d10be3c0b02e,host='devstack@QuobyteHD#QuobyteHD',id=d0aa278f-3e36-48de-b7a7-a5c203aecfbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d33931ceb44f40c5ae678cc440289abe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:25:34Z,use_quota=True,user_id='5b880e5483a241e59f4c12f455181642',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ff4c7f1e-45ef-491c-a63d-3162975e7697),volume_type_id=ff4c7f1e-45ef-491c-a63d-3162975e7697)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:33 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-93d03854-9d55-41b7-b538-5488df4a0665 tempest-GroupsTest-1200662718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da832a7e-24fc-433c-8a88-c7941788e3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:33 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-93d03854-9d55-41b7-b538-5488df4a0665 tempest-GroupsTest-1200662718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da832a7e-24fc-433c-8a88-c7941788e3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:33 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-93d03854-9d55-41b7-b538-5488df4a0665 tempest-GroupsTest-1200662718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2326703e-6c12-4f9f-9d15-2ec2403f5f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:33 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-93d03854-9d55-41b7-b538-5488df4a0665 tempest-GroupsTest-1200662718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2326703e-6c12-4f9f-9d15-2ec2403f5f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0aa278f-3e36-48de-b7a7-a5c203aecfbe', 'volume_name': 'volume-d0aa278f-3e36-48de-b7a7-a5c203aecfbe', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:33 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-93d03854-9d55-41b7-b538-5488df4a0665 tempest-GroupsTest-1200662718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65d78d2c-8bb7-44f3-b275-495340728968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:33 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-93d03854-9d55-41b7-b538-5488df4a0665 tempest-GroupsTest-1200662718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65d78d2c-8bb7-44f3-b275-495340728968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:33 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-93d03854-9d55-41b7-b538-5488df4a0665 tempest-GroupsTest-1200662718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a51d34f2-9754-4d7f-8cfd-2035217eab78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:33 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-93d03854-9d55-41b7-b538-5488df4a0665 tempest-GroupsTest-1200662718 None] Volume d0aa278f-3e36-48de-b7a7-a5c203aecfbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0aa278f-3e36-48de-b7a7-a5c203aecfbe', 'volume_size': 1} Jul 07 17:25:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-93d03854-9d55-41b7-b538-5488df4a0665 tempest-GroupsTest-1200662718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-93d03854-9d55-41b7-b538-5488df4a0665 tempest-GroupsTest-1200662718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:33 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-93d03854-9d55-41b7-b538-5488df4a0665 tempest-GroupsTest-1200662718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1ccf17cd-a43b-4486-827e-d10be3c0b02e,created_at=2026-07-07T15:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1106378203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1ccf17cd-a43b-4486-827e-d10be3c0b02e,host='devstack@QuobyteHD#QuobyteHD',id=d0aa278f-3e36-48de-b7a7-a5c203aecfbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d33931ceb44f40c5ae678cc440289abe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:25:34Z,use_quota=True,user_id='5b880e5483a241e59f4c12f455181642',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ff4c7f1e-45ef-491c-a63d-3162975e7697),volume_type_id=ff4c7f1e-45ef-491c-a63d-3162975e7697)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:25:33 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-93d03854-9d55-41b7-b538-5488df4a0665 tempest-GroupsTest-1200662718 None] Creating volume d0aa278f-3e36-48de-b7a7-a5c203aecfbe {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:25:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-93d03854-9d55-41b7-b538-5488df4a0665 tempest-GroupsTest-1200662718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-93d03854-9d55-41b7-b538-5488df4a0665 tempest-GroupsTest-1200662718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:33 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-93d03854-9d55-41b7-b538-5488df4a0665 tempest-GroupsTest-1200662718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:25:33 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-93d03854-9d55-41b7-b538-5488df4a0665 tempest-GroupsTest-1200662718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:25:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-93d03854-9d55-41b7-b538-5488df4a0665 tempest-GroupsTest-1200662718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:33 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-93d03854-9d55-41b7-b538-5488df4a0665 tempest-GroupsTest-1200662718 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:25:33 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-93d03854-9d55-41b7-b538-5488df4a0665 tempest-GroupsTest-1200662718 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:25:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-93d03854-9d55-41b7-b538-5488df4a0665 tempest-GroupsTest-1200662718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d0aa278f-3e36-48de-b7a7-a5c203aecfbe 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:33 devstack sudo[95152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d0aa278f-3e36-48de-b7a7-a5c203aecfbe 1073741824 Jul 07 17:25:33 devstack sudo[95152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:34 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Created reservations ['e51a29b7-e2ab-4122-93b0-403c2b097db1', '66c48fa4-9f3e-4180-ac33-4bf9ae372e53', '2f421f65-948c-4775-ac55-92d1b4fb253e', '36b3e84a-9b49-4b4b-bb6a-a766cc6557db'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:25:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:34 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:25:34 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:25:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:34 devstack sudo[95154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:25:34 devstack sudo[95154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:35 devstack sudo[95152]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-93d03854-9d55-41b7-b538-5488df4a0665 tempest-GroupsTest-1200662718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d0aa278f-3e36-48de-b7a7-a5c203aecfbe 1073741824" returned: 0 in 1.476s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:35 devstack sudo[95154]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:35 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce3f5777-a4dc-4575-8941-11b603332841 tempest-VolumesDeleteCascade-2018765742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:25:35 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ce3f5777-a4dc-4575-8941-11b603332841 tempest-VolumesDeleteCascade-2018765742 None] Flow 'volume_create_manager' (be7563a6-0d2b-4187-af5f-9895605550b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:25:35 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ce3f5777-a4dc-4575-8941-11b603332841 tempest-VolumesDeleteCascade-2018765742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47ec9293-fdf4-4e6a-958e-7d1c92ef7951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 1.362s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:35 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ce3f5777-a4dc-4575-8941-11b603332841 tempest-VolumesDeleteCascade-2018765742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47ec9293-fdf4-4e6a-958e-7d1c92ef7951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1167381848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=369b3b6a-4e13-43d2-8adb-d744530eb4cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='127f9a16b0404ac2996a1e6af019f788',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:25:35Z,use_quota=True,user_id='e86e1e97683a4d0c9ad01c76afbd9d28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:35 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ce3f5777-a4dc-4575-8941-11b603332841 tempest-VolumesDeleteCascade-2018765742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3954be5-343f-4e24-a8da-b7cbc7e46a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:35 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ce3f5777-a4dc-4575-8941-11b603332841 tempest-VolumesDeleteCascade-2018765742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3954be5-343f-4e24-a8da-b7cbc7e46a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:35 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ce3f5777-a4dc-4575-8941-11b603332841 tempest-VolumesDeleteCascade-2018765742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62eb8574-1eb1-45bf-8efb-dd0ececc0569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:35 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ce3f5777-a4dc-4575-8941-11b603332841 tempest-VolumesDeleteCascade-2018765742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62eb8574-1eb1-45bf-8efb-dd0ececc0569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '369b3b6a-4e13-43d2-8adb-d744530eb4cb', 'volume_name': 'volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:35 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ce3f5777-a4dc-4575-8941-11b603332841 tempest-VolumesDeleteCascade-2018765742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7443ae30-a6e4-4e20-bda5-20be32042286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:35 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ce3f5777-a4dc-4575-8941-11b603332841 tempest-VolumesDeleteCascade-2018765742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7443ae30-a6e4-4e20-bda5-20be32042286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:35 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ce3f5777-a4dc-4575-8941-11b603332841 tempest-VolumesDeleteCascade-2018765742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7cccc7f-a0a0-4f89-97a0-4cc2d074afa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:35 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-ce3f5777-a4dc-4575-8941-11b603332841 tempest-VolumesDeleteCascade-2018765742 None] Volume 369b3b6a-4e13-43d2-8adb-d744530eb4cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb', 'volume_size': 1} Jul 07 17:25:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ce3f5777-a4dc-4575-8941-11b603332841 tempest-VolumesDeleteCascade-2018765742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:35 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:25:35 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Deleted volume successfully. Jul 07 17:25:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-93d03854-9d55-41b7-b538-5488df4a0665 tempest-GroupsTest-1200662718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d0aa278f-3e36-48de-b7a7-a5c203aecfbe {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:35 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-306ce9f6-8e8b-40c4-8fb9-01481fa8fc66 tempest-VolumesDeleteCascade-2018765742 None] Lock "cinder-32e71cc7-40a6-41c1-8bf6-fc902add7c77-delete_volume" released by "delete_volume" :: held 20.352s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:25:35 devstack sudo[95161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d0aa278f-3e36-48de-b7a7-a5c203aecfbe Jul 07 17:25:35 devstack sudo[95161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:36 devstack sudo[95161]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-93d03854-9d55-41b7-b538-5488df4a0665 tempest-GroupsTest-1200662718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d0aa278f-3e36-48de-b7a7-a5c203aecfbe" returned: 0 in 0.655s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:36 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-93d03854-9d55-41b7-b538-5488df4a0665 tempest-GroupsTest-1200662718 None] <== create_volume: return (2287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:25:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-93d03854-9d55-41b7-b538-5488df4a0665 tempest-GroupsTest-1200662718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.290s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ce3f5777-a4dc-4575-8941-11b603332841 tempest-VolumesDeleteCascade-2018765742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.702s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:36 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ce3f5777-a4dc-4575-8941-11b603332841 tempest-VolumesDeleteCascade-2018765742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1167381848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=369b3b6a-4e13-43d2-8adb-d744530eb4cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='127f9a16b0404ac2996a1e6af019f788',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:25:35Z,use_quota=True,user_id='e86e1e97683a4d0c9ad01c76afbd9d28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:25:36 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-ce3f5777-a4dc-4575-8941-11b603332841 tempest-VolumesDeleteCascade-2018765742 None] Creating volume 369b3b6a-4e13-43d2-8adb-d744530eb4cb {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:25:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ce3f5777-a4dc-4575-8941-11b603332841 tempest-VolumesDeleteCascade-2018765742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ce3f5777-a4dc-4575-8941-11b603332841 tempest-VolumesDeleteCascade-2018765742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:36 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ce3f5777-a4dc-4575-8941-11b603332841 tempest-VolumesDeleteCascade-2018765742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:25:36 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ce3f5777-a4dc-4575-8941-11b603332841 tempest-VolumesDeleteCascade-2018765742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:25:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ce3f5777-a4dc-4575-8941-11b603332841 tempest-VolumesDeleteCascade-2018765742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:36 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ce3f5777-a4dc-4575-8941-11b603332841 tempest-VolumesDeleteCascade-2018765742 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:25:36 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-ce3f5777-a4dc-4575-8941-11b603332841 tempest-VolumesDeleteCascade-2018765742 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:25:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ce3f5777-a4dc-4575-8941-11b603332841 tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:36 devstack sudo[95164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb 1073741824 Jul 07 17:25:36 devstack sudo[95164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-93d03854-9d55-41b7-b538-5488df4a0665 tempest-GroupsTest-1200662718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a51d34f2-9754-4d7f-8cfd-2035217eab78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0aa278f-3e36-48de-b7a7-a5c203aecfbe', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-93d03854-9d55-41b7-b538-5488df4a0665 tempest-GroupsTest-1200662718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a62c7893-d1a6-4979-9d02-da2d4e8f11f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:36 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-93d03854-9d55-41b7-b538-5488df4a0665 tempest-GroupsTest-1200662718 None] Volume volume-d0aa278f-3e36-48de-b7a7-a5c203aecfbe (d0aa278f-3e36-48de-b7a7-a5c203aecfbe): created successfully Jul 07 17:25:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-93d03854-9d55-41b7-b538-5488df4a0665 tempest-GroupsTest-1200662718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a62c7893-d1a6-4979-9d02-da2d4e8f11f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-93d03854-9d55-41b7-b538-5488df4a0665 tempest-GroupsTest-1200662718 None] Flow 'volume_create_manager' (a103f662-0f8b-4c40-bfd5-4b71437603f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:25:36 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-93d03854-9d55-41b7-b538-5488df4a0665 tempest-GroupsTest-1200662718 None] Created volume successfully. Jul 07 17:25:37 devstack sudo[95164]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ce3f5777-a4dc-4575-8941-11b603332841 tempest-VolumesDeleteCascade-2018765742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb 1073741824" returned: 0 in 1.013s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ce3f5777-a4dc-4575-8941-11b603332841 tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:37 devstack sudo[95190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb Jul 07 17:25:37 devstack sudo[95190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:38 devstack sudo[95190]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ce3f5777-a4dc-4575-8941-11b603332841 tempest-VolumesDeleteCascade-2018765742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb" returned: 0 in 0.744s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:38 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ce3f5777-a4dc-4575-8941-11b603332841 tempest-VolumesDeleteCascade-2018765742 None] <== create_volume: return (1818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:25:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ce3f5777-a4dc-4575-8941-11b603332841 tempest-VolumesDeleteCascade-2018765742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.824s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ce3f5777-a4dc-4575-8941-11b603332841 tempest-VolumesDeleteCascade-2018765742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7cccc7f-a0a0-4f89-97a0-4cc2d074afa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ce3f5777-a4dc-4575-8941-11b603332841 tempest-VolumesDeleteCascade-2018765742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb8e994f-2c42-4c9b-b163-c58a595b97a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:38 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-ce3f5777-a4dc-4575-8941-11b603332841 tempest-VolumesDeleteCascade-2018765742 None] Volume volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb (369b3b6a-4e13-43d2-8adb-d744530eb4cb): created successfully Jul 07 17:25:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ce3f5777-a4dc-4575-8941-11b603332841 tempest-VolumesDeleteCascade-2018765742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb8e994f-2c42-4c9b-b163-c58a595b97a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ce3f5777-a4dc-4575-8941-11b603332841 tempest-VolumesDeleteCascade-2018765742 None] Flow 'volume_create_manager' (be7563a6-0d2b-4187-af5f-9895605550b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:25:38 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-ce3f5777-a4dc-4575-8941-11b603332841 tempest-VolumesDeleteCascade-2018765742 None] Created volume successfully. Jul 07 17:25:38 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:25:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Flow 'volume_create_manager' (f9079d90-dcb5-4165-88d9-03db39ebeac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:25:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daf6e0de-4452-4199-8245-bd7962423c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daf6e0de-4452-4199-8245-bd7962423c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:25:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1853350724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93ef0148-e743-49c6-b338-6d345b4da0a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee82f6056a374a1987449e7b66af9075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:25:38Z,use_quota=True,user_id='b31b15e5b0d94a71ae6a07897a978083',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4c3b237-d128-49e1-bfe6-6b96d5538933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4c3b237-d128-49e1-bfe6-6b96d5538933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc409f63-b97c-4f46-92d7-0c7526ec1fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:38 devstack cinder-volume[87233]: DEBUG cinder.image.glance [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Creating Keystone auth plugin from conf {{(pid=87233) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 17:25:38 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-16e70a60-d12d-4831-8c50-71da07ce1fa3 tempest-GroupsTest-1200662718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:25:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-16e70a60-d12d-4831-8c50-71da07ce1fa3 tempest-GroupsTest-1200662718 None] Flow 'volume_create_manager' (afe13e7e-4f89-4fa6-ae0a-d67792e4d819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:25:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-16e70a60-d12d-4831-8c50-71da07ce1fa3 tempest-GroupsTest-1200662718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87c66f01-52e3-4c8d-96df-2017afe5b683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-16e70a60-d12d-4831-8c50-71da07ce1fa3 tempest-GroupsTest-1200662718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87c66f01-52e3-4c8d-96df-2017afe5b683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:25:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-164305256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1ccf17cd-a43b-4486-827e-d10be3c0b02e,host='devstack@QuobyteHD#QuobyteHD',id=10712347-552b-4d91-b81c-9a0736dab168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d33931ceb44f40c5ae678cc440289abe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:25:38Z,use_quota=True,user_id='5b880e5483a241e59f4c12f455181642',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ff4c7f1e-45ef-491c-a63d-3162975e7697),volume_type_id=ff4c7f1e-45ef-491c-a63d-3162975e7697)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-16e70a60-d12d-4831-8c50-71da07ce1fa3 tempest-GroupsTest-1200662718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7239745-5b94-49d4-bfaa-a903e67c1a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-16e70a60-d12d-4831-8c50-71da07ce1fa3 tempest-GroupsTest-1200662718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7239745-5b94-49d4-bfaa-a903e67c1a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-16e70a60-d12d-4831-8c50-71da07ce1fa3 tempest-GroupsTest-1200662718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5f04010-106c-4e0c-a15c-97332b264ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-16e70a60-d12d-4831-8c50-71da07ce1fa3 tempest-GroupsTest-1200662718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5f04010-106c-4e0c-a15c-97332b264ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10712347-552b-4d91-b81c-9a0736dab168', 'volume_name': 'volume-10712347-552b-4d91-b81c-9a0736dab168', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-16e70a60-d12d-4831-8c50-71da07ce1fa3 tempest-GroupsTest-1200662718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20a8d6fd-bf6e-4637-a9a7-bac3d1d178be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-16e70a60-d12d-4831-8c50-71da07ce1fa3 tempest-GroupsTest-1200662718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20a8d6fd-bf6e-4637-a9a7-bac3d1d178be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-16e70a60-d12d-4831-8c50-71da07ce1fa3 tempest-GroupsTest-1200662718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eae84d5-620c-437e-960b-62b4acd39042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:38 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-16e70a60-d12d-4831-8c50-71da07ce1fa3 tempest-GroupsTest-1200662718 None] Volume 10712347-552b-4d91-b81c-9a0736dab168: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10712347-552b-4d91-b81c-9a0736dab168', 'volume_size': 1} Jul 07 17:25:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-16e70a60-d12d-4831-8c50-71da07ce1fa3 tempest-GroupsTest-1200662718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-16e70a60-d12d-4831-8c50-71da07ce1fa3 tempest-GroupsTest-1200662718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:38 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-16e70a60-d12d-4831-8c50-71da07ce1fa3 tempest-GroupsTest-1200662718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1ccf17cd-a43b-4486-827e-d10be3c0b02e,created_at=2026-07-07T15:25:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-164305256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1ccf17cd-a43b-4486-827e-d10be3c0b02e,host='devstack@QuobyteHD#QuobyteHD',id=10712347-552b-4d91-b81c-9a0736dab168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d33931ceb44f40c5ae678cc440289abe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:25:38Z,use_quota=True,user_id='5b880e5483a241e59f4c12f455181642',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ff4c7f1e-45ef-491c-a63d-3162975e7697),volume_type_id=ff4c7f1e-45ef-491c-a63d-3162975e7697)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:25:38 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-16e70a60-d12d-4831-8c50-71da07ce1fa3 tempest-GroupsTest-1200662718 None] Creating volume 10712347-552b-4d91-b81c-9a0736dab168 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:25:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-16e70a60-d12d-4831-8c50-71da07ce1fa3 tempest-GroupsTest-1200662718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-16e70a60-d12d-4831-8c50-71da07ce1fa3 tempest-GroupsTest-1200662718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:38 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-16e70a60-d12d-4831-8c50-71da07ce1fa3 tempest-GroupsTest-1200662718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:25:38 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-16e70a60-d12d-4831-8c50-71da07ce1fa3 tempest-GroupsTest-1200662718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:25:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-16e70a60-d12d-4831-8c50-71da07ce1fa3 tempest-GroupsTest-1200662718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:38 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-16e70a60-d12d-4831-8c50-71da07ce1fa3 tempest-GroupsTest-1200662718 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:25:38 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-16e70a60-d12d-4831-8c50-71da07ce1fa3 tempest-GroupsTest-1200662718 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:25:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-16e70a60-d12d-4831-8c50-71da07ce1fa3 tempest-GroupsTest-1200662718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-10712347-552b-4d91-b81c-9a0736dab168 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:38 devstack sudo[95194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-10712347-552b-4d91-b81c-9a0736dab168 1073741824 Jul 07 17:25:38 devstack sudo[95194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-89ea9c42-869e-47a6-85e6-53451312bbec tempest-VolumesDeleteCascade-2018765742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc409f63-b97c-4f46-92d7-0c7526ec1fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '93ef0148-e743-49c6-b338-6d345b4da0a6', 'volume_name': 'volume-93ef0148-e743-49c6-b338-6d345b4da0a6', 'volume_size': 1, 'image_id': '0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ed2f318bab304b78b69744376e93ea0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'created_at': datetime.datetime(2026, 7, 7, 15, 11, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 11, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e7aa8bb-335b-45a2-aabb-4dc50188f189/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2061598c-803f-49f1-9f6e-27f01807799d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2061598c-803f-49f1-9f6e-27f01807799d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01ad2849-432a-4eca-bc15-37b9a03e2f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:38 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Volume 93ef0148-e743-49c6-b338-6d345b4da0a6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-93ef0148-e743-49c6-b338-6d345b4da0a6', 'volume_size': 1, 'image_id': '0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ed2f318bab304b78b69744376e93ea0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'created_at': datetime.datetime(2026, 7, 7, 15, 11, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 11, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e7aa8bb-335b-45a2-aabb-4dc50188f189/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 17:25:38 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Trying to clone 93ef0148-e743-49c6-b338-6d345b4da0a6 from image 0e7aa8bb-335b-45a2-aabb-4dc50188f189 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'metadata': {}}]). {{(pid=87233) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 17:25:39 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_yesia5t3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87233) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 17:25:39 devstack cinder-volume[87233]: INFO cinder.image.image_utils [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Image download 20.69 MB at 20.69 MB/s Jul 07 17:25:39 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c669b7-b458-4d75-a111-4a15b4168aa9]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_yesia5t3devstack@QuobyteHD {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:39 devstack sudo[95220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_yesia5t3devstack@QuobyteHD Jul 07 17:25:39 devstack sudo[95220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:39 devstack sudo[95194]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-16e70a60-d12d-4831-8c50-71da07ce1fa3 tempest-GroupsTest-1200662718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-10712347-552b-4d91-b81c-9a0736dab168 1073741824" returned: 0 in 0.923s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-16e70a60-d12d-4831-8c50-71da07ce1fa3 tempest-GroupsTest-1200662718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-10712347-552b-4d91-b81c-9a0736dab168 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:39 devstack sudo[95222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-10712347-552b-4d91-b81c-9a0736dab168 Jul 07 17:25:39 devstack sudo[95222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:40 devstack sudo[95220]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_yesia5t3devstack@QuobyteHD" returned: 0 in 0.753s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:40 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Temporary image 0e7aa8bb-335b-45a2-aabb-4dc50188f189 is fetched for user b31b15e5b0d94a71ae6a07897a978083. {{(pid=87233) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 17:25:40 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[87166199-887b-4c46-bdc5-c065c8294f23]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_yesia5t3devstack@QuobyteHD {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:40 devstack sudo[95222]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:40 devstack sudo[95229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_yesia5t3devstack@QuobyteHD Jul 07 17:25:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-16e70a60-d12d-4831-8c50-71da07ce1fa3 tempest-GroupsTest-1200662718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-10712347-552b-4d91-b81c-9a0736dab168" returned: 0 in 0.696s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:40 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-16e70a60-d12d-4831-8c50-71da07ce1fa3 tempest-GroupsTest-1200662718 None] <== create_volume: return (1658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:25:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-16e70a60-d12d-4831-8c50-71da07ce1fa3 tempest-GroupsTest-1200662718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:40 devstack sudo[95229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-89ea9c42-869e-47a6-85e6-53451312bbec tempest-VolumesDeleteCascade-2018765742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.528s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:40 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-89ea9c42-869e-47a6-85e6-53451312bbec tempest-VolumesDeleteCascade-2018765742 None] Creating offline snapshot e02b0143-0e91-43a9-b007-a3848f3ceaa4 of volume 369b3b6a-4e13-43d2-8adb-d744530eb4cb {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:25:40 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-16e70a60-d12d-4831-8c50-71da07ce1fa3 tempest-GroupsTest-1200662718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eae84d5-620c-437e-960b-62b4acd39042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10712347-552b-4d91-b81c-9a0736dab168', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:40 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-16e70a60-d12d-4831-8c50-71da07ce1fa3 tempest-GroupsTest-1200662718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b9ca7a3-1c3d-4ffe-acb0-40279ad8e077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:40 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b31d4a-32c9-4734-87df-fb4b57c7823a]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-89ea9c42-869e-47a6-85e6-53451312bbec tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:40 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-16e70a60-d12d-4831-8c50-71da07ce1fa3 tempest-GroupsTest-1200662718 None] Volume volume-10712347-552b-4d91-b81c-9a0736dab168 (10712347-552b-4d91-b81c-9a0736dab168): created successfully Jul 07 17:25:40 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-16e70a60-d12d-4831-8c50-71da07ce1fa3 tempest-GroupsTest-1200662718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b9ca7a3-1c3d-4ffe-acb0-40279ad8e077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:40 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-16e70a60-d12d-4831-8c50-71da07ce1fa3 tempest-GroupsTest-1200662718 None] Flow 'volume_create_manager' (afe13e7e-4f89-4fa6-ae0a-d67792e4d819) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:25:40 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-16e70a60-d12d-4831-8c50-71da07ce1fa3 tempest-GroupsTest-1200662718 None] Created volume successfully. Jul 07 17:25:40 devstack sudo[95231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb Jul 07 17:25:40 devstack sudo[95231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:40 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-6f1facd6-823a-4262-bb7d-4305d886ea69 tempest-GroupsTest-1200662718 None] Update group completed successfully. Jul 07 17:25:40 devstack sudo[95229]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_yesia5t3devstack@QuobyteHD" returned: 0 in 0.800s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:41 devstack sudo[95231]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-89ea9c42-869e-47a6-85e6-53451312bbec tempest-VolumesDeleteCascade-2018765742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb" returned: 0 in 0.764s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-89ea9c42-869e-47a6-85e6-53451312bbec tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb.e02b0143-0e91-43a9-b007-a3848f3ceaa4 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:41 devstack sudo[95239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb.e02b0143-0e91-43a9-b007-a3848f3ceaa4 1G Jul 07 17:25:41 devstack sudo[95239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:41 devstack sudo[95239]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-89ea9c42-869e-47a6-85e6-53451312bbec tempest-VolumesDeleteCascade-2018765742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb.e02b0143-0e91-43a9-b007-a3848f3ceaa4 1G" returned: 0 in 0.779s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-89ea9c42-869e-47a6-85e6-53451312bbec tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb.e02b0143-0e91-43a9-b007-a3848f3ceaa4 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:41 devstack sudo[95244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb.e02b0143-0e91-43a9-b007-a3848f3ceaa4 Jul 07 17:25:41 devstack sudo[95244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:42 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-8f11e4ee-9bd9-47eb-8383-d929807c970c tempest-GroupsTest-1200662718 None] Update group completed successfully. Jul 07 17:25:42 devstack sudo[95244]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-89ea9c42-869e-47a6-85e6-53451312bbec tempest-VolumesDeleteCascade-2018765742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb.e02b0143-0e91-43a9-b007-a3848f3ceaa4" returned: 0 in 0.689s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:42 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-89ea9c42-869e-47a6-85e6-53451312bbec tempest-VolumesDeleteCascade-2018765742 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb.e02b0143-0e91-43a9-b007-a3848f3ceaa4 is being set with open permissions: ugo+rw Jul 07 17:25:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-89ea9c42-869e-47a6-85e6-53451312bbec tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb.e02b0143-0e91-43a9-b007-a3848f3ceaa4 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:42 devstack sudo[95249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb.e02b0143-0e91-43a9-b007-a3848f3ceaa4 Jul 07 17:25:42 devstack sudo[95249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:43 devstack sudo[95249]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-89ea9c42-869e-47a6-85e6-53451312bbec tempest-VolumesDeleteCascade-2018765742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb.e02b0143-0e91-43a9-b007-a3848f3ceaa4" returned: 0 in 0.636s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-89ea9c42-869e-47a6-85e6-53451312bbec tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:43 devstack sudo[95252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb.info Jul 07 17:25:43 devstack sudo[95252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:43 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:25:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:25:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:25:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:43 devstack sudo[95254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:25:43 devstack sudo[95254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:43 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9448afe5-9ee7-4dd8-a9ee-181e69492a70 tempest-GroupsTest-1200662718 None] Acquiring lock "cinder-quobyte-10712347-552b-4d91-b81c-9a0736dab168" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:25:43 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9448afe5-9ee7-4dd8-a9ee-181e69492a70 tempest-GroupsTest-1200662718 None] Lock "cinder-quobyte-10712347-552b-4d91-b81c-9a0736dab168" acquired by "delete_volume" :: waited 0.028s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:25:43 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[06698ef2-f816-4415-bf71-1d3f676dc0ec]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9448afe5-9ee7-4dd8-a9ee-181e69492a70 tempest-GroupsTest-1200662718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-10712347-552b-4d91-b81c-9a0736dab168 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:44 devstack sudo[95252]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-89ea9c42-869e-47a6-85e6-53451312bbec tempest-VolumesDeleteCascade-2018765742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb.info" returned: 0 in 0.832s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:44 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-89ea9c42-869e-47a6-85e6-53451312bbec tempest-VolumesDeleteCascade-2018765742 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb.info is being set with open permissions: ugo+rw Jul 07 17:25:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-89ea9c42-869e-47a6-85e6-53451312bbec tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:44 devstack sudo[95254]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.746s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:44 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:25:44 devstack sudo[95258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-10712347-552b-4d91-b81c-9a0736dab168 Jul 07 17:25:44 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:25:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread count: 28 {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:25:44 devstack sudo[95258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread info: [<_MainThread(MainThread, started 126077716062336)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:25:44 devstack sudo[95259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb.info Jul 07 17:25:44 devstack sudo[95259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:44 devstack sudo[95259]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-89ea9c42-869e-47a6-85e6-53451312bbec tempest-VolumesDeleteCascade-2018765742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb.info" returned: 0 in 0.704s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-89ea9c42-869e-47a6-85e6-53451312bbec tempest-VolumesDeleteCascade-2018765742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.515s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.844s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:44 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:25:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1853350724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93ef0148-e743-49c6-b338-6d345b4da0a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee82f6056a374a1987449e7b66af9075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:25:38Z,use_quota=True,user_id='b31b15e5b0d94a71ae6a07897a978083',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:25:44 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Creating volume 93ef0148-e743-49c6-b338-6d345b4da0a6 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:25:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:44 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:25:44 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:25:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:44 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:25:44 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:25:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-93ef0148-e743-49c6-b338-6d345b4da0a6 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:44 devstack sudo[95258]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9448afe5-9ee7-4dd8-a9ee-181e69492a70 tempest-GroupsTest-1200662718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-10712347-552b-4d91-b81c-9a0736dab168" returned: 0 in 0.878s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9448afe5-9ee7-4dd8-a9ee-181e69492a70 tempest-GroupsTest-1200662718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-10712347-552b-4d91-b81c-9a0736dab168 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:44 devstack sudo[95266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-93ef0148-e743-49c6-b338-6d345b4da0a6 1073741824 Jul 07 17:25:44 devstack sudo[95266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:44 devstack sudo[95267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-10712347-552b-4d91-b81c-9a0736dab168 Jul 07 17:25:44 devstack sudo[95267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:44 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-89ea9c42-869e-47a6-85e6-53451312bbec tempest-VolumesDeleteCascade-2018765742 None] Create snapshot completed successfully Jul 07 17:25:45 devstack sudo[95267]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9448afe5-9ee7-4dd8-a9ee-181e69492a70 tempest-GroupsTest-1200662718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-10712347-552b-4d91-b81c-9a0736dab168" returned: 0 in 0.733s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:45 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9448afe5-9ee7-4dd8-a9ee-181e69492a70 tempest-GroupsTest-1200662718 None] Lock "cinder-quobyte-10712347-552b-4d91-b81c-9a0736dab168" released by "delete_volume" :: held 1.697s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:25:45 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9448afe5-9ee7-4dd8-a9ee-181e69492a70 tempest-GroupsTest-1200662718 None] Acquiring lock "cinder-quobyte-d0aa278f-3e36-48de-b7a7-a5c203aecfbe" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:25:45 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9448afe5-9ee7-4dd8-a9ee-181e69492a70 tempest-GroupsTest-1200662718 None] Lock "cinder-quobyte-d0aa278f-3e36-48de-b7a7-a5c203aecfbe" acquired by "delete_volume" :: waited 0.029s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:25:45 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ce21df-8129-4654-be89-f667be5a6db5]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9448afe5-9ee7-4dd8-a9ee-181e69492a70 tempest-GroupsTest-1200662718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d0aa278f-3e36-48de-b7a7-a5c203aecfbe {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:45 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:25:45 devstack sudo[95274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d0aa278f-3e36-48de-b7a7-a5c203aecfbe Jul 07 17:25:45 devstack sudo[95274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:45 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Flow 'volume_create_manager' (417ef247-d677-4b30-afac-89ee42899a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:25:45 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4cc09fa-1e36-4c8a-8435-4a3788038b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:45 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4cc09fa-1e36-4c8a-8435-4a3788038b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-800521120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e523e220-2e07-4da3-a97b-e3346a61a9cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='127f9a16b0404ac2996a1e6af019f788',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e02b0143-0e91-43a9-b007-a3848f3ceaa4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:25:46Z,use_quota=True,user_id='e86e1e97683a4d0c9ad01c76afbd9d28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:45 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8314269b-f16b-45ed-8d4a-425f29341fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:45 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8314269b-f16b-45ed-8d4a-425f29341fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:45 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f15b839-e0ca-4b16-a566-504b64501759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:45 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f15b839-e0ca-4b16-a566-504b64501759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e523e220-2e07-4da3-a97b-e3346a61a9cb', 'volume_name': 'volume-e523e220-2e07-4da3-a97b-e3346a61a9cb', 'volume_size': 1, 'snapshot_id': 'e02b0143-0e91-43a9-b007-a3848f3ceaa4'}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:45 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dc6689a-9623-4ed9-a90b-d75f7a54b343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:45 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dc6689a-9623-4ed9-a90b-d75f7a54b343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:45 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aba6468-226b-498c-8018-acea3aca40ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:45 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Volume e523e220-2e07-4da3-a97b-e3346a61a9cb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e523e220-2e07-4da3-a97b-e3346a61a9cb', 'volume_size': 1, 'snapshot_id': 'e02b0143-0e91-43a9-b007-a3848f3ceaa4'} Jul 07 17:25:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:45 devstack sudo[95266]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-93ef0148-e743-49c6-b338-6d345b4da0a6 1073741824" returned: 0 in 1.125s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-93ef0148-e743-49c6-b338-6d345b4da0a6 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:46 devstack sudo[95278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-93ef0148-e743-49c6-b338-6d345b4da0a6 Jul 07 17:25:46 devstack sudo[95278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:46 devstack sudo[95274]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9448afe5-9ee7-4dd8-a9ee-181e69492a70 tempest-GroupsTest-1200662718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d0aa278f-3e36-48de-b7a7-a5c203aecfbe" returned: 0 in 0.841s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9448afe5-9ee7-4dd8-a9ee-181e69492a70 tempest-GroupsTest-1200662718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d0aa278f-3e36-48de-b7a7-a5c203aecfbe {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:46 devstack sudo[95285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d0aa278f-3e36-48de-b7a7-a5c203aecfbe Jul 07 17:25:46 devstack sudo[95285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:46 devstack sudo[95278]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-93ef0148-e743-49c6-b338-6d345b4da0a6" returned: 0 in 0.709s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:46 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] <== create_volume: return (1893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:25:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.897s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.793s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:46 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Acquiring lock "cinder-quobyte-e02b0143-0e91-43a9-b007-a3848f3ceaa4-e523e220-2e07-4da3-a97b-e3346a61a9cb" by "_create_volume_from_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:25:46 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Lock "cinder-quobyte-e02b0143-0e91-43a9-b007-a3848f3ceaa4-e523e220-2e07-4da3-a97b-e3346a61a9cb" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:25:46 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Creating volume e523e220-2e07-4da3-a97b-e3346a61a9cb from snapshot e02b0143-0e91-43a9-b007-a3848f3ceaa4 {{(pid=87233) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 17:25:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:46 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:25:46 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:25:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:46 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:25:46 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Acquiring lock "cinder-quobyte-e523e220-2e07-4da3-a97b-e3346a61a9cb" by "_copy_volume_from_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:25:46 devstack cinder-volume[87233]: DEBUG cinder.volume.volume_utils [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Attempting download of 0e7aa8bb-335b-45a2-aabb-4dc50188f189 ((None, [{'url': 'file:///opt/stack/data/glance/images/0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'metadata': {}}])) to volume 93ef0148-e743-49c6-b338-6d345b4da0a6. {{(pid=87233) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 17:25:46 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Lock "cinder-quobyte-e523e220-2e07-4da3-a97b-e3346a61a9cb" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:25:46 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] snapshot: e02b0143-0e91-43a9-b007-a3848f3ceaa4, volume: e523e220-2e07-4da3-a97b-e3346a61a9cb, {{(pid=87233) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 17:25:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:46 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:25:46 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:25:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:46 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f200ff4-29fd-492f-8989-d0a4d5704e67]: (4, 'raw') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e7aa8bb-335b-45a2-aabb-4dc50188f189_film_liy {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:46 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fa6fb3-88ce-4795-af1c-ba8a7513371a]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb.e02b0143-0e91-43a9-b007-a3848f3ceaa4 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:46 devstack sudo[95289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e7aa8bb-335b-45a2-aabb-4dc50188f189_film_liy Jul 07 17:25:46 devstack sudo[95289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:46 devstack sudo[95290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb.e02b0143-0e91-43a9-b007-a3848f3ceaa4 Jul 07 17:25:46 devstack sudo[95290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:47 devstack sudo[95285]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9448afe5-9ee7-4dd8-a9ee-181e69492a70 tempest-GroupsTest-1200662718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d0aa278f-3e36-48de-b7a7-a5c203aecfbe" returned: 0 in 0.667s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:47 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9448afe5-9ee7-4dd8-a9ee-181e69492a70 tempest-GroupsTest-1200662718 None] Lock "cinder-quobyte-d0aa278f-3e36-48de-b7a7-a5c203aecfbe" released by "delete_volume" :: held 1.598s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:25:47 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-9448afe5-9ee7-4dd8-a9ee-181e69492a70 tempest-GroupsTest-1200662718 None] Created reservations ['7050259f-ce5c-410d-ad3c-2703f87a9152'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:25:47 devstack cinder-volume[87233]: WARNING cinder.quota [None req-9448afe5-9ee7-4dd8-a9ee-181e69492a70 tempest-GroupsTest-1200662718 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1558482269 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1558482269, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:25:47 devstack cinder-volume[87233]: WARNING cinder.quota [None req-9448afe5-9ee7-4dd8-a9ee-181e69492a70 tempest-GroupsTest-1200662718 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1558482269 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1558482269, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:25:47 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-9448afe5-9ee7-4dd8-a9ee-181e69492a70 tempest-GroupsTest-1200662718 None] Created reservations ['69b51617-d521-44a3-8eb8-cfeecb188072', '2e4f4465-6214-4094-bbbe-6a17f2b4b142', '10cd6fe6-0924-4ffc-9c4f-b064df3dcbae', 'c1b33960-ad55-4786-afe6-c5b6bf06e15a'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:25:47 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-9448afe5-9ee7-4dd8-a9ee-181e69492a70 tempest-GroupsTest-1200662718 None] Created reservations ['699039c2-3d82-467d-a4da-8b35ec6e9822', '50ef4b26-5787-4392-95f8-631f3e3e3a26', 'ab60a3eb-3a00-409b-8520-4386d62ea67f', '24b2c383-1d5c-42d1-aa46-da5d2aafc06f'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:25:47 devstack sudo[95289]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9448afe5-9ee7-4dd8-a9ee-181e69492a70 tempest-GroupsTest-1200662718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9448afe5-9ee7-4dd8-a9ee-181e69492a70 tempest-GroupsTest-1200662718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:47 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-9448afe5-9ee7-4dd8-a9ee-181e69492a70 tempest-GroupsTest-1200662718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:25:47 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-9448afe5-9ee7-4dd8-a9ee-181e69492a70 tempest-GroupsTest-1200662718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:25:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9448afe5-9ee7-4dd8-a9ee-181e69492a70 tempest-GroupsTest-1200662718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9448afe5-9ee7-4dd8-a9ee-181e69492a70 tempest-GroupsTest-1200662718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e7aa8bb-335b-45a2-aabb-4dc50188f189_film_liy" returned: 0 in 0.812s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e7aa8bb-335b-45a2-aabb-4dc50188f189_film_liy {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:47 devstack sudo[95303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:25:47 devstack sudo[95303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:47 devstack sudo[95304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e7aa8bb-335b-45a2-aabb-4dc50188f189_film_liy Jul 07 17:25:47 devstack sudo[95304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:47 devstack sudo[95290]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb.e02b0143-0e91-43a9-b007-a3848f3ceaa4" returned: 0 in 0.997s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:47 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:25:47 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] will copy from snapshot at /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb {{(pid=87233) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 17:25:47 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Creating direct copy from snapshot {{(pid=87233) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 17:25:47 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa603e0d-390f-4310-8869-c463377a77e9]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:48 devstack sudo[95310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb Jul 07 17:25:48 devstack sudo[95310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:48 devstack sudo[95303]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9448afe5-9ee7-4dd8-a9ee-181e69492a70 tempest-GroupsTest-1200662718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.700s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:48 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-9448afe5-9ee7-4dd8-a9ee-181e69492a70 tempest-GroupsTest-1200662718 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:25:48 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-9448afe5-9ee7-4dd8-a9ee-181e69492a70 tempest-GroupsTest-1200662718 None] Delete group completed successfully. Jul 07 17:25:48 devstack sudo[95304]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e7aa8bb-335b-45a2-aabb-4dc50188f189_film_liy" returned: 1 in 0.840s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e7aa8bb-335b-45a2-aabb-4dc50188f189_film_liy' failed. Not Retrying. {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:25:48 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e62b1a6-a9c7-4e11-ac26-1ffe1bcbdff6]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_yesia5t3devstack@QuobyteHD {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:48 devstack sudo[95315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_yesia5t3devstack@QuobyteHD Jul 07 17:25:48 devstack sudo[95315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:48 devstack sudo[95310]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb" returned: 0 in 0.784s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:48 devstack cinder-volume[87233]: DEBUG cinder.utils [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Path /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e523e220-2e07-4da3-a97b-e3346a61a9cb not found in is_blk_device check {{(pid=87233) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 17:25:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e523e220-2e07-4da3-a97b-e3346a61a9cb {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:48 devstack sudo[95320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e523e220-2e07-4da3-a97b-e3346a61a9cb Jul 07 17:25:48 devstack sudo[95320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:49 devstack sudo[95315]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_yesia5t3devstack@QuobyteHD" returned: 0 in 0.819s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:49 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] 0e7aa8bb-335b-45a2-aabb-4dc50188f189 was qcow2, converting to raw {{(pid=87233) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 17:25:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_yesia5t3devstack@QuobyteHD /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-93ef0148-e743-49c6-b338-6d345b4da0a6 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:49 devstack sudo[95328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_yesia5t3devstack@QuobyteHD /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-93ef0148-e743-49c6-b338-6d345b4da0a6 Jul 07 17:25:49 devstack sudo[95328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:53 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-75431f50-8596-4e6d-8ba6-9716076f24a0 tempest-AttachVolumeNegativeTest-1224056977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:25:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-75431f50-8596-4e6d-8ba6-9716076f24a0 tempest-AttachVolumeNegativeTest-1224056977 None] Flow 'volume_create_manager' (89bb36cf-515b-4b24-90ba-4f5a772e4951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:25:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-75431f50-8596-4e6d-8ba6-9716076f24a0 tempest-AttachVolumeNegativeTest-1224056977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c44b39b-cbe3-4b4a-bbaa-ed8577ea5846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-75431f50-8596-4e6d-8ba6-9716076f24a0 tempest-AttachVolumeNegativeTest-1224056977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c44b39b-cbe3-4b4a-bbaa-ed8577ea5846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1720402342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2767b127-68ae-4b91-954c-71e572c23c78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='796ca6dac1614b198cf7645ae5f214d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:25:53Z,use_quota=True,user_id='9a53ffa5a72b41cab5f1a6dbcfee9d66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-75431f50-8596-4e6d-8ba6-9716076f24a0 tempest-AttachVolumeNegativeTest-1224056977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40809472-a68f-4725-a9b9-52c07d618fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-75431f50-8596-4e6d-8ba6-9716076f24a0 tempest-AttachVolumeNegativeTest-1224056977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40809472-a68f-4725-a9b9-52c07d618fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-75431f50-8596-4e6d-8ba6-9716076f24a0 tempest-AttachVolumeNegativeTest-1224056977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ce12aab-f6a6-4f94-9ccc-c1e607e2041b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-75431f50-8596-4e6d-8ba6-9716076f24a0 tempest-AttachVolumeNegativeTest-1224056977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ce12aab-f6a6-4f94-9ccc-c1e607e2041b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2767b127-68ae-4b91-954c-71e572c23c78', 'volume_name': 'volume-2767b127-68ae-4b91-954c-71e572c23c78', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-75431f50-8596-4e6d-8ba6-9716076f24a0 tempest-AttachVolumeNegativeTest-1224056977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (678703a4-dbdf-4ee0-b676-2c4ee2ed064d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-75431f50-8596-4e6d-8ba6-9716076f24a0 tempest-AttachVolumeNegativeTest-1224056977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (678703a4-dbdf-4ee0-b676-2c4ee2ed064d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-75431f50-8596-4e6d-8ba6-9716076f24a0 tempest-AttachVolumeNegativeTest-1224056977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (645f35fc-88d7-44bc-80d8-ed8d72869cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:53 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-75431f50-8596-4e6d-8ba6-9716076f24a0 tempest-AttachVolumeNegativeTest-1224056977 None] Volume 2767b127-68ae-4b91-954c-71e572c23c78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2767b127-68ae-4b91-954c-71e572c23c78', 'volume_size': 1} Jul 07 17:25:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-75431f50-8596-4e6d-8ba6-9716076f24a0 tempest-AttachVolumeNegativeTest-1224056977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:53 devstack sudo[95328]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_yesia5t3devstack@QuobyteHD /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-93ef0148-e743-49c6-b338-6d345b4da0a6" returned: 0 in 4.190s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:53 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_yesia5t3devstack@QuobyteHD, size 112.00 MB, duration 4.19 sec, destination /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-93ef0148-e743-49c6-b338-6d345b4da0a6 {{(pid=87233) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:25:53 devstack cinder-volume[87233]: INFO cinder.image.image_utils [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Converted 112.00 MB image at 26.72 MB/s Jul 07 17:25:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-93ef0148-e743-49c6-b338-6d345b4da0a6 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:53 devstack sudo[95347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-93ef0148-e743-49c6-b338-6d345b4da0a6 1G Jul 07 17:25:53 devstack sudo[95347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:54 devstack sudo[95320]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e523e220-2e07-4da3-a97b-e3346a61a9cb" returned: 0 in 5.869s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:54 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[71be9c67-3ea1-4f3c-af0e-166779afc422]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:54 devstack sudo[95351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb Jul 07 17:25:54 devstack sudo[95351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:54 devstack sudo[95347]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-93ef0148-e743-49c6-b338-6d345b4da0a6 1G" returned: 0 in 1.192s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:54 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[38207ad1-46ef-4e13-ae25-d56440f20704]: (4, 'raw') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-93ef0148-e743-49c6-b338-6d345b4da0a6 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:54 devstack sudo[95354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-93ef0148-e743-49c6-b338-6d345b4da0a6 Jul 07 17:25:54 devstack sudo[95354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:55 devstack sudo[95354]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-93ef0148-e743-49c6-b338-6d345b4da0a6" returned: 0 in 0.771s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-93ef0148-e743-49c6-b338-6d345b4da0a6 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:55 devstack sudo[95351]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb" returned: 0 in 1.012s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:55 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Image conversion details: src /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb, size 1024.00 MB, duration 5.87 sec, destination /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e523e220-2e07-4da3-a97b-e3346a61a9cb {{(pid=87233) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:25:55 devstack cinder-volume[87233]: INFO cinder.image.image_utils [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Converted 1024.00 MB image at 174.44 MB/s Jul 07 17:25:55 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e523e220-2e07-4da3-a97b-e3346a61a9cb is being set with open permissions: ugo+rw Jul 07 17:25:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e523e220-2e07-4da3-a97b-e3346a61a9cb {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:55 devstack sudo[95362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e523e220-2e07-4da3-a97b-e3346a61a9cb Jul 07 17:25:55 devstack sudo[95362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:55 devstack sudo[95361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-93ef0148-e743-49c6-b338-6d345b4da0a6 Jul 07 17:25:55 devstack sudo[95361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:56 devstack sudo[95362]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e523e220-2e07-4da3-a97b-e3346a61a9cb" returned: 0 in 0.665s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:56 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Lock "cinder-quobyte-e523e220-2e07-4da3-a97b-e3346a61a9cb" released by "_copy_volume_from_snapshot" :: held 9.466s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:25:56 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Lock "cinder-quobyte-e02b0143-0e91-43a9-b007-a3848f3ceaa4-e523e220-2e07-4da3-a97b-e3346a61a9cb" released by "_create_volume_from_snapshot" :: held 9.520s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:25:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.557s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-75431f50-8596-4e6d-8ba6-9716076f24a0 tempest-AttachVolumeNegativeTest-1224056977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.108s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:56 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-75431f50-8596-4e6d-8ba6-9716076f24a0 tempest-AttachVolumeNegativeTest-1224056977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1720402342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2767b127-68ae-4b91-954c-71e572c23c78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='796ca6dac1614b198cf7645ae5f214d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:25:53Z,use_quota=True,user_id='9a53ffa5a72b41cab5f1a6dbcfee9d66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:25:56 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-75431f50-8596-4e6d-8ba6-9716076f24a0 tempest-AttachVolumeNegativeTest-1224056977 None] Creating volume 2767b127-68ae-4b91-954c-71e572c23c78 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:25:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-75431f50-8596-4e6d-8ba6-9716076f24a0 tempest-AttachVolumeNegativeTest-1224056977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-75431f50-8596-4e6d-8ba6-9716076f24a0 tempest-AttachVolumeNegativeTest-1224056977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:56 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-75431f50-8596-4e6d-8ba6-9716076f24a0 tempest-AttachVolumeNegativeTest-1224056977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:25:56 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-75431f50-8596-4e6d-8ba6-9716076f24a0 tempest-AttachVolumeNegativeTest-1224056977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:25:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-75431f50-8596-4e6d-8ba6-9716076f24a0 tempest-AttachVolumeNegativeTest-1224056977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:56 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-75431f50-8596-4e6d-8ba6-9716076f24a0 tempest-AttachVolumeNegativeTest-1224056977 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:25:56 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-75431f50-8596-4e6d-8ba6-9716076f24a0 tempest-AttachVolumeNegativeTest-1224056977 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:25:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-75431f50-8596-4e6d-8ba6-9716076f24a0 tempest-AttachVolumeNegativeTest-1224056977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2767b127-68ae-4b91-954c-71e572c23c78 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:56 devstack sudo[95361]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-93ef0148-e743-49c6-b338-6d345b4da0a6" returned: 1 in 0.767s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-93ef0148-e743-49c6-b338-6d345b4da0a6' failed. Not Retrying. {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:25:56 devstack cinder-volume[87233]: DEBUG cinder.volume.volume_utils [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Downloaded image 0e7aa8bb-335b-45a2-aabb-4dc50188f189 ((None, [{'url': 'file:///opt/stack/data/glance/images/0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'metadata': {}}])) to volume 93ef0148-e743-49c6-b338-6d345b4da0a6 successfully. {{(pid=87233) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 17:25:56 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Temporary image 0e7aa8bb-335b-45a2-aabb-4dc50188f189 for user b31b15e5b0d94a71ae6a07897a978083 is deleted. {{(pid=87233) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 17:25:56 devstack cinder-volume[87233]: DEBUG cinder.volume.volume_utils [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Marking volume 93ef0148-e743-49c6-b338-6d345b4da0a6 as bootable. {{(pid=87233) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 17:25:56 devstack sudo[95369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2767b127-68ae-4b91-954c-71e572c23c78 1073741824 Jul 07 17:25:56 devstack sudo[95369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:56 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Copying metadata from image 0e7aa8bb-335b-45a2-aabb-4dc50188f189 to 93ef0148-e743-49c6-b338-6d345b4da0a6. {{(pid=87233) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 17:25:56 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Creating volume glance metadata for volume 93ef0148-e743-49c6-b338-6d345b4da0a6 backed by image 0e7aa8bb-335b-45a2-aabb-4dc50188f189 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87233) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 17:25:56 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aba6468-226b-498c-8018-acea3aca40ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e523e220-2e07-4da3-a97b-e3346a61a9cb', 'volume_size': 1, 'snapshot_id': 'e02b0143-0e91-43a9-b007-a3848f3ceaa4'}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:56 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d37b730-35af-473a-a068-cd253094c4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:56 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Volume volume-e523e220-2e07-4da3-a97b-e3346a61a9cb (e523e220-2e07-4da3-a97b-e3346a61a9cb): created successfully Jul 07 17:25:56 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d37b730-35af-473a-a068-cd253094c4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:56 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Flow 'volume_create_manager' (417ef247-d677-4b30-afac-89ee42899a68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:25:56 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-54c00929-9115-43bb-91cb-5f7cfe235286 tempest-VolumesDeleteCascade-2018765742 None] Created volume successfully. Jul 07 17:25:56 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01ad2849-432a-4eca-bc15-37b9a03e2f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93ef0148-e743-49c6-b338-6d345b4da0a6', 'volume_size': 1, 'image_id': '0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ed2f318bab304b78b69744376e93ea0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'created_at': datetime.datetime(2026, 7, 7, 15, 11, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 11, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e7aa8bb-335b-45a2-aabb-4dc50188f189/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:56 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a29c60f6-71b8-4774-9bcb-621075572ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:56 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Volume volume-93ef0148-e743-49c6-b338-6d345b4da0a6 (93ef0148-e743-49c6-b338-6d345b4da0a6): created successfully Jul 07 17:25:56 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a29c60f6-71b8-4774-9bcb-621075572ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:56 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Flow 'volume_create_manager' (f9079d90-dcb5-4165-88d9-03db39ebeac3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:25:56 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-fbdde84d-7318-4e6f-b908-7a890941515c tempest-VolumesImageMetadata-398331383 None] Created volume successfully. Jul 07 17:25:56 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a045d61c-bcb1-4e98-a6c5-08f975388590 tempest-VolumesDeleteCascade-2018765742 None] Acquiring lock "cinder-369b3b6a-4e13-43d2-8adb-d744530eb4cb-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:25:56 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a045d61c-bcb1-4e98-a6c5-08f975388590 tempest-VolumesDeleteCascade-2018765742 None] Lock "cinder-369b3b6a-4e13-43d2-8adb-d744530eb4cb-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:25:56 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a045d61c-bcb1-4e98-a6c5-08f975388590 tempest-VolumesDeleteCascade-2018765742 None] Performing cascade delete. {{(pid=87233) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 07 17:25:57 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a045d61c-bcb1-4e98-a6c5-08f975388590 tempest-VolumesDeleteCascade-2018765742 None] Acquiring lock "cinder-e02b0143-0e91-43a9-b007-a3848f3ceaa4-delete_snapshot" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:25:57 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a045d61c-bcb1-4e98-a6c5-08f975388590 tempest-VolumesDeleteCascade-2018765742 None] Lock "cinder-e02b0143-0e91-43a9-b007-a3848f3ceaa4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:25:57 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a045d61c-bcb1-4e98-a6c5-08f975388590 tempest-VolumesDeleteCascade-2018765742 None] Acquiring lock "cinder-quobyte-369b3b6a-4e13-43d2-8adb-d744530eb4cb" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:25:57 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a045d61c-bcb1-4e98-a6c5-08f975388590 tempest-VolumesDeleteCascade-2018765742 None] Lock "cinder-quobyte-369b3b6a-4e13-43d2-8adb-d744530eb4cb" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:25:57 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a045d61c-bcb1-4e98-a6c5-08f975388590 tempest-VolumesDeleteCascade-2018765742 None] Acquiring lock "cinder-quobyte-e02b0143-0e91-43a9-b007-a3848f3ceaa4" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:25:57 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a045d61c-bcb1-4e98-a6c5-08f975388590 tempest-VolumesDeleteCascade-2018765742 None] Lock "cinder-quobyte-e02b0143-0e91-43a9-b007-a3848f3ceaa4" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:25:57 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-a045d61c-bcb1-4e98-a6c5-08f975388590 tempest-VolumesDeleteCascade-2018765742 None] Deleting offline snapshot e02b0143-0e91-43a9-b007-a3848f3ceaa4 of volume 369b3b6a-4e13-43d2-8adb-d744530eb4cb {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:25:57 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-a045d61c-bcb1-4e98-a6c5-08f975388590 tempest-VolumesDeleteCascade-2018765742 None] snapshot_file for this snap is: volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb.e02b0143-0e91-43a9-b007-a3848f3ceaa4 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:25:57 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad16e405-6f26-4b2d-bb98-e3616183c43c]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a045d61c-bcb1-4e98-a6c5-08f975388590 tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb.e02b0143-0e91-43a9-b007-a3848f3ceaa4 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:57 devstack sudo[95375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb.e02b0143-0e91-43a9-b007-a3848f3ceaa4 Jul 07 17:25:57 devstack sudo[95375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:57 devstack sudo[95369]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-75431f50-8596-4e6d-8ba6-9716076f24a0 tempest-AttachVolumeNegativeTest-1224056977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2767b127-68ae-4b91-954c-71e572c23c78 1073741824" returned: 0 in 1.031s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-75431f50-8596-4e6d-8ba6-9716076f24a0 tempest-AttachVolumeNegativeTest-1224056977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2767b127-68ae-4b91-954c-71e572c23c78 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:57 devstack sudo[95377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2767b127-68ae-4b91-954c-71e572c23c78 Jul 07 17:25:57 devstack sudo[95377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:57 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-349f9388-12e4-475b-a83c-9ac54a6237f0 tempest-VolumesImageMetadata-398331383 None] Acquiring lock "cinder-93ef0148-e743-49c6-b338-6d345b4da0a6-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:25:57 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-349f9388-12e4-475b-a83c-9ac54a6237f0 tempest-VolumesImageMetadata-398331383 None] Lock "cinder-93ef0148-e743-49c6-b338-6d345b4da0a6-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:25:57 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-349f9388-12e4-475b-a83c-9ac54a6237f0 tempest-VolumesImageMetadata-398331383 None] Acquiring lock "cinder-quobyte-93ef0148-e743-49c6-b338-6d345b4da0a6" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:25:57 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-349f9388-12e4-475b-a83c-9ac54a6237f0 tempest-VolumesImageMetadata-398331383 None] Lock "cinder-quobyte-93ef0148-e743-49c6-b338-6d345b4da0a6" acquired by "delete_volume" :: waited 0.023s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:25:57 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda605ba-fa2d-4e95-ae6a-efd6117d5acf]: (4, 'raw') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-349f9388-12e4-475b-a83c-9ac54a6237f0 tempest-VolumesImageMetadata-398331383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-93ef0148-e743-49c6-b338-6d345b4da0a6 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:57 devstack sudo[95379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-93ef0148-e743-49c6-b338-6d345b4da0a6 Jul 07 17:25:57 devstack sudo[95379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:58 devstack sudo[95375]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a045d61c-bcb1-4e98-a6c5-08f975388590 tempest-VolumesDeleteCascade-2018765742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb.e02b0143-0e91-43a9-b007-a3848f3ceaa4" returned: 0 in 0.881s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:58 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-a045d61c-bcb1-4e98-a6c5-08f975388590 tempest-VolumesDeleteCascade-2018765742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:25:58 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a184a74-48d5-4571-844a-0f7f6579c036]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a045d61c-bcb1-4e98-a6c5-08f975388590 tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:58 devstack sudo[95377]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-75431f50-8596-4e6d-8ba6-9716076f24a0 tempest-AttachVolumeNegativeTest-1224056977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2767b127-68ae-4b91-954c-71e572c23c78" returned: 0 in 0.726s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:58 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-75431f50-8596-4e6d-8ba6-9716076f24a0 tempest-AttachVolumeNegativeTest-1224056977 None] <== create_volume: return (1823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:25:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-75431f50-8596-4e6d-8ba6-9716076f24a0 tempest-AttachVolumeNegativeTest-1224056977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.825s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-75431f50-8596-4e6d-8ba6-9716076f24a0 tempest-AttachVolumeNegativeTest-1224056977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (645f35fc-88d7-44bc-80d8-ed8d72869cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2767b127-68ae-4b91-954c-71e572c23c78', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-75431f50-8596-4e6d-8ba6-9716076f24a0 tempest-AttachVolumeNegativeTest-1224056977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdd2fdec-726f-431b-a451-687f181a4f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:58 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-75431f50-8596-4e6d-8ba6-9716076f24a0 tempest-AttachVolumeNegativeTest-1224056977 None] Volume volume-2767b127-68ae-4b91-954c-71e572c23c78 (2767b127-68ae-4b91-954c-71e572c23c78): created successfully Jul 07 17:25:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-75431f50-8596-4e6d-8ba6-9716076f24a0 tempest-AttachVolumeNegativeTest-1224056977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdd2fdec-726f-431b-a451-687f181a4f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-75431f50-8596-4e6d-8ba6-9716076f24a0 tempest-AttachVolumeNegativeTest-1224056977 None] Flow 'volume_create_manager' (89bb36cf-515b-4b24-90ba-4f5a772e4951) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:25:58 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-75431f50-8596-4e6d-8ba6-9716076f24a0 tempest-AttachVolumeNegativeTest-1224056977 None] Created volume successfully. Jul 07 17:25:58 devstack sudo[95386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb Jul 07 17:25:58 devstack sudo[95386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:58 devstack sudo[95379]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-349f9388-12e4-475b-a83c-9ac54a6237f0 tempest-VolumesImageMetadata-398331383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-93ef0148-e743-49c6-b338-6d345b4da0a6" returned: 0 in 0.774s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-349f9388-12e4-475b-a83c-9ac54a6237f0 tempest-VolumesImageMetadata-398331383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-93ef0148-e743-49c6-b338-6d345b4da0a6 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:58 devstack sudo[95394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-93ef0148-e743-49c6-b338-6d345b4da0a6 Jul 07 17:25:58 devstack sudo[95394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:58 devstack sudo[95386]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a045d61c-bcb1-4e98-a6c5-08f975388590 tempest-VolumesDeleteCascade-2018765742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb" returned: 0 in 0.915s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a045d61c-bcb1-4e98-a6c5-08f975388590 tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb.e02b0143-0e91-43a9-b007-a3848f3ceaa4 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:58 devstack sudo[95399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb.e02b0143-0e91-43a9-b007-a3848f3ceaa4 Jul 07 17:25:58 devstack sudo[95399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:59 devstack sudo[95394]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-349f9388-12e4-475b-a83c-9ac54a6237f0 tempest-VolumesImageMetadata-398331383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-93ef0148-e743-49c6-b338-6d345b4da0a6" returned: 1 in 0.816s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-349f9388-12e4-475b-a83c-9ac54a6237f0 tempest-VolumesImageMetadata-398331383 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-93ef0148-e743-49c6-b338-6d345b4da0a6' failed. Not Retrying. {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:25:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-349f9388-12e4-475b-a83c-9ac54a6237f0 tempest-VolumesImageMetadata-398331383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-93ef0148-e743-49c6-b338-6d345b4da0a6 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:59 devstack sudo[95404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-93ef0148-e743-49c6-b338-6d345b4da0a6 Jul 07 17:25:59 devstack sudo[95404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:59 devstack sudo[95399]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a045d61c-bcb1-4e98-a6c5-08f975388590 tempest-VolumesDeleteCascade-2018765742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb.e02b0143-0e91-43a9-b007-a3848f3ceaa4" returned: 0 in 0.794s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a045d61c-bcb1-4e98-a6c5-08f975388590 tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb.e02b0143-0e91-43a9-b007-a3848f3ceaa4 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:59 devstack sudo[95410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb.e02b0143-0e91-43a9-b007-a3848f3ceaa4 Jul 07 17:25:59 devstack sudo[95410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:00 devstack sudo[95404]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-349f9388-12e4-475b-a83c-9ac54a6237f0 tempest-VolumesImageMetadata-398331383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-93ef0148-e743-49c6-b338-6d345b4da0a6" returned: 0 in 0.732s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:00 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-349f9388-12e4-475b-a83c-9ac54a6237f0 tempest-VolumesImageMetadata-398331383 None] Lock "cinder-quobyte-93ef0148-e743-49c6-b338-6d345b4da0a6" released by "delete_volume" :: held 2.398s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:00 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-349f9388-12e4-475b-a83c-9ac54a6237f0 tempest-VolumesImageMetadata-398331383 None] Created reservations ['93014089-5079-4205-ab75-0bad24088364', 'b6e51d07-4fe7-4a0f-8786-7d50455af2a1', '229f7a0d-3da1-4351-8905-19d496c28abc', '0ab4ee64-35a4-4314-a65c-6c314e43416f'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:26:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-349f9388-12e4-475b-a83c-9ac54a6237f0 tempest-VolumesImageMetadata-398331383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-349f9388-12e4-475b-a83c-9ac54a6237f0 tempest-VolumesImageMetadata-398331383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:00 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-349f9388-12e4-475b-a83c-9ac54a6237f0 tempest-VolumesImageMetadata-398331383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:26:00 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-349f9388-12e4-475b-a83c-9ac54a6237f0 tempest-VolumesImageMetadata-398331383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:26:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-349f9388-12e4-475b-a83c-9ac54a6237f0 tempest-VolumesImageMetadata-398331383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-349f9388-12e4-475b-a83c-9ac54a6237f0 tempest-VolumesImageMetadata-398331383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:00 devstack sudo[95415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:26:00 devstack sudo[95415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:00 devstack sudo[95410]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a045d61c-bcb1-4e98-a6c5-08f975388590 tempest-VolumesDeleteCascade-2018765742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb.e02b0143-0e91-43a9-b007-a3848f3ceaa4" returned: 0 in 0.672s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:00 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a045d61c-bcb1-4e98-a6c5-08f975388590 tempest-VolumesDeleteCascade-2018765742 None] Lock "cinder-quobyte-e02b0143-0e91-43a9-b007-a3848f3ceaa4" released by "_delete_snapshot" :: held 3.372s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:00 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a045d61c-bcb1-4e98-a6c5-08f975388590 tempest-VolumesDeleteCascade-2018765742 None] Lock "cinder-quobyte-369b3b6a-4e13-43d2-8adb-d744530eb4cb" released by "delete_snapshot" :: held 3.401s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:00 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-a045d61c-bcb1-4e98-a6c5-08f975388590 tempest-VolumesDeleteCascade-2018765742 None] Created reservations ['d4efd6f3-2a67-43d4-a57a-c989420db5c7', '311b1366-63b0-4231-a663-a6941bb3f645', 'a9eace7c-40a5-4050-b284-718130354faf', 'd0abf2dd-4be3-4c8d-bfb0-6ee76ea61faf'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:26:00 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-a045d61c-bcb1-4e98-a6c5-08f975388590 tempest-VolumesDeleteCascade-2018765742 None] Delete snapshot completed successfully. Jul 07 17:26:00 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a045d61c-bcb1-4e98-a6c5-08f975388590 tempest-VolumesDeleteCascade-2018765742 None] Lock "cinder-e02b0143-0e91-43a9-b007-a3848f3ceaa4-delete_snapshot" released by "delete_snapshot" :: held 3.601s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:00 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a045d61c-bcb1-4e98-a6c5-08f975388590 tempest-VolumesDeleteCascade-2018765742 None] Snapshots deleted, issuing volume delete {{(pid=87233) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 07 17:26:00 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a045d61c-bcb1-4e98-a6c5-08f975388590 tempest-VolumesDeleteCascade-2018765742 None] Acquiring lock "cinder-quobyte-369b3b6a-4e13-43d2-8adb-d744530eb4cb" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:26:00 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a045d61c-bcb1-4e98-a6c5-08f975388590 tempest-VolumesDeleteCascade-2018765742 None] Lock "cinder-quobyte-369b3b6a-4e13-43d2-8adb-d744530eb4cb" acquired by "delete_volume" :: waited 0.021s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:26:00 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0aa2d9-9c0d-4050-93f2-3f9d8232773c]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:26:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a045d61c-bcb1-4e98-a6c5-08f975388590 tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:00 devstack sudo[95417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb Jul 07 17:26:00 devstack sudo[95417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:01 devstack sudo[95415]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-349f9388-12e4-475b-a83c-9ac54a6237f0 tempest-VolumesImageMetadata-398331383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.785s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:01 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-349f9388-12e4-475b-a83c-9ac54a6237f0 tempest-VolumesImageMetadata-398331383 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:26:01 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-349f9388-12e4-475b-a83c-9ac54a6237f0 tempest-VolumesImageMetadata-398331383 None] Deleted volume successfully. Jul 07 17:26:01 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-349f9388-12e4-475b-a83c-9ac54a6237f0 tempest-VolumesImageMetadata-398331383 None] Lock "cinder-93ef0148-e743-49c6-b338-6d345b4da0a6-delete_volume" released by "delete_volume" :: held 3.589s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-86c31bb4-dffe-454d-a324-c5f184e496a7 req-094207b8-6e4c-4199-ac77-dbea67e2101b tempest-AttachVolumeNegativeTest-1224056977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-86c31bb4-dffe-454d-a324-c5f184e496a7 req-094207b8-6e4c-4199-ac77-dbea67e2101b tempest-AttachVolumeNegativeTest-1224056977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:01 devstack sudo[95417]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a045d61c-bcb1-4e98-a6c5-08f975388590 tempest-VolumesDeleteCascade-2018765742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb" returned: 0 in 0.969s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a045d61c-bcb1-4e98-a6c5-08f975388590 tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:01 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8d19d0-cfc3-4d5e-be6b-24b4fe4e32da]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:26:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-86c31bb4-dffe-454d-a324-c5f184e496a7 req-094207b8-6e4c-4199-ac77-dbea67e2101b tempest-AttachVolumeNegativeTest-1224056977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2767b127-68ae-4b91-954c-71e572c23c78 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:01 devstack sudo[95432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb Jul 07 17:26:01 devstack sudo[95432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:01 devstack sudo[95433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2767b127-68ae-4b91-954c-71e572c23c78 Jul 07 17:26:01 devstack sudo[95433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:02 devstack sudo[95432]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a045d61c-bcb1-4e98-a6c5-08f975388590 tempest-VolumesDeleteCascade-2018765742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-369b3b6a-4e13-43d2-8adb-d744530eb4cb" returned: 0 in 0.739s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:02 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a045d61c-bcb1-4e98-a6c5-08f975388590 tempest-VolumesDeleteCascade-2018765742 None] Lock "cinder-quobyte-369b3b6a-4e13-43d2-8adb-d744530eb4cb" released by "delete_volume" :: held 1.805s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:02 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-a045d61c-bcb1-4e98-a6c5-08f975388590 tempest-VolumesDeleteCascade-2018765742 None] Created reservations ['849bc385-718a-4823-98c8-6d1c8d71faca', '40c07955-ebc7-4873-af81-a05ac7d6f2c3', '8d134f7c-0965-448e-948b-c906c5673e85', '2a2676da-4adb-4fbe-9b88-68aa4b8577f7'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:26:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a045d61c-bcb1-4e98-a6c5-08f975388590 tempest-VolumesDeleteCascade-2018765742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a045d61c-bcb1-4e98-a6c5-08f975388590 tempest-VolumesDeleteCascade-2018765742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:02 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-a045d61c-bcb1-4e98-a6c5-08f975388590 tempest-VolumesDeleteCascade-2018765742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:26:02 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-a045d61c-bcb1-4e98-a6c5-08f975388590 tempest-VolumesDeleteCascade-2018765742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:26:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a045d61c-bcb1-4e98-a6c5-08f975388590 tempest-VolumesDeleteCascade-2018765742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a045d61c-bcb1-4e98-a6c5-08f975388590 tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:02 devstack sudo[95440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:26:02 devstack sudo[95440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:02 devstack sudo[95433]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-86c31bb4-dffe-454d-a324-c5f184e496a7 req-094207b8-6e4c-4199-ac77-dbea67e2101b tempest-AttachVolumeNegativeTest-1224056977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2767b127-68ae-4b91-954c-71e572c23c78" returned: 0 in 1.043s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-86c31bb4-dffe-454d-a324-c5f184e496a7 req-094207b8-6e4c-4199-ac77-dbea67e2101b tempest-AttachVolumeNegativeTest-1224056977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.073s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:02 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-86c31bb4-dffe-454d-a324-c5f184e496a7 req-094207b8-6e4c-4199-ac77-dbea67e2101b tempest-AttachVolumeNegativeTest-1224056977 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7', 'name': 'volume-2767b127-68ae-4b91-954c-71e572c23c78', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '640d77e1-8560-4026-a180-7c7a7c62d100', 'enforce_multipath': True} {{(pid=87233) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:26:02 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-86c31bb4-dffe-454d-a324-c5f184e496a7 req-094207b8-6e4c-4199-ac77-dbea67e2101b tempest-AttachVolumeNegativeTest-1224056977 None] attachment_update completed successfully. Jul 07 17:26:03 devstack sudo[95440]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a045d61c-bcb1-4e98-a6c5-08f975388590 tempest-VolumesDeleteCascade-2018765742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.811s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:03 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-a045d61c-bcb1-4e98-a6c5-08f975388590 tempest-VolumesDeleteCascade-2018765742 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:26:03 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-a045d61c-bcb1-4e98-a6c5-08f975388590 tempest-VolumesDeleteCascade-2018765742 None] Deleted volume successfully. Jul 07 17:26:03 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a045d61c-bcb1-4e98-a6c5-08f975388590 tempest-VolumesDeleteCascade-2018765742 None] Lock "cinder-369b3b6a-4e13-43d2-8adb-d744530eb4cb-delete_volume" released by "delete_volume" :: held 6.534s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:03 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ca4d5e36-232a-48df-8083-1cbb700fa580 tempest-VolumesDeleteCascade-2018765742 None] Acquiring lock "cinder-e523e220-2e07-4da3-a97b-e3346a61a9cb-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:26:03 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ca4d5e36-232a-48df-8083-1cbb700fa580 tempest-VolumesDeleteCascade-2018765742 None] Lock "cinder-e523e220-2e07-4da3-a97b-e3346a61a9cb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:26:03 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ca4d5e36-232a-48df-8083-1cbb700fa580 tempest-VolumesDeleteCascade-2018765742 None] Acquiring lock "cinder-quobyte-e523e220-2e07-4da3-a97b-e3346a61a9cb" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:26:03 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ca4d5e36-232a-48df-8083-1cbb700fa580 tempest-VolumesDeleteCascade-2018765742 None] Lock "cinder-quobyte-e523e220-2e07-4da3-a97b-e3346a61a9cb" acquired by "delete_volume" :: waited 0.017s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:26:03 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb6c796-641b-4087-b9d3-54838e573225]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:26:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ca4d5e36-232a-48df-8083-1cbb700fa580 tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e523e220-2e07-4da3-a97b-e3346a61a9cb {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:03 devstack sudo[95511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e523e220-2e07-4da3-a97b-e3346a61a9cb Jul 07 17:26:03 devstack sudo[95511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:04 devstack sudo[95511]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ca4d5e36-232a-48df-8083-1cbb700fa580 tempest-VolumesDeleteCascade-2018765742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e523e220-2e07-4da3-a97b-e3346a61a9cb" returned: 0 in 0.889s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ca4d5e36-232a-48df-8083-1cbb700fa580 tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e523e220-2e07-4da3-a97b-e3346a61a9cb {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:04 devstack sudo[95831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e523e220-2e07-4da3-a97b-e3346a61a9cb Jul 07 17:26:04 devstack sudo[95831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:05 devstack sudo[95831]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ca4d5e36-232a-48df-8083-1cbb700fa580 tempest-VolumesDeleteCascade-2018765742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e523e220-2e07-4da3-a97b-e3346a61a9cb" returned: 0 in 0.687s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:05 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ca4d5e36-232a-48df-8083-1cbb700fa580 tempest-VolumesDeleteCascade-2018765742 None] Lock "cinder-quobyte-e523e220-2e07-4da3-a97b-e3346a61a9cb" released by "delete_volume" :: held 1.627s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:05 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-ca4d5e36-232a-48df-8083-1cbb700fa580 tempest-VolumesDeleteCascade-2018765742 None] Created reservations ['737677c9-4350-4c5a-93f2-989c1e02c231', '1fdbc31f-6e4f-4d63-860a-b2fdba03f9de', '98b59c68-2e9a-41e0-9282-3baa82bbe69f', '510917f8-365d-40f1-be54-4d9ef149f3a1'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:26:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ca4d5e36-232a-48df-8083-1cbb700fa580 tempest-VolumesDeleteCascade-2018765742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ca4d5e36-232a-48df-8083-1cbb700fa580 tempest-VolumesDeleteCascade-2018765742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:05 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ca4d5e36-232a-48df-8083-1cbb700fa580 tempest-VolumesDeleteCascade-2018765742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:26:05 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ca4d5e36-232a-48df-8083-1cbb700fa580 tempest-VolumesDeleteCascade-2018765742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:26:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ca4d5e36-232a-48df-8083-1cbb700fa580 tempest-VolumesDeleteCascade-2018765742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ca4d5e36-232a-48df-8083-1cbb700fa580 tempest-VolumesDeleteCascade-2018765742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:05 devstack sudo[95834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:26:05 devstack sudo[95834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:06 devstack sudo[95834]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ca4d5e36-232a-48df-8083-1cbb700fa580 tempest-VolumesDeleteCascade-2018765742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.711s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:06 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-ca4d5e36-232a-48df-8083-1cbb700fa580 tempest-VolumesDeleteCascade-2018765742 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:26:06 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-ca4d5e36-232a-48df-8083-1cbb700fa580 tempest-VolumesDeleteCascade-2018765742 None] Deleted volume successfully. Jul 07 17:26:06 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ca4d5e36-232a-48df-8083-1cbb700fa580 tempest-VolumesDeleteCascade-2018765742 None] Lock "cinder-e523e220-2e07-4da3-a97b-e3346a61a9cb-delete_volume" released by "delete_volume" :: held 2.589s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:08 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:26:08 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Flow 'volume_create_manager' (ef72722e-e7ab-4e0e-8758-e5af4c45d905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:26:08 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e3491c5-7bfb-4e21-a54b-d216153826e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:08 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e3491c5-7bfb-4e21-a54b-d216153826e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1265996912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87f9ef4b-cb63-47c6-9263-c771d7515b88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a6f9dc391484919b93fab15df535766',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:26:08Z,use_quota=True,user_id='6e9bc6ed5c374d248698301fd5c7833d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:08 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb4cb963-bc7b-41d3-8ca0-74bacdb88a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:08 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb4cb963-bc7b-41d3-8ca0-74bacdb88a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:08 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (381753be-e6d7-4049-ab0f-5f820042b94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:08 devstack cinder-volume[87233]: DEBUG cinder.image.glance [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Creating Keystone auth plugin from conf {{(pid=87233) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 17:26:08 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (381753be-e6d7-4049-ab0f-5f820042b94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '87f9ef4b-cb63-47c6-9263-c771d7515b88', 'volume_name': 'volume-87f9ef4b-cb63-47c6-9263-c771d7515b88', 'volume_size': 1, 'image_id': '0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ed2f318bab304b78b69744376e93ea0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'created_at': datetime.datetime(2026, 7, 7, 15, 11, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 11, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e7aa8bb-335b-45a2-aabb-4dc50188f189/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:08 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62072bf0-73ac-449d-9710-49cff5bd6a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:08 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62072bf0-73ac-449d-9710-49cff5bd6a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:08 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e3ceb22-c84f-4801-aaa5-c245950e4ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:08 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Volume 87f9ef4b-cb63-47c6-9263-c771d7515b88: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-87f9ef4b-cb63-47c6-9263-c771d7515b88', 'volume_size': 1, 'image_id': '0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ed2f318bab304b78b69744376e93ea0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'created_at': datetime.datetime(2026, 7, 7, 15, 11, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 11, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e7aa8bb-335b-45a2-aabb-4dc50188f189/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 17:26:08 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Trying to clone 87f9ef4b-cb63-47c6-9263-c771d7515b88 from image 0e7aa8bb-335b-45a2-aabb-4dc50188f189 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'metadata': {}}]). {{(pid=87233) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 17:26:09 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_opwrglwidevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87233) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 17:26:09 devstack cinder-volume[87233]: INFO cinder.image.image_utils [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Image download 20.69 MB at 20.69 MB/s Jul 07 17:26:09 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5479f119-d7cc-47a3-9239-649e7fae88be]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:26:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_opwrglwidevstack@QuobyteHD {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:09 devstack sudo[95872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_opwrglwidevstack@QuobyteHD Jul 07 17:26:09 devstack sudo[95872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:09 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca41db15-dcaf-4c09-8cb0-50d19901c155 tempest-VolumesMetadataTest-157231776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:26:09 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ca41db15-dcaf-4c09-8cb0-50d19901c155 tempest-VolumesMetadataTest-157231776 None] Flow 'volume_create_manager' (64fbd253-5d24-4218-8c64-9ae9fe5d62b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:26:09 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ca41db15-dcaf-4c09-8cb0-50d19901c155 tempest-VolumesMetadataTest-157231776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d3eedad-e81f-41d1-a803-b92f3dddc3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ca41db15-dcaf-4c09-8cb0-50d19901c155 tempest-VolumesMetadataTest-157231776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d3eedad-e81f-41d1-a803-b92f3dddc3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1570601239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ff1cd8f-9fd0-4da7-a18b-68be1ce51299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a81392dca5422d9e1d92dc4dbfab78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:26:10Z,use_quota=True,user_id='1222f7bd7b264e52b9b4ab08913a9281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ca41db15-dcaf-4c09-8cb0-50d19901c155 tempest-VolumesMetadataTest-157231776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6193880-d354-4556-8dbc-74cf66d70a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ca41db15-dcaf-4c09-8cb0-50d19901c155 tempest-VolumesMetadataTest-157231776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6193880-d354-4556-8dbc-74cf66d70a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ca41db15-dcaf-4c09-8cb0-50d19901c155 tempest-VolumesMetadataTest-157231776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (641bca02-fbe1-4dcd-932d-049debc0407c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ca41db15-dcaf-4c09-8cb0-50d19901c155 tempest-VolumesMetadataTest-157231776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (641bca02-fbe1-4dcd-932d-049debc0407c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ff1cd8f-9fd0-4da7-a18b-68be1ce51299', 'volume_name': 'volume-5ff1cd8f-9fd0-4da7-a18b-68be1ce51299', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ca41db15-dcaf-4c09-8cb0-50d19901c155 tempest-VolumesMetadataTest-157231776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc74d9cb-a06a-49de-9e93-859b6b13fcd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ca41db15-dcaf-4c09-8cb0-50d19901c155 tempest-VolumesMetadataTest-157231776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc74d9cb-a06a-49de-9e93-859b6b13fcd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ca41db15-dcaf-4c09-8cb0-50d19901c155 tempest-VolumesMetadataTest-157231776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e5e5401-8b63-47aa-a992-10f0260a2e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:10 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-ca41db15-dcaf-4c09-8cb0-50d19901c155 tempest-VolumesMetadataTest-157231776 None] Volume 5ff1cd8f-9fd0-4da7-a18b-68be1ce51299: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ff1cd8f-9fd0-4da7-a18b-68be1ce51299', 'volume_size': 1} Jul 07 17:26:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ca41db15-dcaf-4c09-8cb0-50d19901c155 tempest-VolumesMetadataTest-157231776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ca41db15-dcaf-4c09-8cb0-50d19901c155 tempest-VolumesMetadataTest-157231776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:10 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ca41db15-dcaf-4c09-8cb0-50d19901c155 tempest-VolumesMetadataTest-157231776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1570601239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ff1cd8f-9fd0-4da7-a18b-68be1ce51299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a81392dca5422d9e1d92dc4dbfab78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:26:10Z,use_quota=True,user_id='1222f7bd7b264e52b9b4ab08913a9281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:26:10 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-ca41db15-dcaf-4c09-8cb0-50d19901c155 tempest-VolumesMetadataTest-157231776 None] Creating volume 5ff1cd8f-9fd0-4da7-a18b-68be1ce51299 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:26:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ca41db15-dcaf-4c09-8cb0-50d19901c155 tempest-VolumesMetadataTest-157231776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ca41db15-dcaf-4c09-8cb0-50d19901c155 tempest-VolumesMetadataTest-157231776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:10 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ca41db15-dcaf-4c09-8cb0-50d19901c155 tempest-VolumesMetadataTest-157231776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:26:10 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ca41db15-dcaf-4c09-8cb0-50d19901c155 tempest-VolumesMetadataTest-157231776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:26:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ca41db15-dcaf-4c09-8cb0-50d19901c155 tempest-VolumesMetadataTest-157231776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:10 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ca41db15-dcaf-4c09-8cb0-50d19901c155 tempest-VolumesMetadataTest-157231776 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:26:10 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-ca41db15-dcaf-4c09-8cb0-50d19901c155 tempest-VolumesMetadataTest-157231776 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:26:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ca41db15-dcaf-4c09-8cb0-50d19901c155 tempest-VolumesMetadataTest-157231776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5ff1cd8f-9fd0-4da7-a18b-68be1ce51299 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:10 devstack sudo[95877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5ff1cd8f-9fd0-4da7-a18b-68be1ce51299 1073741824 Jul 07 17:26:10 devstack sudo[95877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:10 devstack sudo[95872]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_opwrglwidevstack@QuobyteHD" returned: 0 in 0.951s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:10 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Temporary image 0e7aa8bb-335b-45a2-aabb-4dc50188f189 is fetched for user 6e9bc6ed5c374d248698301fd5c7833d. {{(pid=87233) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 17:26:10 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5c470d-999a-4f8b-bce3-ccb30dc3bf5a]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:26:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_opwrglwidevstack@QuobyteHD {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:10 devstack sudo[95883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_opwrglwidevstack@QuobyteHD Jul 07 17:26:10 devstack sudo[95883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:11 devstack sudo[95877]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ca41db15-dcaf-4c09-8cb0-50d19901c155 tempest-VolumesMetadataTest-157231776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5ff1cd8f-9fd0-4da7-a18b-68be1ce51299 1073741824" returned: 0 in 1.061s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ca41db15-dcaf-4c09-8cb0-50d19901c155 tempest-VolumesMetadataTest-157231776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5ff1cd8f-9fd0-4da7-a18b-68be1ce51299 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:11 devstack sudo[95889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5ff1cd8f-9fd0-4da7-a18b-68be1ce51299 Jul 07 17:26:11 devstack sudo[95889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:11 devstack sudo[95883]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_opwrglwidevstack@QuobyteHD" returned: 0 in 0.940s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:11 devstack sudo[95889]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ca41db15-dcaf-4c09-8cb0-50d19901c155 tempest-VolumesMetadataTest-157231776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5ff1cd8f-9fd0-4da7-a18b-68be1ce51299" returned: 0 in 0.763s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:11 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ca41db15-dcaf-4c09-8cb0-50d19901c155 tempest-VolumesMetadataTest-157231776 None] <== create_volume: return (1874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:26:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ca41db15-dcaf-4c09-8cb0-50d19901c155 tempest-VolumesMetadataTest-157231776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.878s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.452s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:11 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1265996912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87f9ef4b-cb63-47c6-9263-c771d7515b88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a6f9dc391484919b93fab15df535766',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:26:08Z,use_quota=True,user_id='6e9bc6ed5c374d248698301fd5c7833d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:26:11 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Creating volume 87f9ef4b-cb63-47c6-9263-c771d7515b88 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:26:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:11 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:26:11 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:26:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:11 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:26:11 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:26:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-87f9ef4b-cb63-47c6-9263-c771d7515b88 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:11 devstack sudo[95898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-87f9ef4b-cb63-47c6-9263-c771d7515b88 1073741824 Jul 07 17:26:11 devstack sudo[95898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:11 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ca41db15-dcaf-4c09-8cb0-50d19901c155 tempest-VolumesMetadataTest-157231776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e5e5401-8b63-47aa-a992-10f0260a2e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ff1cd8f-9fd0-4da7-a18b-68be1ce51299', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:12 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ca41db15-dcaf-4c09-8cb0-50d19901c155 tempest-VolumesMetadataTest-157231776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d136f7d4-9bad-4489-9dfe-91dcbc12f8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:12 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-ca41db15-dcaf-4c09-8cb0-50d19901c155 tempest-VolumesMetadataTest-157231776 None] Volume volume-5ff1cd8f-9fd0-4da7-a18b-68be1ce51299 (5ff1cd8f-9fd0-4da7-a18b-68be1ce51299): created successfully Jul 07 17:26:12 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ca41db15-dcaf-4c09-8cb0-50d19901c155 tempest-VolumesMetadataTest-157231776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d136f7d4-9bad-4489-9dfe-91dcbc12f8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:12 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ca41db15-dcaf-4c09-8cb0-50d19901c155 tempest-VolumesMetadataTest-157231776 None] Flow 'volume_create_manager' (64fbd253-5d24-4218-8c64-9ae9fe5d62b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:26:12 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-ca41db15-dcaf-4c09-8cb0-50d19901c155 tempest-VolumesMetadataTest-157231776 None] Created volume successfully. Jul 07 17:26:12 devstack sudo[95898]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-87f9ef4b-cb63-47c6-9263-c771d7515b88 1073741824" returned: 0 in 0.922s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-87f9ef4b-cb63-47c6-9263-c771d7515b88 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:12 devstack sudo[95905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-87f9ef4b-cb63-47c6-9263-c771d7515b88 Jul 07 17:26:12 devstack sudo[95905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:13 devstack sudo[95905]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-87f9ef4b-cb63-47c6-9263-c771d7515b88" returned: 0 in 0.776s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:13 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] <== create_volume: return (1750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:26:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.752s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:13 devstack cinder-volume[87233]: DEBUG cinder.volume.volume_utils [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Attempting download of 0e7aa8bb-335b-45a2-aabb-4dc50188f189 ((None, [{'url': 'file:///opt/stack/data/glance/images/0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'metadata': {}}])) to volume 87f9ef4b-cb63-47c6-9263-c771d7515b88. {{(pid=87233) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 17:26:13 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-b54bc4ec-b749-4119-95cb-076b5dd765a6 tempest-VolumesMetadataTest-157231776 None] Acquiring lock "cinder-5ff1cd8f-9fd0-4da7-a18b-68be1ce51299-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:26:13 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-b54bc4ec-b749-4119-95cb-076b5dd765a6 tempest-VolumesMetadataTest-157231776 None] Lock "cinder-5ff1cd8f-9fd0-4da7-a18b-68be1ce51299-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:26:13 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d08c81f-bf5e-4723-adbe-a832fa70b86e]: (4, 'raw') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:26:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e7aa8bb-335b-45a2-aabb-4dc50188f189_t87w6p2v {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:13 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-b54bc4ec-b749-4119-95cb-076b5dd765a6 tempest-VolumesMetadataTest-157231776 None] Acquiring lock "cinder-quobyte-5ff1cd8f-9fd0-4da7-a18b-68be1ce51299" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:26:13 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-b54bc4ec-b749-4119-95cb-076b5dd765a6 tempest-VolumesMetadataTest-157231776 None] Lock "cinder-quobyte-5ff1cd8f-9fd0-4da7-a18b-68be1ce51299" acquired by "delete_volume" :: waited 0.028s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:26:13 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[60150b91-8ea8-4c8b-900e-d55e721ba4a3]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:26:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b54bc4ec-b749-4119-95cb-076b5dd765a6 tempest-VolumesMetadataTest-157231776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5ff1cd8f-9fd0-4da7-a18b-68be1ce51299 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:13 devstack sudo[95908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e7aa8bb-335b-45a2-aabb-4dc50188f189_t87w6p2v Jul 07 17:26:13 devstack sudo[95908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:14 devstack sudo[95909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5ff1cd8f-9fd0-4da7-a18b-68be1ce51299 Jul 07 17:26:14 devstack sudo[95909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:14 devstack sudo[95908]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e7aa8bb-335b-45a2-aabb-4dc50188f189_t87w6p2v" returned: 0 in 0.775s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e7aa8bb-335b-45a2-aabb-4dc50188f189_t87w6p2v {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:14 devstack sudo[95917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e7aa8bb-335b-45a2-aabb-4dc50188f189_t87w6p2v Jul 07 17:26:14 devstack sudo[95917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:14 devstack sudo[95909]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b54bc4ec-b749-4119-95cb-076b5dd765a6 tempest-VolumesMetadataTest-157231776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5ff1cd8f-9fd0-4da7-a18b-68be1ce51299" returned: 0 in 0.816s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b54bc4ec-b749-4119-95cb-076b5dd765a6 tempest-VolumesMetadataTest-157231776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5ff1cd8f-9fd0-4da7-a18b-68be1ce51299 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:14 devstack sudo[95920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5ff1cd8f-9fd0-4da7-a18b-68be1ce51299 Jul 07 17:26:14 devstack sudo[95920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:15 devstack sudo[95917]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e7aa8bb-335b-45a2-aabb-4dc50188f189_t87w6p2v" returned: 1 in 0.828s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e7aa8bb-335b-45a2-aabb-4dc50188f189_t87w6p2v' failed. Not Retrying. {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:26:15 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab03a0d9-1963-4db6-962a-06beb6053f22]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:26:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_opwrglwidevstack@QuobyteHD {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:15 devstack sudo[95920]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b54bc4ec-b749-4119-95cb-076b5dd765a6 tempest-VolumesMetadataTest-157231776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5ff1cd8f-9fd0-4da7-a18b-68be1ce51299" returned: 0 in 0.759s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:15 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-b54bc4ec-b749-4119-95cb-076b5dd765a6 tempest-VolumesMetadataTest-157231776 None] Lock "cinder-quobyte-5ff1cd8f-9fd0-4da7-a18b-68be1ce51299" released by "delete_volume" :: held 1.636s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:15 devstack sudo[95925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_opwrglwidevstack@QuobyteHD Jul 07 17:26:15 devstack sudo[95925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:15 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-b54bc4ec-b749-4119-95cb-076b5dd765a6 tempest-VolumesMetadataTest-157231776 None] Created reservations ['1e668b1f-f05c-4619-af7a-d371bb842b55', 'f36e00d8-f0ab-4697-9809-4f82e6b8b3f9', '9f6d153c-0241-4755-8023-f523dddf9c12', '039126c3-181f-4fe6-82cf-de9adecb04fa'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:26:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b54bc4ec-b749-4119-95cb-076b5dd765a6 tempest-VolumesMetadataTest-157231776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b54bc4ec-b749-4119-95cb-076b5dd765a6 tempest-VolumesMetadataTest-157231776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:15 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b54bc4ec-b749-4119-95cb-076b5dd765a6 tempest-VolumesMetadataTest-157231776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:26:15 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b54bc4ec-b749-4119-95cb-076b5dd765a6 tempest-VolumesMetadataTest-157231776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:26:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b54bc4ec-b749-4119-95cb-076b5dd765a6 tempest-VolumesMetadataTest-157231776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b54bc4ec-b749-4119-95cb-076b5dd765a6 tempest-VolumesMetadataTest-157231776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:15 devstack sudo[95927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:26:15 devstack sudo[95927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:16 devstack sudo[95925]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_opwrglwidevstack@QuobyteHD" returned: 0 in 0.901s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:16 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] 0e7aa8bb-335b-45a2-aabb-4dc50188f189 was qcow2, converting to raw {{(pid=87233) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 17:26:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_opwrglwidevstack@QuobyteHD /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-87f9ef4b-cb63-47c6-9263-c771d7515b88 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:16 devstack sudo[95933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_opwrglwidevstack@QuobyteHD /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-87f9ef4b-cb63-47c6-9263-c771d7515b88 Jul 07 17:26:16 devstack sudo[95933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:16 devstack sudo[95927]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b54bc4ec-b749-4119-95cb-076b5dd765a6 tempest-VolumesMetadataTest-157231776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.902s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:16 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-b54bc4ec-b749-4119-95cb-076b5dd765a6 tempest-VolumesMetadataTest-157231776 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:26:16 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-b54bc4ec-b749-4119-95cb-076b5dd765a6 tempest-VolumesMetadataTest-157231776 None] Deleted volume successfully. Jul 07 17:26:16 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-b54bc4ec-b749-4119-95cb-076b5dd765a6 tempest-VolumesMetadataTest-157231776 None] Lock "cinder-5ff1cd8f-9fd0-4da7-a18b-68be1ce51299-delete_volume" released by "delete_volume" :: held 2.821s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:19 devstack sudo[95933]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_opwrglwidevstack@QuobyteHD /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-87f9ef4b-cb63-47c6-9263-c771d7515b88" returned: 0 in 2.769s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:19 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_opwrglwidevstack@QuobyteHD, size 112.00 MB, duration 2.77 sec, destination /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-87f9ef4b-cb63-47c6-9263-c771d7515b88 {{(pid=87233) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:26:19 devstack cinder-volume[87233]: INFO cinder.image.image_utils [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Converted 112.00 MB image at 40.43 MB/s Jul 07 17:26:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-87f9ef4b-cb63-47c6-9263-c771d7515b88 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:19 devstack sudo[95957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-87f9ef4b-cb63-47c6-9263-c771d7515b88 1G Jul 07 17:26:19 devstack sudo[95957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:20 devstack sudo[95957]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-87f9ef4b-cb63-47c6-9263-c771d7515b88 1G" returned: 0 in 0.918s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:20 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d171763e-69c4-47ec-80b8-af9a8bcce9dc]: (4, 'raw') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:26:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-87f9ef4b-cb63-47c6-9263-c771d7515b88 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:20 devstack sudo[95967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-87f9ef4b-cb63-47c6-9263-c771d7515b88 Jul 07 17:26:20 devstack sudo[95967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:20 devstack sudo[95967]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-87f9ef4b-cb63-47c6-9263-c771d7515b88" returned: 0 in 0.812s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-87f9ef4b-cb63-47c6-9263-c771d7515b88 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:20 devstack sudo[95977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-87f9ef4b-cb63-47c6-9263-c771d7515b88 Jul 07 17:26:21 devstack sudo[95977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:21 devstack sudo[95977]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-87f9ef4b-cb63-47c6-9263-c771d7515b88" returned: 1 in 0.903s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-87f9ef4b-cb63-47c6-9263-c771d7515b88' failed. Not Retrying. {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:26:21 devstack cinder-volume[87233]: DEBUG cinder.volume.volume_utils [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Downloaded image 0e7aa8bb-335b-45a2-aabb-4dc50188f189 ((None, [{'url': 'file:///opt/stack/data/glance/images/0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'metadata': {}}])) to volume 87f9ef4b-cb63-47c6-9263-c771d7515b88 successfully. {{(pid=87233) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 17:26:21 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Temporary image 0e7aa8bb-335b-45a2-aabb-4dc50188f189 for user 6e9bc6ed5c374d248698301fd5c7833d is deleted. {{(pid=87233) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 17:26:21 devstack cinder-volume[87233]: DEBUG cinder.volume.volume_utils [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Marking volume 87f9ef4b-cb63-47c6-9263-c771d7515b88 as bootable. {{(pid=87233) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 17:26:21 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Copying metadata from image 0e7aa8bb-335b-45a2-aabb-4dc50188f189 to 87f9ef4b-cb63-47c6-9263-c771d7515b88. {{(pid=87233) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 17:26:21 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Creating volume glance metadata for volume 87f9ef4b-cb63-47c6-9263-c771d7515b88 backed by image 0e7aa8bb-335b-45a2-aabb-4dc50188f189 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87233) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 17:26:21 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e3ceb22-c84f-4801-aaa5-c245950e4ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87f9ef4b-cb63-47c6-9263-c771d7515b88', 'volume_size': 1, 'image_id': '0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ed2f318bab304b78b69744376e93ea0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'created_at': datetime.datetime(2026, 7, 7, 15, 11, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 11, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e7aa8bb-335b-45a2-aabb-4dc50188f189/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:21 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (104090ce-dc24-4470-a1a4-3a726cf33db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:21 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Volume volume-87f9ef4b-cb63-47c6-9263-c771d7515b88 (87f9ef4b-cb63-47c6-9263-c771d7515b88): created successfully Jul 07 17:26:21 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (104090ce-dc24-4470-a1a4-3a726cf33db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:21 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Flow 'volume_create_manager' (ef72722e-e7ab-4e0e-8758-e5af4c45d905) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:26:21 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-d5f33ea7-4c57-4f93-9926-0d0621982c15 tempest-VolumesExtendTest-1013664371 None] Created volume successfully. Jul 07 17:26:22 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1f54d5b-c800-4475-aa3f-38eddfae0ce3 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:26:22 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e1f54d5b-c800-4475-aa3f-38eddfae0ce3 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Flow 'volume_create_manager' (4f29cb4e-60c7-4b6f-bd12-c6edc84c1a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:26:22 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e1f54d5b-c800-4475-aa3f-38eddfae0ce3 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8adaa6c-c810-40be-93bc-08334e00293b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:22 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e1f54d5b-c800-4475-aa3f-38eddfae0ce3 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8adaa6c-c810-40be-93bc-08334e00293b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-757176579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83941d99-9f7b-4d32-b422-9dbc59ce3616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48eadc9c82174e4d81ef30b0d628c66a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:26:22Z,use_quota=True,user_id='70eb8b7944184c7181974f5685f14756',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(61a8bb86-d41b-4960-b943-8dffbf43ef26),volume_type_id=61a8bb86-d41b-4960-b943-8dffbf43ef26)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:22 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e1f54d5b-c800-4475-aa3f-38eddfae0ce3 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5a7d114-f9d1-4823-ba96-c499ee8b4817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:22 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e1f54d5b-c800-4475-aa3f-38eddfae0ce3 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5a7d114-f9d1-4823-ba96-c499ee8b4817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:22 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e1f54d5b-c800-4475-aa3f-38eddfae0ce3 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74e0d75d-9a2c-4b76-b14c-638730e36b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:22 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e1f54d5b-c800-4475-aa3f-38eddfae0ce3 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74e0d75d-9a2c-4b76-b14c-638730e36b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83941d99-9f7b-4d32-b422-9dbc59ce3616', 'volume_name': 'volume-83941d99-9f7b-4d32-b422-9dbc59ce3616', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:22 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e1f54d5b-c800-4475-aa3f-38eddfae0ce3 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5f55998-ab01-4755-9475-896d67459b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:22 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e1f54d5b-c800-4475-aa3f-38eddfae0ce3 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5f55998-ab01-4755-9475-896d67459b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:22 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e1f54d5b-c800-4475-aa3f-38eddfae0ce3 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f9079e9-53bc-440d-9b1e-f43852d2879c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:22 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-e1f54d5b-c800-4475-aa3f-38eddfae0ce3 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Volume 83941d99-9f7b-4d32-b422-9dbc59ce3616: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83941d99-9f7b-4d32-b422-9dbc59ce3616', 'volume_size': 1} Jul 07 17:26:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e1f54d5b-c800-4475-aa3f-38eddfae0ce3 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e1f54d5b-c800-4475-aa3f-38eddfae0ce3 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:22 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-e1f54d5b-c800-4475-aa3f-38eddfae0ce3 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-757176579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83941d99-9f7b-4d32-b422-9dbc59ce3616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48eadc9c82174e4d81ef30b0d628c66a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:26:22Z,use_quota=True,user_id='70eb8b7944184c7181974f5685f14756',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(61a8bb86-d41b-4960-b943-8dffbf43ef26),volume_type_id=61a8bb86-d41b-4960-b943-8dffbf43ef26)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:26:22 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-e1f54d5b-c800-4475-aa3f-38eddfae0ce3 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Creating volume 83941d99-9f7b-4d32-b422-9dbc59ce3616 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:26:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e1f54d5b-c800-4475-aa3f-38eddfae0ce3 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e1f54d5b-c800-4475-aa3f-38eddfae0ce3 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:22 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-e1f54d5b-c800-4475-aa3f-38eddfae0ce3 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:26:22 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-e1f54d5b-c800-4475-aa3f-38eddfae0ce3 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:26:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e1f54d5b-c800-4475-aa3f-38eddfae0ce3 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:22 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-e1f54d5b-c800-4475-aa3f-38eddfae0ce3 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:26:22 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-e1f54d5b-c800-4475-aa3f-38eddfae0ce3 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:26:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e1f54d5b-c800-4475-aa3f-38eddfae0ce3 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83941d99-9f7b-4d32-b422-9dbc59ce3616 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:22 devstack sudo[95983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83941d99-9f7b-4d32-b422-9dbc59ce3616 1073741824 Jul 07 17:26:22 devstack sudo[95983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-01e2a7a4-25e4-4aec-8bce-45a357e583e7 tempest-VolumesExtendTest-1013664371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:22 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-edc3fb4e-a1ef-4ccd-8330-fd357992a53d tempest-VolumesTransfersTest-1613825803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:26:22 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-edc3fb4e-a1ef-4ccd-8330-fd357992a53d tempest-VolumesTransfersTest-1613825803 None] Flow 'volume_create_manager' (43894b4a-56df-4733-8ca3-4d486e71cab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:26:22 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-edc3fb4e-a1ef-4ccd-8330-fd357992a53d tempest-VolumesTransfersTest-1613825803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f964d3c-7deb-4f02-b505-851740d639e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:22 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-edc3fb4e-a1ef-4ccd-8330-fd357992a53d tempest-VolumesTransfersTest-1613825803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f964d3c-7deb-4f02-b505-851740d639e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-484978235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=516a6e61-3cc1-40ba-b213-7418f1b2376a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aa27dd6bda24c338f7e2d4c3bfd7917',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:26:23Z,use_quota=True,user_id='e5cab0b5c9b74911a8e9ab5bd27aa468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:22 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-edc3fb4e-a1ef-4ccd-8330-fd357992a53d tempest-VolumesTransfersTest-1613825803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b5a15f9-e7b7-4d13-9117-2c3a0b4e49e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:22 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-edc3fb4e-a1ef-4ccd-8330-fd357992a53d tempest-VolumesTransfersTest-1613825803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b5a15f9-e7b7-4d13-9117-2c3a0b4e49e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:22 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-edc3fb4e-a1ef-4ccd-8330-fd357992a53d tempest-VolumesTransfersTest-1613825803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c893b811-be3c-4261-9d17-b65968042a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:22 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-edc3fb4e-a1ef-4ccd-8330-fd357992a53d tempest-VolumesTransfersTest-1613825803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c893b811-be3c-4261-9d17-b65968042a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '516a6e61-3cc1-40ba-b213-7418f1b2376a', 'volume_name': 'volume-516a6e61-3cc1-40ba-b213-7418f1b2376a', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:22 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-edc3fb4e-a1ef-4ccd-8330-fd357992a53d tempest-VolumesTransfersTest-1613825803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (222b9446-3941-487e-a9f2-b8b477e70f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:22 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-edc3fb4e-a1ef-4ccd-8330-fd357992a53d tempest-VolumesTransfersTest-1613825803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (222b9446-3941-487e-a9f2-b8b477e70f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:22 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-edc3fb4e-a1ef-4ccd-8330-fd357992a53d tempest-VolumesTransfersTest-1613825803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aacc9a5f-5041-4019-bd96-c70591bda095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:22 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-edc3fb4e-a1ef-4ccd-8330-fd357992a53d tempest-VolumesTransfersTest-1613825803 None] Volume 516a6e61-3cc1-40ba-b213-7418f1b2376a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-516a6e61-3cc1-40ba-b213-7418f1b2376a', 'volume_size': 1} Jul 07 17:26:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-edc3fb4e-a1ef-4ccd-8330-fd357992a53d tempest-VolumesTransfersTest-1613825803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:23 devstack sudo[95983]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e1f54d5b-c800-4475-aa3f-38eddfae0ce3 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83941d99-9f7b-4d32-b422-9dbc59ce3616 1073741824" returned: 0 in 1.011s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e1f54d5b-c800-4475-aa3f-38eddfae0ce3 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83941d99-9f7b-4d32-b422-9dbc59ce3616 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:23 devstack sudo[96006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83941d99-9f7b-4d32-b422-9dbc59ce3616 Jul 07 17:26:23 devstack sudo[96006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:23 devstack sudo[96006]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e1f54d5b-c800-4475-aa3f-38eddfae0ce3 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83941d99-9f7b-4d32-b422-9dbc59ce3616" returned: 0 in 0.693s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:23 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-e1f54d5b-c800-4475-aa3f-38eddfae0ce3 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:26:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e1f54d5b-c800-4475-aa3f-38eddfae0ce3 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.764s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-01e2a7a4-25e4-4aec-8bce-45a357e583e7 tempest-VolumesExtendTest-1013664371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.236s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:23 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:SELECT=123,cinder:INSERT=43,cinder:UPDATE=147,cinder:DELETE=9 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:26:23 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e1f54d5b-c800-4475-aa3f-38eddfae0ce3 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f9079e9-53bc-440d-9b1e-f43852d2879c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83941d99-9f7b-4d32-b422-9dbc59ce3616', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:24 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e1f54d5b-c800-4475-aa3f-38eddfae0ce3 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f7a6c36-8bb3-430e-8e94-1cb39e725b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:24 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:UPDATE=127,cinder:SELECT=118,cinder:INSERT=45,cinder:DELETE=7 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:26:24 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[27236138-19bc-45f3-bf15-7bb968b3c006]: (4, 'raw') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:26:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-01e2a7a4-25e4-4aec-8bce-45a357e583e7 tempest-VolumesExtendTest-1013664371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-87f9ef4b-cb63-47c6-9263-c771d7515b88 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:24 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-e1f54d5b-c800-4475-aa3f-38eddfae0ce3 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Volume volume-83941d99-9f7b-4d32-b422-9dbc59ce3616 (83941d99-9f7b-4d32-b422-9dbc59ce3616): created successfully Jul 07 17:26:24 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e1f54d5b-c800-4475-aa3f-38eddfae0ce3 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f7a6c36-8bb3-430e-8e94-1cb39e725b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:24 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e1f54d5b-c800-4475-aa3f-38eddfae0ce3 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Flow 'volume_create_manager' (4f29cb4e-60c7-4b6f-bd12-c6edc84c1a0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:26:24 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-e1f54d5b-c800-4475-aa3f-38eddfae0ce3 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Created volume successfully. Jul 07 17:26:24 devstack sudo[96039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-87f9ef4b-cb63-47c6-9263-c771d7515b88 Jul 07 17:26:24 devstack sudo[96039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d273bfb2-572e-4bf5-be76-f66312334009 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d273bfb2-572e-4bf5-be76-f66312334009 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:24 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d273bfb2-572e-4bf5-be76-f66312334009 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:26:24 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d273bfb2-572e-4bf5-be76-f66312334009 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:26:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d273bfb2-572e-4bf5-be76-f66312334009 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d273bfb2-572e-4bf5-be76-f66312334009 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:24 devstack sudo[96041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:26:24 devstack sudo[96041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:24 devstack sudo[96039]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-01e2a7a4-25e4-4aec-8bce-45a357e583e7 tempest-VolumesExtendTest-1013664371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-87f9ef4b-cb63-47c6-9263-c771d7515b88" returned: 0 in 0.821s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-01e2a7a4-25e4-4aec-8bce-45a357e583e7 tempest-VolumesExtendTest-1013664371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-87f9ef4b-cb63-47c6-9263-c771d7515b88 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:24 devstack sudo[96054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-87f9ef4b-cb63-47c6-9263-c771d7515b88 Jul 07 17:26:24 devstack sudo[96054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:25 devstack sudo[96041]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d273bfb2-572e-4bf5-be76-f66312334009 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.667s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:25 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-d273bfb2-572e-4bf5-be76-f66312334009 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:26:25 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-d273bfb2-572e-4bf5-be76-f66312334009 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Retype volume completed successfully. Jul 07 17:26:25 devstack sudo[96054]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-01e2a7a4-25e4-4aec-8bce-45a357e583e7 tempest-VolumesExtendTest-1013664371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-87f9ef4b-cb63-47c6-9263-c771d7515b88" returned: 1 in 0.796s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-01e2a7a4-25e4-4aec-8bce-45a357e583e7 tempest-VolumesExtendTest-1013664371 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-87f9ef4b-cb63-47c6-9263-c771d7515b88' failed. Not Retrying. {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:26:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-01e2a7a4-25e4-4aec-8bce-45a357e583e7 tempest-VolumesExtendTest-1013664371 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-87f9ef4b-cb63-47c6-9263-c771d7515b88 2G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-01e2a7a4-25e4-4aec-8bce-45a357e583e7 tempest-VolumesExtendTest-1013664371 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-87f9ef4b-cb63-47c6-9263-c771d7515b88 2G" returned: 0 in 0.077s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-01e2a7a4-25e4-4aec-8bce-45a357e583e7 tempest-VolumesExtendTest-1013664371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.738s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-edc3fb4e-a1ef-4ccd-8330-fd357992a53d tempest-VolumesTransfersTest-1613825803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.765s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:25 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-edc3fb4e-a1ef-4ccd-8330-fd357992a53d tempest-VolumesTransfersTest-1613825803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-484978235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=516a6e61-3cc1-40ba-b213-7418f1b2376a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aa27dd6bda24c338f7e2d4c3bfd7917',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:26:23Z,use_quota=True,user_id='e5cab0b5c9b74911a8e9ab5bd27aa468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:26:25 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-edc3fb4e-a1ef-4ccd-8330-fd357992a53d tempest-VolumesTransfersTest-1613825803 None] Creating volume 516a6e61-3cc1-40ba-b213-7418f1b2376a {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:26:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-edc3fb4e-a1ef-4ccd-8330-fd357992a53d tempest-VolumesTransfersTest-1613825803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-edc3fb4e-a1ef-4ccd-8330-fd357992a53d tempest-VolumesTransfersTest-1613825803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:25 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-edc3fb4e-a1ef-4ccd-8330-fd357992a53d tempest-VolumesTransfersTest-1613825803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:26:25 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-edc3fb4e-a1ef-4ccd-8330-fd357992a53d tempest-VolumesTransfersTest-1613825803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:26:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-edc3fb4e-a1ef-4ccd-8330-fd357992a53d tempest-VolumesTransfersTest-1613825803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:25 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-edc3fb4e-a1ef-4ccd-8330-fd357992a53d tempest-VolumesTransfersTest-1613825803 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:26:25 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-edc3fb4e-a1ef-4ccd-8330-fd357992a53d tempest-VolumesTransfersTest-1613825803 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:26:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-edc3fb4e-a1ef-4ccd-8330-fd357992a53d tempest-VolumesTransfersTest-1613825803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-516a6e61-3cc1-40ba-b213-7418f1b2376a 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:25 devstack sudo[96073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-516a6e61-3cc1-40ba-b213-7418f1b2376a 1073741824 Jul 07 17:26:25 devstack sudo[96073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:25 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-01e2a7a4-25e4-4aec-8bce-45a357e583e7 tempest-VolumesExtendTest-1013664371 None] Extend volume completed successfully. Jul 07 17:26:25 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5c16a476-a07e-4d01-8c74-e564aabf33e8 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Acquiring lock "cinder-83941d99-9f7b-4d32-b422-9dbc59ce3616-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:26:25 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5c16a476-a07e-4d01-8c74-e564aabf33e8 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Lock "cinder-83941d99-9f7b-4d32-b422-9dbc59ce3616-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:26:25 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5c16a476-a07e-4d01-8c74-e564aabf33e8 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Acquiring lock "cinder-quobyte-83941d99-9f7b-4d32-b422-9dbc59ce3616" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:26:25 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5c16a476-a07e-4d01-8c74-e564aabf33e8 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Lock "cinder-quobyte-83941d99-9f7b-4d32-b422-9dbc59ce3616" acquired by "delete_volume" :: waited 0.027s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:26:25 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[607aed60-c95b-4e4d-bf5a-aa33e382a106]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:26:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5c16a476-a07e-4d01-8c74-e564aabf33e8 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83941d99-9f7b-4d32-b422-9dbc59ce3616 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:26 devstack sudo[96077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83941d99-9f7b-4d32-b422-9dbc59ce3616 Jul 07 17:26:26 devstack sudo[96077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:26 devstack sudo[96073]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-edc3fb4e-a1ef-4ccd-8330-fd357992a53d tempest-VolumesTransfersTest-1613825803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-516a6e61-3cc1-40ba-b213-7418f1b2376a 1073741824" returned: 0 in 0.981s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-edc3fb4e-a1ef-4ccd-8330-fd357992a53d tempest-VolumesTransfersTest-1613825803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-516a6e61-3cc1-40ba-b213-7418f1b2376a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:26 devstack sudo[96087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-516a6e61-3cc1-40ba-b213-7418f1b2376a Jul 07 17:26:26 devstack sudo[96087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:26 devstack sudo[96077]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5c16a476-a07e-4d01-8c74-e564aabf33e8 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83941d99-9f7b-4d32-b422-9dbc59ce3616" returned: 0 in 0.945s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5c16a476-a07e-4d01-8c74-e564aabf33e8 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83941d99-9f7b-4d32-b422-9dbc59ce3616 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:27 devstack sudo[96089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83941d99-9f7b-4d32-b422-9dbc59ce3616 Jul 07 17:26:27 devstack sudo[96089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:27 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ef006455-26a4-4496-a8a0-d6d6a306ac7e tempest-VolumesExtendTest-1013664371 None] Acquiring lock "cinder-87f9ef4b-cb63-47c6-9263-c771d7515b88-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:26:27 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ef006455-26a4-4496-a8a0-d6d6a306ac7e tempest-VolumesExtendTest-1013664371 None] Lock "cinder-87f9ef4b-cb63-47c6-9263-c771d7515b88-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:26:27 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ef006455-26a4-4496-a8a0-d6d6a306ac7e tempest-VolumesExtendTest-1013664371 None] Acquiring lock "cinder-quobyte-87f9ef4b-cb63-47c6-9263-c771d7515b88" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:26:27 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ef006455-26a4-4496-a8a0-d6d6a306ac7e tempest-VolumesExtendTest-1013664371 None] Lock "cinder-quobyte-87f9ef4b-cb63-47c6-9263-c771d7515b88" acquired by "delete_volume" :: waited 0.045s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:26:27 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2935bd03-0c19-4991-997b-b51297691493]: (4, 'raw') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:26:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ef006455-26a4-4496-a8a0-d6d6a306ac7e tempest-VolumesExtendTest-1013664371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-87f9ef4b-cb63-47c6-9263-c771d7515b88 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:27 devstack sudo[96092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-87f9ef4b-cb63-47c6-9263-c771d7515b88 Jul 07 17:26:27 devstack sudo[96092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:27 devstack sudo[96087]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-edc3fb4e-a1ef-4ccd-8330-fd357992a53d tempest-VolumesTransfersTest-1613825803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-516a6e61-3cc1-40ba-b213-7418f1b2376a" returned: 0 in 1.092s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:27 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-edc3fb4e-a1ef-4ccd-8330-fd357992a53d tempest-VolumesTransfersTest-1613825803 None] <== create_volume: return (2121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:26:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-edc3fb4e-a1ef-4ccd-8330-fd357992a53d tempest-VolumesTransfersTest-1613825803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.126s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:27 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-edc3fb4e-a1ef-4ccd-8330-fd357992a53d tempest-VolumesTransfersTest-1613825803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aacc9a5f-5041-4019-bd96-c70591bda095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-516a6e61-3cc1-40ba-b213-7418f1b2376a', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:27 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-edc3fb4e-a1ef-4ccd-8330-fd357992a53d tempest-VolumesTransfersTest-1613825803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f79e527-5414-4f44-94e8-808f5cb66e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:27 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-edc3fb4e-a1ef-4ccd-8330-fd357992a53d tempest-VolumesTransfersTest-1613825803 None] Volume volume-516a6e61-3cc1-40ba-b213-7418f1b2376a (516a6e61-3cc1-40ba-b213-7418f1b2376a): created successfully Jul 07 17:26:27 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-edc3fb4e-a1ef-4ccd-8330-fd357992a53d tempest-VolumesTransfersTest-1613825803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f79e527-5414-4f44-94e8-808f5cb66e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:27 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-edc3fb4e-a1ef-4ccd-8330-fd357992a53d tempest-VolumesTransfersTest-1613825803 None] Flow 'volume_create_manager' (43894b4a-56df-4733-8ca3-4d486e71cab7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:26:27 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-edc3fb4e-a1ef-4ccd-8330-fd357992a53d tempest-VolumesTransfersTest-1613825803 None] Created volume successfully. Jul 07 17:26:28 devstack sudo[96089]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5c16a476-a07e-4d01-8c74-e564aabf33e8 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-83941d99-9f7b-4d32-b422-9dbc59ce3616" returned: 0 in 1.222s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:28 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5c16a476-a07e-4d01-8c74-e564aabf33e8 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Lock "cinder-quobyte-83941d99-9f7b-4d32-b422-9dbc59ce3616" released by "delete_volume" :: held 2.238s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:28 devstack cinder-volume[87233]: WARNING cinder.quota [None req-5c16a476-a07e-4d01-8c74-e564aabf33e8 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:26:28 devstack cinder-volume[87233]: WARNING cinder.quota [None req-5c16a476-a07e-4d01-8c74-e564aabf33e8 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:26:28 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-5c16a476-a07e-4d01-8c74-e564aabf33e8 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Created reservations ['5812f954-33f4-497d-9cde-2aa8820e8ce5', '737e0cb0-b556-4a7a-b0d2-f66338ae8278', '8a59a129-4444-4651-a5da-ad7994264503', 'dc2b8828-4e5d-4714-8a1f-842403a3a6f5'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:26:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-5c16a476-a07e-4d01-8c74-e564aabf33e8 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-5c16a476-a07e-4d01-8c74-e564aabf33e8 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:28 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-5c16a476-a07e-4d01-8c74-e564aabf33e8 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:26:28 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-5c16a476-a07e-4d01-8c74-e564aabf33e8 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:26:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-5c16a476-a07e-4d01-8c74-e564aabf33e8 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5c16a476-a07e-4d01-8c74-e564aabf33e8 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:28 devstack sudo[96095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:26:28 devstack sudo[96095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:28 devstack sudo[96092]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ef006455-26a4-4496-a8a0-d6d6a306ac7e tempest-VolumesExtendTest-1013664371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-87f9ef4b-cb63-47c6-9263-c771d7515b88" returned: 0 in 1.080s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ef006455-26a4-4496-a8a0-d6d6a306ac7e tempest-VolumesExtendTest-1013664371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-87f9ef4b-cb63-47c6-9263-c771d7515b88 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:28 devstack sudo[96099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-87f9ef4b-cb63-47c6-9263-c771d7515b88 Jul 07 17:26:28 devstack sudo[96099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:29 devstack sudo[96095]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5c16a476-a07e-4d01-8c74-e564aabf33e8 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.996s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:29 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-5c16a476-a07e-4d01-8c74-e564aabf33e8 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:26:29 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-5c16a476-a07e-4d01-8c74-e564aabf33e8 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Deleted volume successfully. Jul 07 17:26:29 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5c16a476-a07e-4d01-8c74-e564aabf33e8 tempest-VolumeRetypeWithoutMigrationTest-1723210759 None] Lock "cinder-83941d99-9f7b-4d32-b422-9dbc59ce3616-delete_volume" released by "delete_volume" :: held 3.562s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:29 devstack sudo[96099]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ef006455-26a4-4496-a8a0-d6d6a306ac7e tempest-VolumesExtendTest-1013664371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-87f9ef4b-cb63-47c6-9263-c771d7515b88" returned: 1 in 1.268s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ef006455-26a4-4496-a8a0-d6d6a306ac7e tempest-VolumesExtendTest-1013664371 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-87f9ef4b-cb63-47c6-9263-c771d7515b88' failed. Not Retrying. {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:26:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ef006455-26a4-4496-a8a0-d6d6a306ac7e tempest-VolumesExtendTest-1013664371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-87f9ef4b-cb63-47c6-9263-c771d7515b88 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:29 devstack sudo[96108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-87f9ef4b-cb63-47c6-9263-c771d7515b88 Jul 07 17:26:29 devstack sudo[96108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:30 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-0c077258-e7b2-4e14-a690-8128df613baf tempest-VolumesTransfersTest-539202567 None] Transfer volume completed successfully. Jul 07 17:26:30 devstack sudo[96108]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ef006455-26a4-4496-a8a0-d6d6a306ac7e tempest-VolumesExtendTest-1013664371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-87f9ef4b-cb63-47c6-9263-c771d7515b88" returned: 0 in 1.049s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:31 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ef006455-26a4-4496-a8a0-d6d6a306ac7e tempest-VolumesExtendTest-1013664371 None] Lock "cinder-quobyte-87f9ef4b-cb63-47c6-9263-c771d7515b88" released by "delete_volume" :: held 3.536s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:31 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-ef006455-26a4-4496-a8a0-d6d6a306ac7e tempest-VolumesExtendTest-1013664371 None] Created reservations ['c64b6b0c-6cc8-4125-8a8e-ba01bb223e62', '27bcff97-5997-4d0b-a1eb-b1778e801b21', 'f98c0bd9-6997-4e37-a0ae-087c6600fc20', '6efc9bed-0217-4436-9ded-11bb7502b710'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:26:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ef006455-26a4-4496-a8a0-d6d6a306ac7e tempest-VolumesExtendTest-1013664371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ef006455-26a4-4496-a8a0-d6d6a306ac7e tempest-VolumesExtendTest-1013664371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:31 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ef006455-26a4-4496-a8a0-d6d6a306ac7e tempest-VolumesExtendTest-1013664371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:26:31 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ef006455-26a4-4496-a8a0-d6d6a306ac7e tempest-VolumesExtendTest-1013664371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:26:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ef006455-26a4-4496-a8a0-d6d6a306ac7e tempest-VolumesExtendTest-1013664371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ef006455-26a4-4496-a8a0-d6d6a306ac7e tempest-VolumesExtendTest-1013664371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:31 devstack sudo[96111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:26:31 devstack sudo[96111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:31 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-88a3f430-f139-4140-b282-08853c96332c tempest-VolumesTransfersTest-282868220 None] Acquiring lock "cinder-516a6e61-3cc1-40ba-b213-7418f1b2376a-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:26:31 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-88a3f430-f139-4140-b282-08853c96332c tempest-VolumesTransfersTest-282868220 None] Lock "cinder-516a6e61-3cc1-40ba-b213-7418f1b2376a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:26:31 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-88a3f430-f139-4140-b282-08853c96332c tempest-VolumesTransfersTest-282868220 None] Acquiring lock "cinder-quobyte-516a6e61-3cc1-40ba-b213-7418f1b2376a" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:26:31 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-88a3f430-f139-4140-b282-08853c96332c tempest-VolumesTransfersTest-282868220 None] Lock "cinder-quobyte-516a6e61-3cc1-40ba-b213-7418f1b2376a" acquired by "delete_volume" :: waited 0.051s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:26:31 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3aa1346-b0fe-4126-9756-128070b888ea]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:26:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-88a3f430-f139-4140-b282-08853c96332c tempest-VolumesTransfersTest-282868220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-516a6e61-3cc1-40ba-b213-7418f1b2376a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:32 devstack sudo[96114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-516a6e61-3cc1-40ba-b213-7418f1b2376a Jul 07 17:26:32 devstack sudo[96114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:32 devstack sudo[96111]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ef006455-26a4-4496-a8a0-d6d6a306ac7e tempest-VolumesExtendTest-1013664371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 1.026s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:32 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-ef006455-26a4-4496-a8a0-d6d6a306ac7e tempest-VolumesExtendTest-1013664371 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:26:32 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-ef006455-26a4-4496-a8a0-d6d6a306ac7e tempest-VolumesExtendTest-1013664371 None] Deleted volume successfully. Jul 07 17:26:32 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ef006455-26a4-4496-a8a0-d6d6a306ac7e tempest-VolumesExtendTest-1013664371 None] Lock "cinder-87f9ef4b-cb63-47c6-9263-c771d7515b88-delete_volume" released by "delete_volume" :: held 4.930s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:32 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-2666c105-5eb8-4998-971b-601e6162c1d5 tempest-VolumesExtendTest-1013664371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:26:32 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-2666c105-5eb8-4998-971b-601e6162c1d5 tempest-VolumesExtendTest-1013664371 None] Flow 'volume_create_manager' (5e469f89-24b2-450b-ae57-2c5a0e6f7d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:26:32 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-2666c105-5eb8-4998-971b-601e6162c1d5 tempest-VolumesExtendTest-1013664371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acdf8c40-e65e-41c2-95b1-4469e6b269ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:32 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-2666c105-5eb8-4998-971b-601e6162c1d5 tempest-VolumesExtendTest-1013664371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acdf8c40-e65e-41c2-95b1-4469e6b269ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2105753515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd12fd00-26c4-4e3b-b91a-28f9423ef5de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a6f9dc391484919b93fab15df535766',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:26:33Z,use_quota=True,user_id='6e9bc6ed5c374d248698301fd5c7833d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:32 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-2666c105-5eb8-4998-971b-601e6162c1d5 tempest-VolumesExtendTest-1013664371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (385b0f8c-8831-4d39-957c-77b107da8fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:32 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-2666c105-5eb8-4998-971b-601e6162c1d5 tempest-VolumesExtendTest-1013664371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (385b0f8c-8831-4d39-957c-77b107da8fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:32 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-2666c105-5eb8-4998-971b-601e6162c1d5 tempest-VolumesExtendTest-1013664371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4c785f3-31aa-4fa1-89c0-a6f7fc5a6c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:32 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-2666c105-5eb8-4998-971b-601e6162c1d5 tempest-VolumesExtendTest-1013664371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4c785f3-31aa-4fa1-89c0-a6f7fc5a6c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd12fd00-26c4-4e3b-b91a-28f9423ef5de', 'volume_name': 'volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:32 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-2666c105-5eb8-4998-971b-601e6162c1d5 tempest-VolumesExtendTest-1013664371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45045751-0f64-4f88-8043-18326d647327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:32 devstack sudo[96114]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:32 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-2666c105-5eb8-4998-971b-601e6162c1d5 tempest-VolumesExtendTest-1013664371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45045751-0f64-4f88-8043-18326d647327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:32 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-2666c105-5eb8-4998-971b-601e6162c1d5 tempest-VolumesExtendTest-1013664371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57e27ba9-ecc6-442b-ac67-e41bac724735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:32 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-2666c105-5eb8-4998-971b-601e6162c1d5 tempest-VolumesExtendTest-1013664371 None] Volume cd12fd00-26c4-4e3b-b91a-28f9423ef5de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de', 'volume_size': 1} Jul 07 17:26:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-2666c105-5eb8-4998-971b-601e6162c1d5 tempest-VolumesExtendTest-1013664371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-2666c105-5eb8-4998-971b-601e6162c1d5 tempest-VolumesExtendTest-1013664371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:32 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-2666c105-5eb8-4998-971b-601e6162c1d5 tempest-VolumesExtendTest-1013664371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2105753515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd12fd00-26c4-4e3b-b91a-28f9423ef5de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a6f9dc391484919b93fab15df535766',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:26:33Z,use_quota=True,user_id='6e9bc6ed5c374d248698301fd5c7833d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:26:32 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-2666c105-5eb8-4998-971b-601e6162c1d5 tempest-VolumesExtendTest-1013664371 None] Creating volume cd12fd00-26c4-4e3b-b91a-28f9423ef5de {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:26:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-2666c105-5eb8-4998-971b-601e6162c1d5 tempest-VolumesExtendTest-1013664371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-2666c105-5eb8-4998-971b-601e6162c1d5 tempest-VolumesExtendTest-1013664371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:32 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-2666c105-5eb8-4998-971b-601e6162c1d5 tempest-VolumesExtendTest-1013664371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:26:32 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-2666c105-5eb8-4998-971b-601e6162c1d5 tempest-VolumesExtendTest-1013664371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:26:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-2666c105-5eb8-4998-971b-601e6162c1d5 tempest-VolumesExtendTest-1013664371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:32 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-2666c105-5eb8-4998-971b-601e6162c1d5 tempest-VolumesExtendTest-1013664371 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:26:32 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-2666c105-5eb8-4998-971b-601e6162c1d5 tempest-VolumesExtendTest-1013664371 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:26:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2666c105-5eb8-4998-971b-601e6162c1d5 tempest-VolumesExtendTest-1013664371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-88a3f430-f139-4140-b282-08853c96332c tempest-VolumesTransfersTest-282868220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-516a6e61-3cc1-40ba-b213-7418f1b2376a" returned: 0 in 1.054s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-88a3f430-f139-4140-b282-08853c96332c tempest-VolumesTransfersTest-282868220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-516a6e61-3cc1-40ba-b213-7418f1b2376a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:33 devstack sudo[96121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de 1073741824 Jul 07 17:26:33 devstack sudo[96121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:33 devstack sudo[96122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-516a6e61-3cc1-40ba-b213-7418f1b2376a Jul 07 17:26:33 devstack sudo[96122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:33 devstack sudo[96122]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-88a3f430-f139-4140-b282-08853c96332c tempest-VolumesTransfersTest-282868220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-516a6e61-3cc1-40ba-b213-7418f1b2376a" returned: 0 in 0.694s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:33 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-88a3f430-f139-4140-b282-08853c96332c tempest-VolumesTransfersTest-282868220 None] Lock "cinder-quobyte-516a6e61-3cc1-40ba-b213-7418f1b2376a" released by "delete_volume" :: held 1.832s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:33 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-88a3f430-f139-4140-b282-08853c96332c tempest-VolumesTransfersTest-282868220 None] Created reservations ['d95ca906-7d3c-4c09-a95d-14f0ff386452', 'a0ed085f-6c72-4780-91ed-1644de45f0d5', '3d7ae00c-25a3-402f-a2c1-e746ff2a2f2e', '9d153918-b3be-49d2-85aa-b8b81d13615e'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:26:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-88a3f430-f139-4140-b282-08853c96332c tempest-VolumesTransfersTest-282868220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-88a3f430-f139-4140-b282-08853c96332c tempest-VolumesTransfersTest-282868220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:33 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-88a3f430-f139-4140-b282-08853c96332c tempest-VolumesTransfersTest-282868220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:26:33 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-88a3f430-f139-4140-b282-08853c96332c tempest-VolumesTransfersTest-282868220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:26:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-88a3f430-f139-4140-b282-08853c96332c tempest-VolumesTransfersTest-282868220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-88a3f430-f139-4140-b282-08853c96332c tempest-VolumesTransfersTest-282868220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:33 devstack sudo[96129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:26:33 devstack sudo[96129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:34 devstack sudo[96121]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2666c105-5eb8-4998-971b-601e6162c1d5 tempest-VolumesExtendTest-1013664371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de 1073741824" returned: 0 in 1.223s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2666c105-5eb8-4998-971b-601e6162c1d5 tempest-VolumesExtendTest-1013664371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:34 devstack sudo[96132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de Jul 07 17:26:34 devstack sudo[96132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:34 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cb6f514-3065-4abd-b54f-dbfcdfd4fbe0 tempest-VolumesTransfersTest-1613825803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:26:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4cb6f514-3065-4abd-b54f-dbfcdfd4fbe0 tempest-VolumesTransfersTest-1613825803 None] Flow 'volume_create_manager' (7f368360-8cd4-427f-96a8-573cec20d689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:26:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4cb6f514-3065-4abd-b54f-dbfcdfd4fbe0 tempest-VolumesTransfersTest-1613825803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00cd5c84-65d1-45d5-abb1-677529d10e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:34 devstack sudo[96129]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-88a3f430-f139-4140-b282-08853c96332c tempest-VolumesTransfersTest-282868220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 1.016s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:34 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-88a3f430-f139-4140-b282-08853c96332c tempest-VolumesTransfersTest-282868220 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:26:34 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-88a3f430-f139-4140-b282-08853c96332c tempest-VolumesTransfersTest-282868220 None] Deleted volume successfully. Jul 07 17:26:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4cb6f514-3065-4abd-b54f-dbfcdfd4fbe0 tempest-VolumesTransfersTest-1613825803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00cd5c84-65d1-45d5-abb1-677529d10e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2000344647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70ed4ee9-42f2-4947-8bed-fca873ba66fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aa27dd6bda24c338f7e2d4c3bfd7917',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:26:35Z,use_quota=True,user_id='e5cab0b5c9b74911a8e9ab5bd27aa468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4cb6f514-3065-4abd-b54f-dbfcdfd4fbe0 tempest-VolumesTransfersTest-1613825803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2c13a01-312f-4170-8656-a9e16e5828ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4cb6f514-3065-4abd-b54f-dbfcdfd4fbe0 tempest-VolumesTransfersTest-1613825803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2c13a01-312f-4170-8656-a9e16e5828ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4cb6f514-3065-4abd-b54f-dbfcdfd4fbe0 tempest-VolumesTransfersTest-1613825803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96c37eb7-85de-4ccc-ad11-975f4676a5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4cb6f514-3065-4abd-b54f-dbfcdfd4fbe0 tempest-VolumesTransfersTest-1613825803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96c37eb7-85de-4ccc-ad11-975f4676a5fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70ed4ee9-42f2-4947-8bed-fca873ba66fc', 'volume_name': 'volume-70ed4ee9-42f2-4947-8bed-fca873ba66fc', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:35 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4cb6f514-3065-4abd-b54f-dbfcdfd4fbe0 tempest-VolumesTransfersTest-1613825803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e81db3fa-c658-4f3f-8d0c-b148385e943b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:35 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4cb6f514-3065-4abd-b54f-dbfcdfd4fbe0 tempest-VolumesTransfersTest-1613825803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e81db3fa-c658-4f3f-8d0c-b148385e943b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:35 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4cb6f514-3065-4abd-b54f-dbfcdfd4fbe0 tempest-VolumesTransfersTest-1613825803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ee50c9f-e29f-432e-9254-9f8ce2f59eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:35 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-4cb6f514-3065-4abd-b54f-dbfcdfd4fbe0 tempest-VolumesTransfersTest-1613825803 None] Volume 70ed4ee9-42f2-4947-8bed-fca873ba66fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70ed4ee9-42f2-4947-8bed-fca873ba66fc', 'volume_size': 1} Jul 07 17:26:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4cb6f514-3065-4abd-b54f-dbfcdfd4fbe0 tempest-VolumesTransfersTest-1613825803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:35 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-88a3f430-f139-4140-b282-08853c96332c tempest-VolumesTransfersTest-282868220 None] Lock "cinder-516a6e61-3cc1-40ba-b213-7418f1b2376a-delete_volume" released by "delete_volume" :: held 3.274s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:35 devstack sudo[96132]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2666c105-5eb8-4998-971b-601e6162c1d5 tempest-VolumesExtendTest-1013664371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de" returned: 0 in 1.034s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:35 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-2666c105-5eb8-4998-971b-601e6162c1d5 tempest-VolumesExtendTest-1013664371 None] <== create_volume: return (2337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:26:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-2666c105-5eb8-4998-971b-601e6162c1d5 tempest-VolumesExtendTest-1013664371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.339s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4cb6f514-3065-4abd-b54f-dbfcdfd4fbe0 tempest-VolumesTransfersTest-1613825803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.322s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:35 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-4cb6f514-3065-4abd-b54f-dbfcdfd4fbe0 tempest-VolumesTransfersTest-1613825803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2000344647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70ed4ee9-42f2-4947-8bed-fca873ba66fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aa27dd6bda24c338f7e2d4c3bfd7917',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:26:35Z,use_quota=True,user_id='e5cab0b5c9b74911a8e9ab5bd27aa468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:26:35 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-4cb6f514-3065-4abd-b54f-dbfcdfd4fbe0 tempest-VolumesTransfersTest-1613825803 None] Creating volume 70ed4ee9-42f2-4947-8bed-fca873ba66fc {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:26:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4cb6f514-3065-4abd-b54f-dbfcdfd4fbe0 tempest-VolumesTransfersTest-1613825803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4cb6f514-3065-4abd-b54f-dbfcdfd4fbe0 tempest-VolumesTransfersTest-1613825803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:35 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-4cb6f514-3065-4abd-b54f-dbfcdfd4fbe0 tempest-VolumesTransfersTest-1613825803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:26:35 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-4cb6f514-3065-4abd-b54f-dbfcdfd4fbe0 tempest-VolumesTransfersTest-1613825803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:26:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4cb6f514-3065-4abd-b54f-dbfcdfd4fbe0 tempest-VolumesTransfersTest-1613825803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:35 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-4cb6f514-3065-4abd-b54f-dbfcdfd4fbe0 tempest-VolumesTransfersTest-1613825803 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:26:35 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-4cb6f514-3065-4abd-b54f-dbfcdfd4fbe0 tempest-VolumesTransfersTest-1613825803 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:26:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4cb6f514-3065-4abd-b54f-dbfcdfd4fbe0 tempest-VolumesTransfersTest-1613825803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-70ed4ee9-42f2-4947-8bed-fca873ba66fc 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:35 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-2666c105-5eb8-4998-971b-601e6162c1d5 tempest-VolumesExtendTest-1013664371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57e27ba9-ecc6-442b-ac67-e41bac724735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:35 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-2666c105-5eb8-4998-971b-601e6162c1d5 tempest-VolumesExtendTest-1013664371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bffdf3c-f359-4c95-808c-5c32ab5cd7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:35 devstack sudo[96136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-70ed4ee9-42f2-4947-8bed-fca873ba66fc 1073741824 Jul 07 17:26:35 devstack sudo[96136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:35 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-2666c105-5eb8-4998-971b-601e6162c1d5 tempest-VolumesExtendTest-1013664371 None] Volume volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de (cd12fd00-26c4-4e3b-b91a-28f9423ef5de): created successfully Jul 07 17:26:35 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-2666c105-5eb8-4998-971b-601e6162c1d5 tempest-VolumesExtendTest-1013664371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bffdf3c-f359-4c95-808c-5c32ab5cd7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:35 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-2666c105-5eb8-4998-971b-601e6162c1d5 tempest-VolumesExtendTest-1013664371 None] Flow 'volume_create_manager' (5e469f89-24b2-450b-ae57-2c5a0e6f7d35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:26:35 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-2666c105-5eb8-4998-971b-601e6162c1d5 tempest-VolumesExtendTest-1013664371 None] Created volume successfully. Jul 07 17:26:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-389ddd2d-eb82-4088-9fdc-37c8726cab3c tempest-VolumesExtendTest-1013664371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:36 devstack sudo[96136]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4cb6f514-3065-4abd-b54f-dbfcdfd4fbe0 tempest-VolumesTransfersTest-1613825803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-70ed4ee9-42f2-4947-8bed-fca873ba66fc 1073741824" returned: 0 in 1.027s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4cb6f514-3065-4abd-b54f-dbfcdfd4fbe0 tempest-VolumesTransfersTest-1613825803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-70ed4ee9-42f2-4947-8bed-fca873ba66fc {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:36 devstack sudo[96142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-70ed4ee9-42f2-4947-8bed-fca873ba66fc Jul 07 17:26:36 devstack sudo[96142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:36 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7ee9741-55bd-47ed-a80f-65d2858de6e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:26:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b7ee9741-55bd-47ed-a80f-65d2858de6e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Flow 'volume_create_manager' (5364f3d4-220e-4679-bc57-540966486007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:26:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b7ee9741-55bd-47ed-a80f-65d2858de6e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3270707-6bd1-4b6e-870a-5f5e38cb498c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b7ee9741-55bd-47ed-a80f-65d2858de6e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3270707-6bd1-4b6e-870a-5f5e38cb498c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-423473848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad1049ec639140fba7188dfe5f97be03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:26:37Z,use_quota=True,user_id='0b787aeca6ab457b902b0bf0316f231d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b7ee9741-55bd-47ed-a80f-65d2858de6e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bcfbc4c-6b28-45a9-b49a-952dbfd68678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b7ee9741-55bd-47ed-a80f-65d2858de6e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bcfbc4c-6b28-45a9-b49a-952dbfd68678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b7ee9741-55bd-47ed-a80f-65d2858de6e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd25ff0b-6ee4-4de2-98a2-d240ebf6e9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b7ee9741-55bd-47ed-a80f-65d2858de6e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd25ff0b-6ee4-4de2-98a2-d240ebf6e9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c', 'volume_name': 'volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b7ee9741-55bd-47ed-a80f-65d2858de6e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47f9dbac-5903-487d-84e8-5aaf5072b047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b7ee9741-55bd-47ed-a80f-65d2858de6e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47f9dbac-5903-487d-84e8-5aaf5072b047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b7ee9741-55bd-47ed-a80f-65d2858de6e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4594826c-0d48-40c1-9ad5-7932cf369379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:37 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-b7ee9741-55bd-47ed-a80f-65d2858de6e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Volume 0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c', 'volume_size': 1} Jul 07 17:26:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b7ee9741-55bd-47ed-a80f-65d2858de6e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:37 devstack sudo[96142]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4cb6f514-3065-4abd-b54f-dbfcdfd4fbe0 tempest-VolumesTransfersTest-1613825803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-70ed4ee9-42f2-4947-8bed-fca873ba66fc" returned: 0 in 0.722s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:37 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-4cb6f514-3065-4abd-b54f-dbfcdfd4fbe0 tempest-VolumesTransfersTest-1613825803 None] <== create_volume: return (1811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:26:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4cb6f514-3065-4abd-b54f-dbfcdfd4fbe0 tempest-VolumesTransfersTest-1613825803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.815s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-389ddd2d-eb82-4088-9fdc-37c8726cab3c tempest-VolumesExtendTest-1013664371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.873s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4cb6f514-3065-4abd-b54f-dbfcdfd4fbe0 tempest-VolumesTransfersTest-1613825803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ee50c9f-e29f-432e-9254-9f8ce2f59eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70ed4ee9-42f2-4947-8bed-fca873ba66fc', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4cb6f514-3065-4abd-b54f-dbfcdfd4fbe0 tempest-VolumesTransfersTest-1613825803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88aa47d4-7ccb-4236-af7c-2bdf6f03b712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:37 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-389ddd2d-eb82-4088-9fdc-37c8726cab3c tempest-VolumesExtendTest-1013664371 None] Creating offline snapshot e05e59ec-4ab3-4a32-ae56-63b4d8966a59 of volume cd12fd00-26c4-4e3b-b91a-28f9423ef5de {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:26:37 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-4cb6f514-3065-4abd-b54f-dbfcdfd4fbe0 tempest-VolumesTransfersTest-1613825803 None] Volume volume-70ed4ee9-42f2-4947-8bed-fca873ba66fc (70ed4ee9-42f2-4947-8bed-fca873ba66fc): created successfully Jul 07 17:26:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4cb6f514-3065-4abd-b54f-dbfcdfd4fbe0 tempest-VolumesTransfersTest-1613825803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88aa47d4-7ccb-4236-af7c-2bdf6f03b712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4cb6f514-3065-4abd-b54f-dbfcdfd4fbe0 tempest-VolumesTransfersTest-1613825803 None] Flow 'volume_create_manager' (7f368360-8cd4-427f-96a8-573cec20d689) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:26:37 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bae6fa3-01dc-4afc-a793-b269140c66b8]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:26:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-389ddd2d-eb82-4088-9fdc-37c8726cab3c tempest-VolumesExtendTest-1013664371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:37 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-4cb6f514-3065-4abd-b54f-dbfcdfd4fbe0 tempest-VolumesTransfersTest-1613825803 None] Created volume successfully. Jul 07 17:26:37 devstack sudo[96145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de Jul 07 17:26:37 devstack sudo[96145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:37 devstack sudo[96145]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-389ddd2d-eb82-4088-9fdc-37c8726cab3c tempest-VolumesExtendTest-1013664371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de" returned: 0 in 0.787s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-389ddd2d-eb82-4088-9fdc-37c8726cab3c tempest-VolumesExtendTest-1013664371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de.e05e59ec-4ab3-4a32-ae56-63b4d8966a59 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:38 devstack sudo[96150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de.e05e59ec-4ab3-4a32-ae56-63b4d8966a59 1G Jul 07 17:26:38 devstack sudo[96150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:38 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-1875db13-e02c-4c6f-8053-a20f43e619c5 tempest-VolumesTransfersTest-282868220 None] Acquiring lock "cinder-70ed4ee9-42f2-4947-8bed-fca873ba66fc-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:26:38 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-1875db13-e02c-4c6f-8053-a20f43e619c5 tempest-VolumesTransfersTest-282868220 None] Lock "cinder-70ed4ee9-42f2-4947-8bed-fca873ba66fc-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:26:38 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-1875db13-e02c-4c6f-8053-a20f43e619c5 tempest-VolumesTransfersTest-282868220 None] Acquiring lock "cinder-quobyte-70ed4ee9-42f2-4947-8bed-fca873ba66fc" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:26:38 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-1875db13-e02c-4c6f-8053-a20f43e619c5 tempest-VolumesTransfersTest-282868220 None] Lock "cinder-quobyte-70ed4ee9-42f2-4947-8bed-fca873ba66fc" acquired by "delete_volume" :: waited 0.019s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:26:38 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a51b51-ed29-4c23-b512-f93b0fcf86c0]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:26:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1875db13-e02c-4c6f-8053-a20f43e619c5 tempest-VolumesTransfersTest-282868220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-70ed4ee9-42f2-4947-8bed-fca873ba66fc {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:38 devstack sudo[96174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-70ed4ee9-42f2-4947-8bed-fca873ba66fc Jul 07 17:26:38 devstack sudo[96174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:38 devstack sudo[96150]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-389ddd2d-eb82-4088-9fdc-37c8726cab3c tempest-VolumesExtendTest-1013664371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de.e05e59ec-4ab3-4a32-ae56-63b4d8966a59 1G" returned: 0 in 0.902s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-389ddd2d-eb82-4088-9fdc-37c8726cab3c tempest-VolumesExtendTest-1013664371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de.e05e59ec-4ab3-4a32-ae56-63b4d8966a59 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:38 devstack sudo[96180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de.e05e59ec-4ab3-4a32-ae56-63b4d8966a59 Jul 07 17:26:38 devstack sudo[96180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:39 devstack sudo[96174]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1875db13-e02c-4c6f-8053-a20f43e619c5 tempest-VolumesTransfersTest-282868220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-70ed4ee9-42f2-4947-8bed-fca873ba66fc" returned: 0 in 0.755s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1875db13-e02c-4c6f-8053-a20f43e619c5 tempest-VolumesTransfersTest-282868220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-70ed4ee9-42f2-4947-8bed-fca873ba66fc {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:39 devstack sudo[96185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-70ed4ee9-42f2-4947-8bed-fca873ba66fc Jul 07 17:26:39 devstack sudo[96185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:39 devstack sudo[96180]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-389ddd2d-eb82-4088-9fdc-37c8726cab3c tempest-VolumesExtendTest-1013664371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de.e05e59ec-4ab3-4a32-ae56-63b4d8966a59" returned: 0 in 0.667s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:39 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-389ddd2d-eb82-4088-9fdc-37c8726cab3c tempest-VolumesExtendTest-1013664371 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de.e05e59ec-4ab3-4a32-ae56-63b4d8966a59 is being set with open permissions: ugo+rw Jul 07 17:26:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-389ddd2d-eb82-4088-9fdc-37c8726cab3c tempest-VolumesExtendTest-1013664371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de.e05e59ec-4ab3-4a32-ae56-63b4d8966a59 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:39 devstack sudo[96190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de.e05e59ec-4ab3-4a32-ae56-63b4d8966a59 Jul 07 17:26:39 devstack sudo[96190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:39 devstack sudo[96185]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1875db13-e02c-4c6f-8053-a20f43e619c5 tempest-VolumesTransfersTest-282868220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-70ed4ee9-42f2-4947-8bed-fca873ba66fc" returned: 0 in 0.670s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:39 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-1875db13-e02c-4c6f-8053-a20f43e619c5 tempest-VolumesTransfersTest-282868220 None] Lock "cinder-quobyte-70ed4ee9-42f2-4947-8bed-fca873ba66fc" released by "delete_volume" :: held 1.478s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:39 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-1875db13-e02c-4c6f-8053-a20f43e619c5 tempest-VolumesTransfersTest-282868220 None] Created reservations ['25bed1bd-acf6-4029-85ac-d15531a56dc4', 'eced8767-9dea-489e-ba31-3fbe90186d75', 'f7bd2e74-a665-411a-99c5-bbb47c491f52', 'd473a8df-c4b3-4c1b-ba54-ee4e92feb4d9'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:26:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1875db13-e02c-4c6f-8053-a20f43e619c5 tempest-VolumesTransfersTest-282868220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1875db13-e02c-4c6f-8053-a20f43e619c5 tempest-VolumesTransfersTest-282868220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:40 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-1875db13-e02c-4c6f-8053-a20f43e619c5 tempest-VolumesTransfersTest-282868220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:26:40 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-1875db13-e02c-4c6f-8053-a20f43e619c5 tempest-VolumesTransfersTest-282868220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:26:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1875db13-e02c-4c6f-8053-a20f43e619c5 tempest-VolumesTransfersTest-282868220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1875db13-e02c-4c6f-8053-a20f43e619c5 tempest-VolumesTransfersTest-282868220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:40 devstack sudo[96194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:26:40 devstack sudo[96194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:40 devstack sudo[96190]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-389ddd2d-eb82-4088-9fdc-37c8726cab3c tempest-VolumesExtendTest-1013664371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de.e05e59ec-4ab3-4a32-ae56-63b4d8966a59" returned: 0 in 0.687s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-389ddd2d-eb82-4088-9fdc-37c8726cab3c tempest-VolumesExtendTest-1013664371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:40 devstack sudo[96197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de.info Jul 07 17:26:40 devstack sudo[96197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:40 devstack sudo[96194]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1875db13-e02c-4c6f-8053-a20f43e619c5 tempest-VolumesTransfersTest-282868220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.663s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:40 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-1875db13-e02c-4c6f-8053-a20f43e619c5 tempest-VolumesTransfersTest-282868220 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:26:40 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-1875db13-e02c-4c6f-8053-a20f43e619c5 tempest-VolumesTransfersTest-282868220 None] Deleted volume successfully. Jul 07 17:26:40 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-1875db13-e02c-4c6f-8053-a20f43e619c5 tempest-VolumesTransfersTest-282868220 None] Lock "cinder-70ed4ee9-42f2-4947-8bed-fca873ba66fc-delete_volume" released by "delete_volume" :: held 2.396s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:40 devstack sudo[96197]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-389ddd2d-eb82-4088-9fdc-37c8726cab3c tempest-VolumesExtendTest-1013664371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de.info" returned: 0 in 0.678s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:40 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-389ddd2d-eb82-4088-9fdc-37c8726cab3c tempest-VolumesExtendTest-1013664371 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de.info is being set with open permissions: ugo+rw Jul 07 17:26:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-389ddd2d-eb82-4088-9fdc-37c8726cab3c tempest-VolumesExtendTest-1013664371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:40 devstack sudo[96201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de.info Jul 07 17:26:40 devstack sudo[96201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:41 devstack sudo[96201]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-389ddd2d-eb82-4088-9fdc-37c8726cab3c tempest-VolumesExtendTest-1013664371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de.info" returned: 0 in 0.623s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-389ddd2d-eb82-4088-9fdc-37c8726cab3c tempest-VolumesExtendTest-1013664371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.448s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b7ee9741-55bd-47ed-a80f-65d2858de6e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.554s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:41 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b7ee9741-55bd-47ed-a80f-65d2858de6e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-423473848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad1049ec639140fba7188dfe5f97be03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:26:37Z,use_quota=True,user_id='0b787aeca6ab457b902b0bf0316f231d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:26:41 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-b7ee9741-55bd-47ed-a80f-65d2858de6e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Creating volume 0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:26:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b7ee9741-55bd-47ed-a80f-65d2858de6e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b7ee9741-55bd-47ed-a80f-65d2858de6e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:41 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b7ee9741-55bd-47ed-a80f-65d2858de6e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:26:41 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b7ee9741-55bd-47ed-a80f-65d2858de6e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:26:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b7ee9741-55bd-47ed-a80f-65d2858de6e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:41 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b7ee9741-55bd-47ed-a80f-65d2858de6e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:26:41 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-b7ee9741-55bd-47ed-a80f-65d2858de6e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:26:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b7ee9741-55bd-47ed-a80f-65d2858de6e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:41 devstack sudo[96204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c 1073741824 Jul 07 17:26:41 devstack sudo[96204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:41 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-389ddd2d-eb82-4088-9fdc-37c8726cab3c tempest-VolumesExtendTest-1013664371 None] Create snapshot completed successfully Jul 07 17:26:42 devstack sudo[96204]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b7ee9741-55bd-47ed-a80f-65d2858de6e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c 1073741824" returned: 0 in 0.904s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b7ee9741-55bd-47ed-a80f-65d2858de6e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:42 devstack sudo[96209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c Jul 07 17:26:42 devstack sudo[96209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-7eef3574-391d-478d-beee-e37a310467a0 tempest-VolumesExtendTest-1013664371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:43 devstack sudo[96209]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b7ee9741-55bd-47ed-a80f-65d2858de6e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c" returned: 0 in 0.690s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b7ee9741-55bd-47ed-a80f-65d2858de6e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:26:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b7ee9741-55bd-47ed-a80f-65d2858de6e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.653s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-7eef3574-391d-478d-beee-e37a310467a0 tempest-VolumesExtendTest-1013664371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.587s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:43 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b7ee9741-55bd-47ed-a80f-65d2858de6e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4594826c-0d48-40c1-9ad5-7932cf369379) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:43 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b7ee9741-55bd-47ed-a80f-65d2858de6e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (423e76e6-ffbf-4d62-833e-c55dcdcfce40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:43 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba5f495-f463-4c3d-a3f3-253d37e5dc9c]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:26:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7eef3574-391d-478d-beee-e37a310467a0 tempest-VolumesExtendTest-1013664371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:43 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-b7ee9741-55bd-47ed-a80f-65d2858de6e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Volume volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c (0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c): created successfully Jul 07 17:26:43 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b7ee9741-55bd-47ed-a80f-65d2858de6e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (423e76e6-ffbf-4d62-833e-c55dcdcfce40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:43 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b7ee9741-55bd-47ed-a80f-65d2858de6e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Flow 'volume_create_manager' (5364f3d4-220e-4679-bc57-540966486007) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:26:43 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-b7ee9741-55bd-47ed-a80f-65d2858de6e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Created volume successfully. Jul 07 17:26:43 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:26:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:26:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:26:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:43 devstack sudo[96213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:26:43 devstack sudo[96213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:43 devstack sudo[96212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de Jul 07 17:26:43 devstack sudo[96212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:44 devstack sudo[96212]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7eef3574-391d-478d-beee-e37a310467a0 tempest-VolumesExtendTest-1013664371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de" returned: 0 in 0.773s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7eef3574-391d-478d-beee-e37a310467a0 tempest-VolumesExtendTest-1013664371 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de.e05e59ec-4ab3-4a32-ae56-63b4d8966a59 2G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:44 devstack sudo[96213]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.781s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:44 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:26:44 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:26:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread count: 28 {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:26:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread info: [<_MainThread(MainThread, started 126077716062336)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:26:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7eef3574-391d-478d-beee-e37a310467a0 tempest-VolumesExtendTest-1013664371 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de.e05e59ec-4ab3-4a32-ae56-63b4d8966a59 2G" returned: 0 in 0.138s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-7eef3574-391d-478d-beee-e37a310467a0 tempest-VolumesExtendTest-1013664371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.967s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:44 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-7eef3574-391d-478d-beee-e37a310467a0 tempest-VolumesExtendTest-1013664371 None] Extend volume completed successfully. Jul 07 17:26:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-2982e6d4-df28-4907-98d1-dc17bb109f3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-2982e6d4-df28-4907-98d1-dc17bb109f3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:44 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-2982e6d4-df28-4907-98d1-dc17bb109f3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Creating offline snapshot d4068fed-1a14-4e4c-928b-450e28b24abb of volume 0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:26:44 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[040efaf6-b8a3-4bf4-acb6-4b8367a7f740]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:26:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2982e6d4-df28-4907-98d1-dc17bb109f3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:44 devstack sudo[96223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c Jul 07 17:26:44 devstack sudo[96223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:45 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5f80b27e-f653-434c-a6df-198ae573ebb1 tempest-VolumesExtendTest-1013664371 None] Acquiring lock "cinder-e05e59ec-4ab3-4a32-ae56-63b4d8966a59-delete_snapshot" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:26:45 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5f80b27e-f653-434c-a6df-198ae573ebb1 tempest-VolumesExtendTest-1013664371 None] Lock "cinder-e05e59ec-4ab3-4a32-ae56-63b4d8966a59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:26:45 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5f80b27e-f653-434c-a6df-198ae573ebb1 tempest-VolumesExtendTest-1013664371 None] Acquiring lock "cinder-quobyte-cd12fd00-26c4-4e3b-b91a-28f9423ef5de" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:26:45 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5f80b27e-f653-434c-a6df-198ae573ebb1 tempest-VolumesExtendTest-1013664371 None] Lock "cinder-quobyte-cd12fd00-26c4-4e3b-b91a-28f9423ef5de" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:26:45 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5f80b27e-f653-434c-a6df-198ae573ebb1 tempest-VolumesExtendTest-1013664371 None] Acquiring lock "cinder-quobyte-e05e59ec-4ab3-4a32-ae56-63b4d8966a59" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:26:45 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5f80b27e-f653-434c-a6df-198ae573ebb1 tempest-VolumesExtendTest-1013664371 None] Lock "cinder-quobyte-e05e59ec-4ab3-4a32-ae56-63b4d8966a59" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:26:45 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-5f80b27e-f653-434c-a6df-198ae573ebb1 tempest-VolumesExtendTest-1013664371 None] Deleting offline snapshot e05e59ec-4ab3-4a32-ae56-63b4d8966a59 of volume cd12fd00-26c4-4e3b-b91a-28f9423ef5de {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:26:45 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-5f80b27e-f653-434c-a6df-198ae573ebb1 tempest-VolumesExtendTest-1013664371 None] snapshot_file for this snap is: volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de.e05e59ec-4ab3-4a32-ae56-63b4d8966a59 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:26:45 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[54009d2a-afac-4437-b903-b1ddd000ad1d]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:26:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5f80b27e-f653-434c-a6df-198ae573ebb1 tempest-VolumesExtendTest-1013664371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de.e05e59ec-4ab3-4a32-ae56-63b4d8966a59 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:45 devstack sudo[96225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de.e05e59ec-4ab3-4a32-ae56-63b4d8966a59 Jul 07 17:26:45 devstack sudo[96225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:45 devstack sudo[96223]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2982e6d4-df28-4907-98d1-dc17bb109f3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c" returned: 0 in 0.803s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2982e6d4-df28-4907-98d1-dc17bb109f3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c.d4068fed-1a14-4e4c-928b-450e28b24abb 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:45 devstack sudo[96230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c.d4068fed-1a14-4e4c-928b-450e28b24abb 1G Jul 07 17:26:45 devstack sudo[96230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:45 devstack sudo[96225]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5f80b27e-f653-434c-a6df-198ae573ebb1 tempest-VolumesExtendTest-1013664371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de.e05e59ec-4ab3-4a32-ae56-63b4d8966a59" returned: 0 in 0.815s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:45 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-5f80b27e-f653-434c-a6df-198ae573ebb1 tempest-VolumesExtendTest-1013664371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:26:45 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbcd1b5-c59f-4935-aabc-08492ec28ba2]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:26:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5f80b27e-f653-434c-a6df-198ae573ebb1 tempest-VolumesExtendTest-1013664371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:46 devstack sudo[96235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de Jul 07 17:26:46 devstack sudo[96235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:46 devstack sudo[96230]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2982e6d4-df28-4907-98d1-dc17bb109f3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c.d4068fed-1a14-4e4c-928b-450e28b24abb 1G" returned: 0 in 1.005s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2982e6d4-df28-4907-98d1-dc17bb109f3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c.d4068fed-1a14-4e4c-928b-450e28b24abb {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:46 devstack sudo[96242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c.d4068fed-1a14-4e4c-928b-450e28b24abb Jul 07 17:26:46 devstack sudo[96242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:47 devstack sudo[96235]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5f80b27e-f653-434c-a6df-198ae573ebb1 tempest-VolumesExtendTest-1013664371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de" returned: 0 in 1.067s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5f80b27e-f653-434c-a6df-198ae573ebb1 tempest-VolumesExtendTest-1013664371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de.e05e59ec-4ab3-4a32-ae56-63b4d8966a59 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:47 devstack sudo[96248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de.e05e59ec-4ab3-4a32-ae56-63b4d8966a59 Jul 07 17:26:47 devstack sudo[96248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:47 devstack sudo[96242]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2982e6d4-df28-4907-98d1-dc17bb109f3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c.d4068fed-1a14-4e4c-928b-450e28b24abb" returned: 0 in 0.959s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:47 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-2982e6d4-df28-4907-98d1-dc17bb109f3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c.d4068fed-1a14-4e4c-928b-450e28b24abb is being set with open permissions: ugo+rw Jul 07 17:26:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2982e6d4-df28-4907-98d1-dc17bb109f3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c.d4068fed-1a14-4e4c-928b-450e28b24abb {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:47 devstack sudo[96256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c.d4068fed-1a14-4e4c-928b-450e28b24abb Jul 07 17:26:47 devstack sudo[96256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:48 devstack sudo[96248]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5f80b27e-f653-434c-a6df-198ae573ebb1 tempest-VolumesExtendTest-1013664371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de.e05e59ec-4ab3-4a32-ae56-63b4d8966a59" returned: 0 in 1.041s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5f80b27e-f653-434c-a6df-198ae573ebb1 tempest-VolumesExtendTest-1013664371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de.e05e59ec-4ab3-4a32-ae56-63b4d8966a59 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:48 devstack sudo[96287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de.e05e59ec-4ab3-4a32-ae56-63b4d8966a59 Jul 07 17:26:48 devstack sudo[96287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:48 devstack sudo[96256]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2982e6d4-df28-4907-98d1-dc17bb109f3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c.d4068fed-1a14-4e4c-928b-450e28b24abb" returned: 0 in 0.857s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2982e6d4-df28-4907-98d1-dc17bb109f3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:48 devstack sudo[96290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c.info Jul 07 17:26:48 devstack sudo[96290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:48 devstack sudo[96287]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5f80b27e-f653-434c-a6df-198ae573ebb1 tempest-VolumesExtendTest-1013664371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de.e05e59ec-4ab3-4a32-ae56-63b4d8966a59" returned: 0 in 0.824s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:48 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5f80b27e-f653-434c-a6df-198ae573ebb1 tempest-VolumesExtendTest-1013664371 None] Lock "cinder-quobyte-e05e59ec-4ab3-4a32-ae56-63b4d8966a59" released by "_delete_snapshot" :: held 3.881s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:48 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5f80b27e-f653-434c-a6df-198ae573ebb1 tempest-VolumesExtendTest-1013664371 None] Lock "cinder-quobyte-cd12fd00-26c4-4e3b-b91a-28f9423ef5de" released by "delete_snapshot" :: held 3.908s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:49 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-5f80b27e-f653-434c-a6df-198ae573ebb1 tempest-VolumesExtendTest-1013664371 None] Created reservations ['c45710be-c724-4df6-bf94-6c63a7ce45af', '961d525d-9c50-4be3-95be-ca98bcf62cc4', '05df0c6e-f74e-4098-8768-889374651c7b', '58c7be99-4340-41e4-b961-2de11ada2436'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:26:49 devstack sudo[96290]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:49 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-5f80b27e-f653-434c-a6df-198ae573ebb1 tempest-VolumesExtendTest-1013664371 None] Delete snapshot completed successfully. Jul 07 17:26:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2982e6d4-df28-4907-98d1-dc17bb109f3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c.info" returned: 0 in 0.862s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:49 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-2982e6d4-df28-4907-98d1-dc17bb109f3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c.info is being set with open permissions: ugo+rw Jul 07 17:26:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2982e6d4-df28-4907-98d1-dc17bb109f3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:49 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5f80b27e-f653-434c-a6df-198ae573ebb1 tempest-VolumesExtendTest-1013664371 None] Lock "cinder-e05e59ec-4ab3-4a32-ae56-63b4d8966a59-delete_snapshot" released by "delete_snapshot" :: held 4.106s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:49 devstack sudo[96296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c.info Jul 07 17:26:49 devstack sudo[96296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:49 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-fd16015f-9df1-403a-83c7-4e038c49b5c8 tempest-VolumesExtendTest-1013664371 None] Acquiring lock "cinder-cd12fd00-26c4-4e3b-b91a-28f9423ef5de-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:26:49 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-fd16015f-9df1-403a-83c7-4e038c49b5c8 tempest-VolumesExtendTest-1013664371 None] Lock "cinder-cd12fd00-26c4-4e3b-b91a-28f9423ef5de-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:26:49 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-fd16015f-9df1-403a-83c7-4e038c49b5c8 tempest-VolumesExtendTest-1013664371 None] Acquiring lock "cinder-quobyte-cd12fd00-26c4-4e3b-b91a-28f9423ef5de" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:26:49 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-fd16015f-9df1-403a-83c7-4e038c49b5c8 tempest-VolumesExtendTest-1013664371 None] Lock "cinder-quobyte-cd12fd00-26c4-4e3b-b91a-28f9423ef5de" acquired by "delete_volume" :: waited 0.026s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:26:49 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e667ec-8545-4603-a9fa-831d9f472d07]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:26:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fd16015f-9df1-403a-83c7-4e038c49b5c8 tempest-VolumesExtendTest-1013664371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:49 devstack sudo[96298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de Jul 07 17:26:49 devstack sudo[96298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:50 devstack sudo[96296]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2982e6d4-df28-4907-98d1-dc17bb109f3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c.info" returned: 0 in 0.931s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-2982e6d4-df28-4907-98d1-dc17bb109f3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.520s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:50 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-2982e6d4-df28-4907-98d1-dc17bb109f3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Create snapshot completed successfully Jul 07 17:26:50 devstack sudo[96298]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fd16015f-9df1-403a-83c7-4e038c49b5c8 tempest-VolumesExtendTest-1013664371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de" returned: 0 in 0.923s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fd16015f-9df1-403a-83c7-4e038c49b5c8 tempest-VolumesExtendTest-1013664371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:50 devstack sudo[96306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de Jul 07 17:26:50 devstack sudo[96306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:51 devstack sudo[96306]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fd16015f-9df1-403a-83c7-4e038c49b5c8 tempest-VolumesExtendTest-1013664371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cd12fd00-26c4-4e3b-b91a-28f9423ef5de" returned: 0 in 0.673s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:51 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-fd16015f-9df1-403a-83c7-4e038c49b5c8 tempest-VolumesExtendTest-1013664371 None] Lock "cinder-quobyte-cd12fd00-26c4-4e3b-b91a-28f9423ef5de" released by "delete_volume" :: held 1.702s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:51 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-fd16015f-9df1-403a-83c7-4e038c49b5c8 tempest-VolumesExtendTest-1013664371 None] Created reservations ['2e48150e-6d55-4811-9d79-ff7a9ccb0660', 'e5157372-5b46-4df5-82f3-c1e48202c8da', 'deae2d47-5afd-4dd4-852c-92f3e3ec6466', '8cf71b32-ee0c-4129-881b-086773131317'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:26:51 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-4a83fd47-d19d-495a-940f-c1ad42776ee6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Acquiring lock "cinder-d4068fed-1a14-4e4c-928b-450e28b24abb-delete_snapshot" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:26:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-fd16015f-9df1-403a-83c7-4e038c49b5c8 tempest-VolumesExtendTest-1013664371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-fd16015f-9df1-403a-83c7-4e038c49b5c8 tempest-VolumesExtendTest-1013664371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:51 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-fd16015f-9df1-403a-83c7-4e038c49b5c8 tempest-VolumesExtendTest-1013664371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:26:51 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-fd16015f-9df1-403a-83c7-4e038c49b5c8 tempest-VolumesExtendTest-1013664371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:26:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-fd16015f-9df1-403a-83c7-4e038c49b5c8 tempest-VolumesExtendTest-1013664371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fd16015f-9df1-403a-83c7-4e038c49b5c8 tempest-VolumesExtendTest-1013664371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:51 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-4a83fd47-d19d-495a-940f-c1ad42776ee6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Lock "cinder-d4068fed-1a14-4e4c-928b-450e28b24abb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.117s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:26:51 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-4a83fd47-d19d-495a-940f-c1ad42776ee6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Acquiring lock "cinder-quobyte-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:26:51 devstack sudo[96324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:26:51 devstack sudo[96324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:51 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-4a83fd47-d19d-495a-940f-c1ad42776ee6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Lock "cinder-quobyte-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:26:51 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-4a83fd47-d19d-495a-940f-c1ad42776ee6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Acquiring lock "cinder-quobyte-d4068fed-1a14-4e4c-928b-450e28b24abb" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:26:51 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-4a83fd47-d19d-495a-940f-c1ad42776ee6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Lock "cinder-quobyte-d4068fed-1a14-4e4c-928b-450e28b24abb" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:26:51 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-4a83fd47-d19d-495a-940f-c1ad42776ee6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Deleting offline snapshot d4068fed-1a14-4e4c-928b-450e28b24abb of volume 0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:26:51 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-4a83fd47-d19d-495a-940f-c1ad42776ee6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] snapshot_file for this snap is: volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c.d4068fed-1a14-4e4c-928b-450e28b24abb {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:26:51 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[045261cc-ef0b-447d-9cf3-54f53e93eebb]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:26:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4a83fd47-d19d-495a-940f-c1ad42776ee6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c.d4068fed-1a14-4e4c-928b-450e28b24abb {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:52 devstack sudo[96331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c.d4068fed-1a14-4e4c-928b-450e28b24abb Jul 07 17:26:52 devstack sudo[96331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:52 devstack sudo[96324]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fd16015f-9df1-403a-83c7-4e038c49b5c8 tempest-VolumesExtendTest-1013664371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 1.110s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:52 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-fd16015f-9df1-403a-83c7-4e038c49b5c8 tempest-VolumesExtendTest-1013664371 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:26:52 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-fd16015f-9df1-403a-83c7-4e038c49b5c8 tempest-VolumesExtendTest-1013664371 None] Deleted volume successfully. Jul 07 17:26:52 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-fd16015f-9df1-403a-83c7-4e038c49b5c8 tempest-VolumesExtendTest-1013664371 None] Lock "cinder-cd12fd00-26c4-4e3b-b91a-28f9423ef5de-delete_volume" released by "delete_volume" :: held 3.397s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:53 devstack sudo[96331]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4a83fd47-d19d-495a-940f-c1ad42776ee6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c.d4068fed-1a14-4e4c-928b-450e28b24abb" returned: 0 in 1.191s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:53 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-4a83fd47-d19d-495a-940f-c1ad42776ee6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:26:53 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0635201f-7ea6-41bf-b60c-aaaad33c4d79]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:26:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4a83fd47-d19d-495a-940f-c1ad42776ee6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:53 devstack sudo[96343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c Jul 07 17:26:53 devstack sudo[96343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:54 devstack sudo[96343]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4a83fd47-d19d-495a-940f-c1ad42776ee6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c" returned: 0 in 0.902s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4a83fd47-d19d-495a-940f-c1ad42776ee6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c.d4068fed-1a14-4e4c-928b-450e28b24abb {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:54 devstack sudo[96349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c.d4068fed-1a14-4e4c-928b-450e28b24abb Jul 07 17:26:54 devstack sudo[96349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:54 devstack sudo[96349]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4a83fd47-d19d-495a-940f-c1ad42776ee6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c.d4068fed-1a14-4e4c-928b-450e28b24abb" returned: 0 in 0.882s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4a83fd47-d19d-495a-940f-c1ad42776ee6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c.d4068fed-1a14-4e4c-928b-450e28b24abb {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:54 devstack sudo[96355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c.d4068fed-1a14-4e4c-928b-450e28b24abb Jul 07 17:26:54 devstack sudo[96355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:55 devstack sudo[96355]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4a83fd47-d19d-495a-940f-c1ad42776ee6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c.d4068fed-1a14-4e4c-928b-450e28b24abb" returned: 0 in 0.784s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:55 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-4a83fd47-d19d-495a-940f-c1ad42776ee6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Lock "cinder-quobyte-d4068fed-1a14-4e4c-928b-450e28b24abb" released by "_delete_snapshot" :: held 3.963s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:55 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-4a83fd47-d19d-495a-940f-c1ad42776ee6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Lock "cinder-quobyte-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c" released by "delete_snapshot" :: held 4.009s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:55 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-4a83fd47-d19d-495a-940f-c1ad42776ee6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Created reservations ['c344cd5b-0539-4a69-85bc-027306b35204', '7bac1f7d-910e-4a10-a38f-2471264bec8b', '27946e6e-9d44-4a8a-be45-1ee646eb8315', '57eab361-049a-4b61-b665-8b39b6f0dbb0'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:26:55 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-4a83fd47-d19d-495a-940f-c1ad42776ee6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Delete snapshot completed successfully. Jul 07 17:26:55 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-4a83fd47-d19d-495a-940f-c1ad42776ee6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Lock "cinder-d4068fed-1a14-4e4c-928b-450e28b24abb-delete_snapshot" released by "delete_snapshot" :: held 4.236s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:57 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-e7de20fa-b9c9-4466-b80a-6c76026287ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Acquiring lock "cinder-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:26:57 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-e7de20fa-b9c9-4466-b80a-6c76026287ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Lock "cinder-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:26:57 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-e7de20fa-b9c9-4466-b80a-6c76026287ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Acquiring lock "cinder-quobyte-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:26:57 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-e7de20fa-b9c9-4466-b80a-6c76026287ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Lock "cinder-quobyte-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c" acquired by "delete_volume" :: waited 0.018s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:26:57 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75becd0-8289-4d58-bf58-6d71e7851793]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:26:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e7de20fa-b9c9-4466-b80a-6c76026287ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:57 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-56353594-09d3-4cfa-bdfb-36b35bc27810 tempest-VolumesListTestJSON-1316977558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:26:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-56353594-09d3-4cfa-bdfb-36b35bc27810 tempest-VolumesListTestJSON-1316977558 None] Flow 'volume_create_manager' (407a84aa-9ac3-4650-bdf9-eff7294827c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:26:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-56353594-09d3-4cfa-bdfb-36b35bc27810 tempest-VolumesListTestJSON-1316977558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d6cedc6-e30e-4536-a35e-08873c33dc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-56353594-09d3-4cfa-bdfb-36b35bc27810 tempest-VolumesListTestJSON-1316977558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d6cedc6-e30e-4536-a35e-08873c33dc3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1696183409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f23879f-616f-4239-92ab-f5e211c1625d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='81170e046d444e479c2a768b32a00260',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:26:57Z,use_quota=True,user_id='cb3af465727042a698d5dee8f7626fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-56353594-09d3-4cfa-bdfb-36b35bc27810 tempest-VolumesListTestJSON-1316977558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28a36922-710e-4b13-b545-243f59644152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-56353594-09d3-4cfa-bdfb-36b35bc27810 tempest-VolumesListTestJSON-1316977558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28a36922-710e-4b13-b545-243f59644152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:57 devstack sudo[96360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c Jul 07 17:26:57 devstack sudo[96360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-56353594-09d3-4cfa-bdfb-36b35bc27810 tempest-VolumesListTestJSON-1316977558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac43bab9-0c2a-4122-9ce3-37159b25954b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-56353594-09d3-4cfa-bdfb-36b35bc27810 tempest-VolumesListTestJSON-1316977558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac43bab9-0c2a-4122-9ce3-37159b25954b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f23879f-616f-4239-92ab-f5e211c1625d', 'volume_name': 'volume-3f23879f-616f-4239-92ab-f5e211c1625d', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-56353594-09d3-4cfa-bdfb-36b35bc27810 tempest-VolumesListTestJSON-1316977558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9beae1a8-c638-4137-a31e-d11520654b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-56353594-09d3-4cfa-bdfb-36b35bc27810 tempest-VolumesListTestJSON-1316977558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9beae1a8-c638-4137-a31e-d11520654b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-56353594-09d3-4cfa-bdfb-36b35bc27810 tempest-VolumesListTestJSON-1316977558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (898ecfe9-f1c7-4b4e-9c59-7f530f94bdb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:57 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-56353594-09d3-4cfa-bdfb-36b35bc27810 tempest-VolumesListTestJSON-1316977558 None] Volume 3f23879f-616f-4239-92ab-f5e211c1625d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f23879f-616f-4239-92ab-f5e211c1625d', 'volume_size': 1} Jul 07 17:26:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-56353594-09d3-4cfa-bdfb-36b35bc27810 tempest-VolumesListTestJSON-1316977558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-56353594-09d3-4cfa-bdfb-36b35bc27810 tempest-VolumesListTestJSON-1316977558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:57 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-56353594-09d3-4cfa-bdfb-36b35bc27810 tempest-VolumesListTestJSON-1316977558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1696183409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f23879f-616f-4239-92ab-f5e211c1625d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='81170e046d444e479c2a768b32a00260',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:26:57Z,use_quota=True,user_id='cb3af465727042a698d5dee8f7626fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:26:57 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-56353594-09d3-4cfa-bdfb-36b35bc27810 tempest-VolumesListTestJSON-1316977558 None] Creating volume 3f23879f-616f-4239-92ab-f5e211c1625d {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:26:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-56353594-09d3-4cfa-bdfb-36b35bc27810 tempest-VolumesListTestJSON-1316977558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-56353594-09d3-4cfa-bdfb-36b35bc27810 tempest-VolumesListTestJSON-1316977558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:57 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-56353594-09d3-4cfa-bdfb-36b35bc27810 tempest-VolumesListTestJSON-1316977558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:26:57 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-56353594-09d3-4cfa-bdfb-36b35bc27810 tempest-VolumesListTestJSON-1316977558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:26:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-56353594-09d3-4cfa-bdfb-36b35bc27810 tempest-VolumesListTestJSON-1316977558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:57 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-56353594-09d3-4cfa-bdfb-36b35bc27810 tempest-VolumesListTestJSON-1316977558 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:26:57 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-56353594-09d3-4cfa-bdfb-36b35bc27810 tempest-VolumesListTestJSON-1316977558 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:26:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-56353594-09d3-4cfa-bdfb-36b35bc27810 tempest-VolumesListTestJSON-1316977558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3f23879f-616f-4239-92ab-f5e211c1625d 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:57 devstack sudo[96362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3f23879f-616f-4239-92ab-f5e211c1625d 1073741824 Jul 07 17:26:57 devstack sudo[96362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:58 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-45b17e09-627d-4467-9d2b-42daf4f5692e tempest-VolumesActionsTest-1271669291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:26:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-45b17e09-627d-4467-9d2b-42daf4f5692e tempest-VolumesActionsTest-1271669291 None] Flow 'volume_create_manager' (320269a3-8477-4ab2-8f55-6f5c22fb7fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:26:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-45b17e09-627d-4467-9d2b-42daf4f5692e tempest-VolumesActionsTest-1271669291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f25ad220-93bd-4ae1-b03e-382bf7e4f7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-45b17e09-627d-4467-9d2b-42daf4f5692e tempest-VolumesActionsTest-1271669291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f25ad220-93bd-4ae1-b03e-382bf7e4f7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-764065558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb3e6b9075e44d2c9b3f99063e61db4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:26:58Z,use_quota=True,user_id='6aefcc8677144713800ab6f1fefbfdd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-45b17e09-627d-4467-9d2b-42daf4f5692e tempest-VolumesActionsTest-1271669291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (876d20a9-8733-49ac-92f0-54e7410bc8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-45b17e09-627d-4467-9d2b-42daf4f5692e tempest-VolumesActionsTest-1271669291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (876d20a9-8733-49ac-92f0-54e7410bc8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-45b17e09-627d-4467-9d2b-42daf4f5692e tempest-VolumesActionsTest-1271669291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2be3b7e7-b36d-458d-81d4-93ca7ed5974c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-45b17e09-627d-4467-9d2b-42daf4f5692e tempest-VolumesActionsTest-1271669291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2be3b7e7-b36d-458d-81d4-93ca7ed5974c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d', 'volume_name': 'volume-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-45b17e09-627d-4467-9d2b-42daf4f5692e tempest-VolumesActionsTest-1271669291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05ec6ade-6723-428d-b3f9-d52d6641fbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-45b17e09-627d-4467-9d2b-42daf4f5692e tempest-VolumesActionsTest-1271669291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05ec6ade-6723-428d-b3f9-d52d6641fbe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-45b17e09-627d-4467-9d2b-42daf4f5692e tempest-VolumesActionsTest-1271669291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9921cec-a37a-4c6a-95b1-62707cb2e06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:58 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-45b17e09-627d-4467-9d2b-42daf4f5692e tempest-VolumesActionsTest-1271669291 None] Volume 6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d', 'volume_size': 1} Jul 07 17:26:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-45b17e09-627d-4467-9d2b-42daf4f5692e tempest-VolumesActionsTest-1271669291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:58 devstack sudo[96360]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e7de20fa-b9c9-4466-b80a-6c76026287ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c" returned: 0 in 1.059s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e7de20fa-b9c9-4466-b80a-6c76026287ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:58 devstack sudo[96371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c Jul 07 17:26:58 devstack sudo[96371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:58 devstack sudo[96362]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-56353594-09d3-4cfa-bdfb-36b35bc27810 tempest-VolumesListTestJSON-1316977558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3f23879f-616f-4239-92ab-f5e211c1625d 1073741824" returned: 0 in 0.966s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-56353594-09d3-4cfa-bdfb-36b35bc27810 tempest-VolumesListTestJSON-1316977558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3f23879f-616f-4239-92ab-f5e211c1625d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:58 devstack sudo[96373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3f23879f-616f-4239-92ab-f5e211c1625d Jul 07 17:26:58 devstack sudo[96373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:59 devstack sudo[96371]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e7de20fa-b9c9-4466-b80a-6c76026287ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c" returned: 0 in 0.652s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:59 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-e7de20fa-b9c9-4466-b80a-6c76026287ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Lock "cinder-quobyte-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c" released by "delete_volume" :: held 1.797s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:59 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-e7de20fa-b9c9-4466-b80a-6c76026287ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Created reservations ['edbce042-5b77-4d4e-807c-ff22f847d685', '24e91980-2f26-43e7-a202-572e37e30ef1', '9ff0a333-1b38-4cc4-9e0f-cc1a59e12de5', 'fcebda64-de69-41d1-a44e-a5aaadde5353'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:26:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e7de20fa-b9c9-4466-b80a-6c76026287ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e7de20fa-b9c9-4466-b80a-6c76026287ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:59 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-e7de20fa-b9c9-4466-b80a-6c76026287ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:26:59 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-e7de20fa-b9c9-4466-b80a-6c76026287ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:26:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e7de20fa-b9c9-4466-b80a-6c76026287ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e7de20fa-b9c9-4466-b80a-6c76026287ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:59 devstack sudo[96377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:26:59 devstack sudo[96377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:59 devstack sudo[96373]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-56353594-09d3-4cfa-bdfb-36b35bc27810 tempest-VolumesListTestJSON-1316977558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3f23879f-616f-4239-92ab-f5e211c1625d" returned: 0 in 0.660s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:59 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-56353594-09d3-4cfa-bdfb-36b35bc27810 tempest-VolumesListTestJSON-1316977558 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:26:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-56353594-09d3-4cfa-bdfb-36b35bc27810 tempest-VolumesListTestJSON-1316977558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-45b17e09-627d-4467-9d2b-42daf4f5692e tempest-VolumesActionsTest-1271669291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.024s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:59 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-45b17e09-627d-4467-9d2b-42daf4f5692e tempest-VolumesActionsTest-1271669291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-764065558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb3e6b9075e44d2c9b3f99063e61db4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:26:58Z,use_quota=True,user_id='6aefcc8677144713800ab6f1fefbfdd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:26:59 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-45b17e09-627d-4467-9d2b-42daf4f5692e tempest-VolumesActionsTest-1271669291 None] Creating volume 6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:26:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-45b17e09-627d-4467-9d2b-42daf4f5692e tempest-VolumesActionsTest-1271669291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-45b17e09-627d-4467-9d2b-42daf4f5692e tempest-VolumesActionsTest-1271669291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:59 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-45b17e09-627d-4467-9d2b-42daf4f5692e tempest-VolumesActionsTest-1271669291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:26:59 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-45b17e09-627d-4467-9d2b-42daf4f5692e tempest-VolumesActionsTest-1271669291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:26:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-45b17e09-627d-4467-9d2b-42daf4f5692e tempest-VolumesActionsTest-1271669291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:59 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-45b17e09-627d-4467-9d2b-42daf4f5692e tempest-VolumesActionsTest-1271669291 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:26:59 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-45b17e09-627d-4467-9d2b-42daf4f5692e tempest-VolumesActionsTest-1271669291 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:26:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-45b17e09-627d-4467-9d2b-42daf4f5692e tempest-VolumesActionsTest-1271669291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-56353594-09d3-4cfa-bdfb-36b35bc27810 tempest-VolumesListTestJSON-1316977558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (898ecfe9-f1c7-4b4e-9c59-7f530f94bdb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f23879f-616f-4239-92ab-f5e211c1625d', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-56353594-09d3-4cfa-bdfb-36b35bc27810 tempest-VolumesListTestJSON-1316977558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03dda418-7378-4cbf-a031-95eb396c378e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:59 devstack sudo[96379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d 1073741824 Jul 07 17:26:59 devstack sudo[96379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:59 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-56353594-09d3-4cfa-bdfb-36b35bc27810 tempest-VolumesListTestJSON-1316977558 None] Volume volume-3f23879f-616f-4239-92ab-f5e211c1625d (3f23879f-616f-4239-92ab-f5e211c1625d): created successfully Jul 07 17:26:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-56353594-09d3-4cfa-bdfb-36b35bc27810 tempest-VolumesListTestJSON-1316977558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03dda418-7378-4cbf-a031-95eb396c378e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-56353594-09d3-4cfa-bdfb-36b35bc27810 tempest-VolumesListTestJSON-1316977558 None] Flow 'volume_create_manager' (407a84aa-9ac3-4650-bdf9-eff7294827c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:26:59 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-56353594-09d3-4cfa-bdfb-36b35bc27810 tempest-VolumesListTestJSON-1316977558 None] Created volume successfully. Jul 07 17:27:00 devstack sudo[96377]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e7de20fa-b9c9-4466-b80a-6c76026287ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.824s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:00 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-e7de20fa-b9c9-4466-b80a-6c76026287ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:27:00 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-e7de20fa-b9c9-4466-b80a-6c76026287ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Deleted volume successfully. Jul 07 17:27:00 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-e7de20fa-b9c9-4466-b80a-6c76026287ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1496069309 None] Lock "cinder-0ecc9a05-744d-4c7c-8ed8-f0e108a6b99c-delete_volume" released by "delete_volume" :: held 2.867s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:27:00 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-0310c5af-8652-4fc4-afd5-c4324beb0acc tempest-VolumesListTestJSON-1316977558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:27:00 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0310c5af-8652-4fc4-afd5-c4324beb0acc tempest-VolumesListTestJSON-1316977558 None] Flow 'volume_create_manager' (697199bb-57fd-42be-b570-95688c5bb5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:27:00 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0310c5af-8652-4fc4-afd5-c4324beb0acc tempest-VolumesListTestJSON-1316977558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1105a4c3-0e48-49ca-9388-27f72ad8d078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:00 devstack sudo[96379]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-45b17e09-627d-4467-9d2b-42daf4f5692e tempest-VolumesActionsTest-1271669291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d 1073741824" returned: 0 in 1.074s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:00 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0310c5af-8652-4fc4-afd5-c4324beb0acc tempest-VolumesListTestJSON-1316977558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1105a4c3-0e48-49ca-9388-27f72ad8d078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-880689151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55cb701e-439c-4284-bd7a-d33b5dbafd6b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='81170e046d444e479c2a768b32a00260',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:27:00Z,use_quota=True,user_id='cb3af465727042a698d5dee8f7626fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:00 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0310c5af-8652-4fc4-afd5-c4324beb0acc tempest-VolumesListTestJSON-1316977558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd88282f-0ece-4c76-ba0c-2b31a74cb47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:00 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0310c5af-8652-4fc4-afd5-c4324beb0acc tempest-VolumesListTestJSON-1316977558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd88282f-0ece-4c76-ba0c-2b31a74cb47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:00 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0310c5af-8652-4fc4-afd5-c4324beb0acc tempest-VolumesListTestJSON-1316977558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27c46d6c-f62d-4ee6-ae95-b07e1c814476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:00 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0310c5af-8652-4fc4-afd5-c4324beb0acc tempest-VolumesListTestJSON-1316977558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27c46d6c-f62d-4ee6-ae95-b07e1c814476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55cb701e-439c-4284-bd7a-d33b5dbafd6b', 'volume_name': 'volume-55cb701e-439c-4284-bd7a-d33b5dbafd6b', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:00 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0310c5af-8652-4fc4-afd5-c4324beb0acc tempest-VolumesListTestJSON-1316977558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e4859c4-bf8f-4fb8-a14b-7f409180281d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:00 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0310c5af-8652-4fc4-afd5-c4324beb0acc tempest-VolumesListTestJSON-1316977558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e4859c4-bf8f-4fb8-a14b-7f409180281d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:00 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0310c5af-8652-4fc4-afd5-c4324beb0acc tempest-VolumesListTestJSON-1316977558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38b55979-3cfd-47b1-811c-302c9ef919d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:00 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-0310c5af-8652-4fc4-afd5-c4324beb0acc tempest-VolumesListTestJSON-1316977558 None] Volume 55cb701e-439c-4284-bd7a-d33b5dbafd6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55cb701e-439c-4284-bd7a-d33b5dbafd6b', 'volume_size': 1} Jul 07 17:27:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0310c5af-8652-4fc4-afd5-c4324beb0acc tempest-VolumesListTestJSON-1316977558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-45b17e09-627d-4467-9d2b-42daf4f5692e tempest-VolumesActionsTest-1271669291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:00 devstack sudo[96388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d Jul 07 17:27:00 devstack sudo[96388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:01 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-d7b3a562-c1b1-4070-87cb-dff6be71512f req-9f2d63ef-47e5-40b3-9138-5af0fcc59114 tempest-AttachVolumeNegativeTest-1224056977 None] Terminate volume connection completed successfully. Jul 07 17:27:01 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-d7b3a562-c1b1-4070-87cb-dff6be71512f req-9f2d63ef-47e5-40b3-9138-5af0fcc59114 tempest-AttachVolumeNegativeTest-1224056977 None] Deleting attachment 640d77e1-8560-4026-a180-7c7a7c62d100. {{(pid=87233) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:27:01 devstack sudo[96388]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-45b17e09-627d-4467-9d2b-42daf4f5692e tempest-VolumesActionsTest-1271669291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d" returned: 0 in 0.716s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:01 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-45b17e09-627d-4467-9d2b-42daf4f5692e tempest-VolumesActionsTest-1271669291 None] <== create_volume: return (1878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:27:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-45b17e09-627d-4467-9d2b-42daf4f5692e tempest-VolumesActionsTest-1271669291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.882s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0310c5af-8652-4fc4-afd5-c4324beb0acc tempest-VolumesListTestJSON-1316977558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.747s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:01 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-0310c5af-8652-4fc4-afd5-c4324beb0acc tempest-VolumesListTestJSON-1316977558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-880689151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55cb701e-439c-4284-bd7a-d33b5dbafd6b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='81170e046d444e479c2a768b32a00260',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:27:00Z,use_quota=True,user_id='cb3af465727042a698d5dee8f7626fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:27:01 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-0310c5af-8652-4fc4-afd5-c4324beb0acc tempest-VolumesListTestJSON-1316977558 None] Creating volume 55cb701e-439c-4284-bd7a-d33b5dbafd6b {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:27:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0310c5af-8652-4fc4-afd5-c4324beb0acc tempest-VolumesListTestJSON-1316977558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0310c5af-8652-4fc4-afd5-c4324beb0acc tempest-VolumesListTestJSON-1316977558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:01 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-0310c5af-8652-4fc4-afd5-c4324beb0acc tempest-VolumesListTestJSON-1316977558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:27:01 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-0310c5af-8652-4fc4-afd5-c4324beb0acc tempest-VolumesListTestJSON-1316977558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:27:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0310c5af-8652-4fc4-afd5-c4324beb0acc tempest-VolumesListTestJSON-1316977558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:01 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-0310c5af-8652-4fc4-afd5-c4324beb0acc tempest-VolumesListTestJSON-1316977558 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:27:01 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-0310c5af-8652-4fc4-afd5-c4324beb0acc tempest-VolumesListTestJSON-1316977558 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:27:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0310c5af-8652-4fc4-afd5-c4324beb0acc tempest-VolumesListTestJSON-1316977558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-55cb701e-439c-4284-bd7a-d33b5dbafd6b 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:01 devstack sudo[96395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-55cb701e-439c-4284-bd7a-d33b5dbafd6b 1073741824 Jul 07 17:27:01 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-45b17e09-627d-4467-9d2b-42daf4f5692e tempest-VolumesActionsTest-1271669291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9921cec-a37a-4c6a-95b1-62707cb2e06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:01 devstack sudo[96395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:01 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-45b17e09-627d-4467-9d2b-42daf4f5692e tempest-VolumesActionsTest-1271669291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a70151a1-44f8-49b2-884f-df0f86e6b943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:01 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-45b17e09-627d-4467-9d2b-42daf4f5692e tempest-VolumesActionsTest-1271669291 None] Volume volume-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d (6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d): created successfully Jul 07 17:27:01 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-45b17e09-627d-4467-9d2b-42daf4f5692e tempest-VolumesActionsTest-1271669291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a70151a1-44f8-49b2-884f-df0f86e6b943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:01 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-45b17e09-627d-4467-9d2b-42daf4f5692e tempest-VolumesActionsTest-1271669291 None] Flow 'volume_create_manager' (320269a3-8477-4ab2-8f55-6f5c22fb7fe1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:27:01 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-45b17e09-627d-4467-9d2b-42daf4f5692e tempest-VolumesActionsTest-1271669291 None] Created volume successfully. Jul 07 17:27:02 devstack sudo[96395]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0310c5af-8652-4fc4-afd5-c4324beb0acc tempest-VolumesListTestJSON-1316977558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-55cb701e-439c-4284-bd7a-d33b5dbafd6b 1073741824" returned: 0 in 0.946s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0310c5af-8652-4fc4-afd5-c4324beb0acc tempest-VolumesListTestJSON-1316977558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-55cb701e-439c-4284-bd7a-d33b5dbafd6b {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:02 devstack sudo[96401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-55cb701e-439c-4284-bd7a-d33b5dbafd6b Jul 07 17:27:02 devstack sudo[96401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:02 devstack sudo[96401]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0310c5af-8652-4fc4-afd5-c4324beb0acc tempest-VolumesListTestJSON-1316977558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-55cb701e-439c-4284-bd7a-d33b5dbafd6b" returned: 0 in 0.727s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:02 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-0310c5af-8652-4fc4-afd5-c4324beb0acc tempest-VolumesListTestJSON-1316977558 None] <== create_volume: return (1719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:27:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0310c5af-8652-4fc4-afd5-c4324beb0acc tempest-VolumesListTestJSON-1316977558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.721s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:02 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0310c5af-8652-4fc4-afd5-c4324beb0acc tempest-VolumesListTestJSON-1316977558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38b55979-3cfd-47b1-811c-302c9ef919d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55cb701e-439c-4284-bd7a-d33b5dbafd6b', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:02 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0310c5af-8652-4fc4-afd5-c4324beb0acc tempest-VolumesListTestJSON-1316977558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c57ba787-312c-4e58-b9f6-de373255a72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:02 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-0310c5af-8652-4fc4-afd5-c4324beb0acc tempest-VolumesListTestJSON-1316977558 None] Volume volume-55cb701e-439c-4284-bd7a-d33b5dbafd6b (55cb701e-439c-4284-bd7a-d33b5dbafd6b): created successfully Jul 07 17:27:02 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0310c5af-8652-4fc4-afd5-c4324beb0acc tempest-VolumesListTestJSON-1316977558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c57ba787-312c-4e58-b9f6-de373255a72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:02 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0310c5af-8652-4fc4-afd5-c4324beb0acc tempest-VolumesListTestJSON-1316977558 None] Flow 'volume_create_manager' (697199bb-57fd-42be-b570-95688c5bb5d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:27:02 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-0310c5af-8652-4fc4-afd5-c4324beb0acc tempest-VolumesListTestJSON-1316977558 None] Created volume successfully. Jul 07 17:27:04 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee010a31-e569-49cc-b7e7-a2c57b7a989c tempest-VolumesListTestJSON-1316977558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:27:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ee010a31-e569-49cc-b7e7-a2c57b7a989c tempest-VolumesListTestJSON-1316977558 None] Flow 'volume_create_manager' (53b1449a-4e6c-4937-88c3-fe2ac7cd2bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:27:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ee010a31-e569-49cc-b7e7-a2c57b7a989c tempest-VolumesListTestJSON-1316977558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d5316ee-4f15-49aa-8ed4-c78731314794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ee010a31-e569-49cc-b7e7-a2c57b7a989c tempest-VolumesListTestJSON-1316977558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d5316ee-4f15-49aa-8ed4-c78731314794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1417329852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07ce3341-3ff5-476d-8dab-a8d3ed5c8fc2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='81170e046d444e479c2a768b32a00260',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:27:04Z,use_quota=True,user_id='cb3af465727042a698d5dee8f7626fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ee010a31-e569-49cc-b7e7-a2c57b7a989c tempest-VolumesListTestJSON-1316977558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4149b0d-c5e1-4057-81bb-5777d8ef8f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ee010a31-e569-49cc-b7e7-a2c57b7a989c tempest-VolumesListTestJSON-1316977558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4149b0d-c5e1-4057-81bb-5777d8ef8f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ee010a31-e569-49cc-b7e7-a2c57b7a989c tempest-VolumesListTestJSON-1316977558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (658062b1-d210-45e3-b993-90b6a6692797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ee010a31-e569-49cc-b7e7-a2c57b7a989c tempest-VolumesListTestJSON-1316977558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (658062b1-d210-45e3-b993-90b6a6692797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07ce3341-3ff5-476d-8dab-a8d3ed5c8fc2', 'volume_name': 'volume-07ce3341-3ff5-476d-8dab-a8d3ed5c8fc2', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ee010a31-e569-49cc-b7e7-a2c57b7a989c tempest-VolumesListTestJSON-1316977558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37b6969c-500f-4503-9ec3-34bbb1f9ed84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ee010a31-e569-49cc-b7e7-a2c57b7a989c tempest-VolumesListTestJSON-1316977558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37b6969c-500f-4503-9ec3-34bbb1f9ed84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ee010a31-e569-49cc-b7e7-a2c57b7a989c tempest-VolumesListTestJSON-1316977558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a30443a0-49a9-4b2f-ad3d-5c96359ceaba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:04 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-ee010a31-e569-49cc-b7e7-a2c57b7a989c tempest-VolumesListTestJSON-1316977558 None] Volume 07ce3341-3ff5-476d-8dab-a8d3ed5c8fc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07ce3341-3ff5-476d-8dab-a8d3ed5c8fc2', 'volume_size': 1} Jul 07 17:27:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ee010a31-e569-49cc-b7e7-a2c57b7a989c tempest-VolumesListTestJSON-1316977558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ee010a31-e569-49cc-b7e7-a2c57b7a989c tempest-VolumesListTestJSON-1316977558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:04 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ee010a31-e569-49cc-b7e7-a2c57b7a989c tempest-VolumesListTestJSON-1316977558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1417329852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07ce3341-3ff5-476d-8dab-a8d3ed5c8fc2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='81170e046d444e479c2a768b32a00260',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:27:04Z,use_quota=True,user_id='cb3af465727042a698d5dee8f7626fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:27:04 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-ee010a31-e569-49cc-b7e7-a2c57b7a989c tempest-VolumesListTestJSON-1316977558 None] Creating volume 07ce3341-3ff5-476d-8dab-a8d3ed5c8fc2 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:27:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ee010a31-e569-49cc-b7e7-a2c57b7a989c tempest-VolumesListTestJSON-1316977558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ee010a31-e569-49cc-b7e7-a2c57b7a989c tempest-VolumesListTestJSON-1316977558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:04 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ee010a31-e569-49cc-b7e7-a2c57b7a989c tempest-VolumesListTestJSON-1316977558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:27:04 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ee010a31-e569-49cc-b7e7-a2c57b7a989c tempest-VolumesListTestJSON-1316977558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:27:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ee010a31-e569-49cc-b7e7-a2c57b7a989c tempest-VolumesListTestJSON-1316977558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:04 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ee010a31-e569-49cc-b7e7-a2c57b7a989c tempest-VolumesListTestJSON-1316977558 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:27:04 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-ee010a31-e569-49cc-b7e7-a2c57b7a989c tempest-VolumesListTestJSON-1316977558 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:27:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ee010a31-e569-49cc-b7e7-a2c57b7a989c tempest-VolumesListTestJSON-1316977558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-07ce3341-3ff5-476d-8dab-a8d3ed5c8fc2 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:04 devstack sudo[96409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-07ce3341-3ff5-476d-8dab-a8d3ed5c8fc2 1073741824 Jul 07 17:27:04 devstack sudo[96409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:05 devstack sudo[96409]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ee010a31-e569-49cc-b7e7-a2c57b7a989c tempest-VolumesListTestJSON-1316977558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-07ce3341-3ff5-476d-8dab-a8d3ed5c8fc2 1073741824" returned: 0 in 1.169s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ee010a31-e569-49cc-b7e7-a2c57b7a989c tempest-VolumesListTestJSON-1316977558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-07ce3341-3ff5-476d-8dab-a8d3ed5c8fc2 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:05 devstack sudo[96437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-07ce3341-3ff5-476d-8dab-a8d3ed5c8fc2 Jul 07 17:27:05 devstack sudo[96437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:06 devstack sudo[96437]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ee010a31-e569-49cc-b7e7-a2c57b7a989c tempest-VolumesListTestJSON-1316977558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-07ce3341-3ff5-476d-8dab-a8d3ed5c8fc2" returned: 0 in 0.823s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:06 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ee010a31-e569-49cc-b7e7-a2c57b7a989c tempest-VolumesListTestJSON-1316977558 None] <== create_volume: return (2059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:27:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ee010a31-e569-49cc-b7e7-a2c57b7a989c tempest-VolumesListTestJSON-1316977558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.062s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:06 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ee010a31-e569-49cc-b7e7-a2c57b7a989c tempest-VolumesListTestJSON-1316977558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a30443a0-49a9-4b2f-ad3d-5c96359ceaba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07ce3341-3ff5-476d-8dab-a8d3ed5c8fc2', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:06 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ee010a31-e569-49cc-b7e7-a2c57b7a989c tempest-VolumesListTestJSON-1316977558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc5797e5-5d06-46fa-8102-3d9b8dd10c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:06 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-ee010a31-e569-49cc-b7e7-a2c57b7a989c tempest-VolumesListTestJSON-1316977558 None] Volume volume-07ce3341-3ff5-476d-8dab-a8d3ed5c8fc2 (07ce3341-3ff5-476d-8dab-a8d3ed5c8fc2): created successfully Jul 07 17:27:06 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ee010a31-e569-49cc-b7e7-a2c57b7a989c tempest-VolumesListTestJSON-1316977558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc5797e5-5d06-46fa-8102-3d9b8dd10c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:06 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ee010a31-e569-49cc-b7e7-a2c57b7a989c tempest-VolumesListTestJSON-1316977558 None] Flow 'volume_create_manager' (53b1449a-4e6c-4937-88c3-fe2ac7cd2bab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:27:06 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-ee010a31-e569-49cc-b7e7-a2c57b7a989c tempest-VolumesListTestJSON-1316977558 None] Created volume successfully. Jul 07 17:27:10 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-dac4f69b-c5a3-4aec-9726-ca3cf40da645 tempest-VolumesListTestJSON-1316977558 None] Acquiring lock "cinder-07ce3341-3ff5-476d-8dab-a8d3ed5c8fc2-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:27:10 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-dac4f69b-c5a3-4aec-9726-ca3cf40da645 tempest-VolumesListTestJSON-1316977558 None] Lock "cinder-07ce3341-3ff5-476d-8dab-a8d3ed5c8fc2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:27:10 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-dac4f69b-c5a3-4aec-9726-ca3cf40da645 tempest-VolumesListTestJSON-1316977558 None] Acquiring lock "cinder-quobyte-07ce3341-3ff5-476d-8dab-a8d3ed5c8fc2" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:27:10 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-dac4f69b-c5a3-4aec-9726-ca3cf40da645 tempest-VolumesListTestJSON-1316977558 None] Lock "cinder-quobyte-07ce3341-3ff5-476d-8dab-a8d3ed5c8fc2" acquired by "delete_volume" :: waited 0.020s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:27:10 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a66b2c-a96a-4d17-919f-9c0fa73e9cd1]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:27:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-dac4f69b-c5a3-4aec-9726-ca3cf40da645 tempest-VolumesListTestJSON-1316977558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-07ce3341-3ff5-476d-8dab-a8d3ed5c8fc2 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:10 devstack sudo[96479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-07ce3341-3ff5-476d-8dab-a8d3ed5c8fc2 Jul 07 17:27:10 devstack sudo[96479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:11 devstack sudo[96479]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-dac4f69b-c5a3-4aec-9726-ca3cf40da645 tempest-VolumesListTestJSON-1316977558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-07ce3341-3ff5-476d-8dab-a8d3ed5c8fc2" returned: 0 in 1.064s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-dac4f69b-c5a3-4aec-9726-ca3cf40da645 tempest-VolumesListTestJSON-1316977558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-07ce3341-3ff5-476d-8dab-a8d3ed5c8fc2 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:11 devstack sudo[96503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-07ce3341-3ff5-476d-8dab-a8d3ed5c8fc2 Jul 07 17:27:11 devstack sudo[96503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:12 devstack sudo[96503]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-dac4f69b-c5a3-4aec-9726-ca3cf40da645 tempest-VolumesListTestJSON-1316977558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-07ce3341-3ff5-476d-8dab-a8d3ed5c8fc2" returned: 0 in 0.942s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:12 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-dac4f69b-c5a3-4aec-9726-ca3cf40da645 tempest-VolumesListTestJSON-1316977558 None] Lock "cinder-quobyte-07ce3341-3ff5-476d-8dab-a8d3ed5c8fc2" released by "delete_volume" :: held 2.080s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:27:12 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-dac4f69b-c5a3-4aec-9726-ca3cf40da645 tempest-VolumesListTestJSON-1316977558 None] Created reservations ['ccced7bc-308b-45c3-8929-71d0bb5c2a28', 'd2b8cb7c-4c8d-40b5-b57e-1df56c062558', '4909ad71-a619-4528-8ad3-623e6d025559', '834ede08-f2e9-4229-aacd-8d0928daf7c0'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:27:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-dac4f69b-c5a3-4aec-9726-ca3cf40da645 tempest-VolumesListTestJSON-1316977558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-dac4f69b-c5a3-4aec-9726-ca3cf40da645 tempest-VolumesListTestJSON-1316977558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:12 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-dac4f69b-c5a3-4aec-9726-ca3cf40da645 tempest-VolumesListTestJSON-1316977558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:27:12 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-dac4f69b-c5a3-4aec-9726-ca3cf40da645 tempest-VolumesListTestJSON-1316977558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:27:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-dac4f69b-c5a3-4aec-9726-ca3cf40da645 tempest-VolumesListTestJSON-1316977558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-dac4f69b-c5a3-4aec-9726-ca3cf40da645 tempest-VolumesListTestJSON-1316977558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:12 devstack sudo[96507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:27:12 devstack sudo[96507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:13 devstack sudo[96507]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-dac4f69b-c5a3-4aec-9726-ca3cf40da645 tempest-VolumesListTestJSON-1316977558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.746s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:13 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-dac4f69b-c5a3-4aec-9726-ca3cf40da645 tempest-VolumesListTestJSON-1316977558 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:27:13 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-dac4f69b-c5a3-4aec-9726-ca3cf40da645 tempest-VolumesListTestJSON-1316977558 None] Deleted volume successfully. Jul 07 17:27:13 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-dac4f69b-c5a3-4aec-9726-ca3cf40da645 tempest-VolumesListTestJSON-1316977558 None] Lock "cinder-07ce3341-3ff5-476d-8dab-a8d3ed5c8fc2-delete_volume" released by "delete_volume" :: held 3.113s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:27:13 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-73f39e11-6939-4e91-842a-7a8925512ffa tempest-VolumesListTestJSON-1316977558 None] Acquiring lock "cinder-55cb701e-439c-4284-bd7a-d33b5dbafd6b-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:27:13 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-73f39e11-6939-4e91-842a-7a8925512ffa tempest-VolumesListTestJSON-1316977558 None] Lock "cinder-55cb701e-439c-4284-bd7a-d33b5dbafd6b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:27:13 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-73f39e11-6939-4e91-842a-7a8925512ffa tempest-VolumesListTestJSON-1316977558 None] Acquiring lock "cinder-quobyte-55cb701e-439c-4284-bd7a-d33b5dbafd6b" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:27:13 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-73f39e11-6939-4e91-842a-7a8925512ffa tempest-VolumesListTestJSON-1316977558 None] Lock "cinder-quobyte-55cb701e-439c-4284-bd7a-d33b5dbafd6b" acquired by "delete_volume" :: waited 0.022s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:27:14 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e63ac13-d78c-4d1c-8f16-2e84eb711170]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:27:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-73f39e11-6939-4e91-842a-7a8925512ffa tempest-VolumesListTestJSON-1316977558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-55cb701e-439c-4284-bd7a-d33b5dbafd6b {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:14 devstack sudo[96510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-55cb701e-439c-4284-bd7a-d33b5dbafd6b Jul 07 17:27:14 devstack sudo[96510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:14 devstack sudo[96510]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-73f39e11-6939-4e91-842a-7a8925512ffa tempest-VolumesListTestJSON-1316977558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-55cb701e-439c-4284-bd7a-d33b5dbafd6b" returned: 0 in 0.926s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-73f39e11-6939-4e91-842a-7a8925512ffa tempest-VolumesListTestJSON-1316977558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-55cb701e-439c-4284-bd7a-d33b5dbafd6b {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:14 devstack sudo[96516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-55cb701e-439c-4284-bd7a-d33b5dbafd6b Jul 07 17:27:14 devstack sudo[96516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:15 devstack sudo[96516]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-73f39e11-6939-4e91-842a-7a8925512ffa tempest-VolumesListTestJSON-1316977558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-55cb701e-439c-4284-bd7a-d33b5dbafd6b" returned: 0 in 0.887s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:15 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-73f39e11-6939-4e91-842a-7a8925512ffa tempest-VolumesListTestJSON-1316977558 None] Lock "cinder-quobyte-55cb701e-439c-4284-bd7a-d33b5dbafd6b" released by "delete_volume" :: held 1.867s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:27:16 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-73f39e11-6939-4e91-842a-7a8925512ffa tempest-VolumesListTestJSON-1316977558 None] Created reservations ['f46eb007-1f1e-4d9d-a475-b13336c68302', '3ff18194-6549-4a06-9367-9710f0a62281', '8f862c99-94e8-4cea-8928-64e5eb3876d0', '0c550b23-f52a-462b-9baf-9ad8442dba30'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:27:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-73f39e11-6939-4e91-842a-7a8925512ffa tempest-VolumesListTestJSON-1316977558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-73f39e11-6939-4e91-842a-7a8925512ffa tempest-VolumesListTestJSON-1316977558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:16 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-73f39e11-6939-4e91-842a-7a8925512ffa tempest-VolumesListTestJSON-1316977558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:27:16 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-73f39e11-6939-4e91-842a-7a8925512ffa tempest-VolumesListTestJSON-1316977558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:27:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-73f39e11-6939-4e91-842a-7a8925512ffa tempest-VolumesListTestJSON-1316977558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-73f39e11-6939-4e91-842a-7a8925512ffa tempest-VolumesListTestJSON-1316977558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:16 devstack sudo[96538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:27:16 devstack sudo[96538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:16 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-1f3b9bcb-662f-49f6-8f6d-19e6c7741094 tempest-VolumesListTestJSON-1316977558 None] Acquiring lock "cinder-3f23879f-616f-4239-92ab-f5e211c1625d-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:27:16 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-1f3b9bcb-662f-49f6-8f6d-19e6c7741094 tempest-VolumesListTestJSON-1316977558 None] Lock "cinder-3f23879f-616f-4239-92ab-f5e211c1625d-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:27:16 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-1f3b9bcb-662f-49f6-8f6d-19e6c7741094 tempest-VolumesListTestJSON-1316977558 None] Acquiring lock "cinder-quobyte-3f23879f-616f-4239-92ab-f5e211c1625d" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:27:16 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-1f3b9bcb-662f-49f6-8f6d-19e6c7741094 tempest-VolumesListTestJSON-1316977558 None] Lock "cinder-quobyte-3f23879f-616f-4239-92ab-f5e211c1625d" acquired by "delete_volume" :: waited 0.019s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:27:16 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0eca90-9461-4948-9899-1f4f60eecec7]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:27:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1f3b9bcb-662f-49f6-8f6d-19e6c7741094 tempest-VolumesListTestJSON-1316977558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3f23879f-616f-4239-92ab-f5e211c1625d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:16 devstack sudo[96560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3f23879f-616f-4239-92ab-f5e211c1625d Jul 07 17:27:16 devstack sudo[96560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:17 devstack sudo[96538]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-73f39e11-6939-4e91-842a-7a8925512ffa tempest-VolumesListTestJSON-1316977558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 1.330s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:17 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-73f39e11-6939-4e91-842a-7a8925512ffa tempest-VolumesListTestJSON-1316977558 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:27:17 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-73f39e11-6939-4e91-842a-7a8925512ffa tempest-VolumesListTestJSON-1316977558 None] Deleted volume successfully. Jul 07 17:27:17 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-73f39e11-6939-4e91-842a-7a8925512ffa tempest-VolumesListTestJSON-1316977558 None] Lock "cinder-55cb701e-439c-4284-bd7a-d33b5dbafd6b-delete_volume" released by "delete_volume" :: held 3.573s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:27:17 devstack sudo[96560]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1f3b9bcb-662f-49f6-8f6d-19e6c7741094 tempest-VolumesListTestJSON-1316977558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3f23879f-616f-4239-92ab-f5e211c1625d" returned: 0 in 1.057s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1f3b9bcb-662f-49f6-8f6d-19e6c7741094 tempest-VolumesListTestJSON-1316977558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3f23879f-616f-4239-92ab-f5e211c1625d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:17 devstack sudo[96590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3f23879f-616f-4239-92ab-f5e211c1625d Jul 07 17:27:17 devstack sudo[96590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:18 devstack sudo[96590]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1f3b9bcb-662f-49f6-8f6d-19e6c7741094 tempest-VolumesListTestJSON-1316977558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3f23879f-616f-4239-92ab-f5e211c1625d" returned: 0 in 0.824s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:18 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-1f3b9bcb-662f-49f6-8f6d-19e6c7741094 tempest-VolumesListTestJSON-1316977558 None] Lock "cinder-quobyte-3f23879f-616f-4239-92ab-f5e211c1625d" released by "delete_volume" :: held 1.948s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:27:18 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-1f3b9bcb-662f-49f6-8f6d-19e6c7741094 tempest-VolumesListTestJSON-1316977558 None] Created reservations ['a820d2a5-7792-413a-96fc-f79f08fdb3c1', 'c78147d2-b06d-4b5e-b7ed-8e9655cda711', '4d3ae590-85dc-4171-aae1-d3cadf1512af', '72a69aa6-17a3-42c2-a5e4-e9a430220a1c'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:27:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1f3b9bcb-662f-49f6-8f6d-19e6c7741094 tempest-VolumesListTestJSON-1316977558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1f3b9bcb-662f-49f6-8f6d-19e6c7741094 tempest-VolumesListTestJSON-1316977558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:18 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-1f3b9bcb-662f-49f6-8f6d-19e6c7741094 tempest-VolumesListTestJSON-1316977558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:27:18 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-1f3b9bcb-662f-49f6-8f6d-19e6c7741094 tempest-VolumesListTestJSON-1316977558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:27:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1f3b9bcb-662f-49f6-8f6d-19e6c7741094 tempest-VolumesListTestJSON-1316977558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1f3b9bcb-662f-49f6-8f6d-19e6c7741094 tempest-VolumesListTestJSON-1316977558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:18 devstack sudo[96604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:27:18 devstack sudo[96604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:19 devstack sudo[96604]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1f3b9bcb-662f-49f6-8f6d-19e6c7741094 tempest-VolumesListTestJSON-1316977558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.983s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:19 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-1f3b9bcb-662f-49f6-8f6d-19e6c7741094 tempest-VolumesListTestJSON-1316977558 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:27:19 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-1f3b9bcb-662f-49f6-8f6d-19e6c7741094 tempest-VolumesListTestJSON-1316977558 None] Deleted volume successfully. Jul 07 17:27:19 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-1f3b9bcb-662f-49f6-8f6d-19e6c7741094 tempest-VolumesListTestJSON-1316977558 None] Lock "cinder-3f23879f-616f-4239-92ab-f5e211c1625d-delete_volume" released by "delete_volume" :: held 3.419s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:27:19 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-7efe1d0f-403a-4f83-b6d4-f16154d62bc7 tempest-AbsoluteLimitsTests-457728226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:27:20 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7efe1d0f-403a-4f83-b6d4-f16154d62bc7 tempest-AbsoluteLimitsTests-457728226 None] Flow 'volume_create_manager' (7d000e54-df17-4949-921e-91ddb4fba597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:27:20 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7efe1d0f-403a-4f83-b6d4-f16154d62bc7 tempest-AbsoluteLimitsTests-457728226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b22b1235-f958-4690-bdac-775b79773204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:20 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7efe1d0f-403a-4f83-b6d4-f16154d62bc7 tempest-AbsoluteLimitsTests-457728226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b22b1235-f958-4690-bdac-775b79773204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-91799807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e2bd7ac-34da-4a58-91e5-759556241aa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0741d680a754aeea7625e0e7ccc7bcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:27:20Z,use_quota=True,user_id='4df56e2df9174120be048ffbccf511db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:20 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7efe1d0f-403a-4f83-b6d4-f16154d62bc7 tempest-AbsoluteLimitsTests-457728226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73b0774b-1180-469c-b5b1-fc1c5221fb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:20 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7efe1d0f-403a-4f83-b6d4-f16154d62bc7 tempest-AbsoluteLimitsTests-457728226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73b0774b-1180-469c-b5b1-fc1c5221fb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:20 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7efe1d0f-403a-4f83-b6d4-f16154d62bc7 tempest-AbsoluteLimitsTests-457728226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c55e2044-b57d-4f8f-884f-08f0333e74ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:20 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7efe1d0f-403a-4f83-b6d4-f16154d62bc7 tempest-AbsoluteLimitsTests-457728226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c55e2044-b57d-4f8f-884f-08f0333e74ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e2bd7ac-34da-4a58-91e5-759556241aa6', 'volume_name': 'volume-7e2bd7ac-34da-4a58-91e5-759556241aa6', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:20 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7efe1d0f-403a-4f83-b6d4-f16154d62bc7 tempest-AbsoluteLimitsTests-457728226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edfa3473-7226-45fb-b45a-616ddd02df8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:20 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7efe1d0f-403a-4f83-b6d4-f16154d62bc7 tempest-AbsoluteLimitsTests-457728226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edfa3473-7226-45fb-b45a-616ddd02df8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:20 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7efe1d0f-403a-4f83-b6d4-f16154d62bc7 tempest-AbsoluteLimitsTests-457728226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (602f4133-2417-431c-95a7-ec3431c35896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:20 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-7efe1d0f-403a-4f83-b6d4-f16154d62bc7 tempest-AbsoluteLimitsTests-457728226 None] Volume 7e2bd7ac-34da-4a58-91e5-759556241aa6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e2bd7ac-34da-4a58-91e5-759556241aa6', 'volume_size': 1} Jul 07 17:27:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-7efe1d0f-403a-4f83-b6d4-f16154d62bc7 tempest-AbsoluteLimitsTests-457728226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-7efe1d0f-403a-4f83-b6d4-f16154d62bc7 tempest-AbsoluteLimitsTests-457728226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:20 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-7efe1d0f-403a-4f83-b6d4-f16154d62bc7 tempest-AbsoluteLimitsTests-457728226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-91799807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e2bd7ac-34da-4a58-91e5-759556241aa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0741d680a754aeea7625e0e7ccc7bcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:27:20Z,use_quota=True,user_id='4df56e2df9174120be048ffbccf511db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:27:20 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-7efe1d0f-403a-4f83-b6d4-f16154d62bc7 tempest-AbsoluteLimitsTests-457728226 None] Creating volume 7e2bd7ac-34da-4a58-91e5-759556241aa6 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:27:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-7efe1d0f-403a-4f83-b6d4-f16154d62bc7 tempest-AbsoluteLimitsTests-457728226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-7efe1d0f-403a-4f83-b6d4-f16154d62bc7 tempest-AbsoluteLimitsTests-457728226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:20 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-7efe1d0f-403a-4f83-b6d4-f16154d62bc7 tempest-AbsoluteLimitsTests-457728226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:27:20 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-7efe1d0f-403a-4f83-b6d4-f16154d62bc7 tempest-AbsoluteLimitsTests-457728226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:27:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-7efe1d0f-403a-4f83-b6d4-f16154d62bc7 tempest-AbsoluteLimitsTests-457728226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:20 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-7efe1d0f-403a-4f83-b6d4-f16154d62bc7 tempest-AbsoluteLimitsTests-457728226 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:27:20 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-7efe1d0f-403a-4f83-b6d4-f16154d62bc7 tempest-AbsoluteLimitsTests-457728226 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:27:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7efe1d0f-403a-4f83-b6d4-f16154d62bc7 tempest-AbsoluteLimitsTests-457728226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-7e2bd7ac-34da-4a58-91e5-759556241aa6 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:20 devstack sudo[96608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-7e2bd7ac-34da-4a58-91e5-759556241aa6 1073741824 Jul 07 17:27:20 devstack sudo[96608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:21 devstack sudo[96608]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7efe1d0f-403a-4f83-b6d4-f16154d62bc7 tempest-AbsoluteLimitsTests-457728226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-7e2bd7ac-34da-4a58-91e5-759556241aa6 1073741824" returned: 0 in 1.734s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7efe1d0f-403a-4f83-b6d4-f16154d62bc7 tempest-AbsoluteLimitsTests-457728226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-7e2bd7ac-34da-4a58-91e5-759556241aa6 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:22 devstack sudo[96621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-7e2bd7ac-34da-4a58-91e5-759556241aa6 Jul 07 17:27:22 devstack sudo[96621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:22 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0fe23dfa-e9dc-4060-9315-0dae30df47c7 tempest-VolumesActionsTest-1271669291 None] Acquiring lock "cinder-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d" by "attach_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:27:22 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0fe23dfa-e9dc-4060-9315-0dae30df47c7 tempest-VolumesActionsTest-1271669291 None] Lock "cinder-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d" acquired by "attach_volume" :: waited 0.041s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:27:22 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-0fe23dfa-e9dc-4060-9315-0dae30df47c7 tempest-VolumesActionsTest-1271669291 None] Attaching volume 6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d to instance bc055fac-af6d-47f0-ad2d-bcf6818829b2 at mountpoint /dev/vdb on host None. Jul 07 17:27:22 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-0fe23dfa-e9dc-4060-9315-0dae30df47c7 tempest-VolumesActionsTest-1271669291 None] Attach volume completed successfully. Jul 07 17:27:22 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0fe23dfa-e9dc-4060-9315-0dae30df47c7 tempest-VolumesActionsTest-1271669291 None] Lock "cinder-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d" released by "attach_volume" :: held 0.275s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:27:22 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-03ac1534-c475-4b86-af77-3d7252f900d6 tempest-VolumesActionsTest-1271669291 None] Acquiring lock "cinder-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d-detach_volume" by "detach_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:27:22 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-03ac1534-c475-4b86-af77-3d7252f900d6 tempest-VolumesActionsTest-1271669291 None] Lock "cinder-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d-detach_volume" acquired by "detach_volume" :: waited 0.047s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:27:22 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-03ac1534-c475-4b86-af77-3d7252f900d6 tempest-VolumesActionsTest-1271669291 None] Detaching volume 6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d from instance bc055fac-af6d-47f0-ad2d-bcf6818829b2. Jul 07 17:27:23 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-03ac1534-c475-4b86-af77-3d7252f900d6 tempest-VolumesActionsTest-1271669291 None] Detach volume completed successfully. Jul 07 17:27:23 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-03ac1534-c475-4b86-af77-3d7252f900d6 tempest-VolumesActionsTest-1271669291 None] Lock "cinder-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d-detach_volume" released by "detach_volume" :: held 0.223s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:27:23 devstack sudo[96621]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7efe1d0f-403a-4f83-b6d4-f16154d62bc7 tempest-AbsoluteLimitsTests-457728226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-7e2bd7ac-34da-4a58-91e5-759556241aa6" returned: 0 in 1.253s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:23 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-7efe1d0f-403a-4f83-b6d4-f16154d62bc7 tempest-AbsoluteLimitsTests-457728226 None] <== create_volume: return (3063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:27:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-7efe1d0f-403a-4f83-b6d4-f16154d62bc7 tempest-AbsoluteLimitsTests-457728226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.067s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:23 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7efe1d0f-403a-4f83-b6d4-f16154d62bc7 tempest-AbsoluteLimitsTests-457728226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (602f4133-2417-431c-95a7-ec3431c35896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e2bd7ac-34da-4a58-91e5-759556241aa6', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:23 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7efe1d0f-403a-4f83-b6d4-f16154d62bc7 tempest-AbsoluteLimitsTests-457728226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (747a4bee-a945-4879-8469-afe4bb872c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:23 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-7efe1d0f-403a-4f83-b6d4-f16154d62bc7 tempest-AbsoluteLimitsTests-457728226 None] Volume volume-7e2bd7ac-34da-4a58-91e5-759556241aa6 (7e2bd7ac-34da-4a58-91e5-759556241aa6): created successfully Jul 07 17:27:23 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7efe1d0f-403a-4f83-b6d4-f16154d62bc7 tempest-AbsoluteLimitsTests-457728226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (747a4bee-a945-4879-8469-afe4bb872c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:23 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7efe1d0f-403a-4f83-b6d4-f16154d62bc7 tempest-AbsoluteLimitsTests-457728226 None] Flow 'volume_create_manager' (7d000e54-df17-4949-921e-91ddb4fba597) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:27:23 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-7efe1d0f-403a-4f83-b6d4-f16154d62bc7 tempest-AbsoluteLimitsTests-457728226 None] Created volume successfully. Jul 07 17:27:24 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d3612fb6-3ce0-429f-9871-0c8d3a0ccdbd tempest-AbsoluteLimitsTests-457728226 None] Acquiring lock "cinder-7e2bd7ac-34da-4a58-91e5-759556241aa6-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:27:24 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d3612fb6-3ce0-429f-9871-0c8d3a0ccdbd tempest-AbsoluteLimitsTests-457728226 None] Lock "cinder-7e2bd7ac-34da-4a58-91e5-759556241aa6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:27:24 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:SELECT=103,cinder:UPDATE=126,cinder:INSERT=31,cinder:DELETE=11 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:27:24 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:UPDATE=127,cinder:DELETE=10,cinder:SELECT=95,cinder:INSERT=26 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:27:24 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d3612fb6-3ce0-429f-9871-0c8d3a0ccdbd tempest-AbsoluteLimitsTests-457728226 None] Acquiring lock "cinder-quobyte-7e2bd7ac-34da-4a58-91e5-759556241aa6" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:27:24 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d3612fb6-3ce0-429f-9871-0c8d3a0ccdbd tempest-AbsoluteLimitsTests-457728226 None] Lock "cinder-quobyte-7e2bd7ac-34da-4a58-91e5-759556241aa6" acquired by "delete_volume" :: waited 0.031s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:27:24 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e444b4-da1f-4e5d-8034-0fc1e166f8fc]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:27:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d3612fb6-3ce0-429f-9871-0c8d3a0ccdbd tempest-AbsoluteLimitsTests-457728226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-7e2bd7ac-34da-4a58-91e5-759556241aa6 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:24 devstack sudo[96646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-7e2bd7ac-34da-4a58-91e5-759556241aa6 Jul 07 17:27:24 devstack sudo[96646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:25 devstack sudo[96646]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d3612fb6-3ce0-429f-9871-0c8d3a0ccdbd tempest-AbsoluteLimitsTests-457728226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-7e2bd7ac-34da-4a58-91e5-759556241aa6" returned: 0 in 1.007s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d3612fb6-3ce0-429f-9871-0c8d3a0ccdbd tempest-AbsoluteLimitsTests-457728226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-7e2bd7ac-34da-4a58-91e5-759556241aa6 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:25 devstack sudo[96668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-7e2bd7ac-34da-4a58-91e5-759556241aa6 Jul 07 17:27:25 devstack sudo[96668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:26 devstack sudo[96668]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d3612fb6-3ce0-429f-9871-0c8d3a0ccdbd tempest-AbsoluteLimitsTests-457728226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-7e2bd7ac-34da-4a58-91e5-759556241aa6" returned: 0 in 0.915s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:26 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d3612fb6-3ce0-429f-9871-0c8d3a0ccdbd tempest-AbsoluteLimitsTests-457728226 None] Lock "cinder-quobyte-7e2bd7ac-34da-4a58-91e5-759556241aa6" released by "delete_volume" :: held 1.987s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:27:26 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-d3612fb6-3ce0-429f-9871-0c8d3a0ccdbd tempest-AbsoluteLimitsTests-457728226 None] Created reservations ['80d00c40-9700-4e3d-97eb-0cfdf97ca7b3', 'cb859199-eaf0-4db3-bdd8-ecd508c591af', 'ad0fd63f-18ec-405c-89b0-a8d33a91970d', '0b897127-f8dc-43c6-884a-bdbdc2330a88'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:27:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d3612fb6-3ce0-429f-9871-0c8d3a0ccdbd tempest-AbsoluteLimitsTests-457728226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d3612fb6-3ce0-429f-9871-0c8d3a0ccdbd tempest-AbsoluteLimitsTests-457728226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:26 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d3612fb6-3ce0-429f-9871-0c8d3a0ccdbd tempest-AbsoluteLimitsTests-457728226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:27:26 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d3612fb6-3ce0-429f-9871-0c8d3a0ccdbd tempest-AbsoluteLimitsTests-457728226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:27:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d3612fb6-3ce0-429f-9871-0c8d3a0ccdbd tempest-AbsoluteLimitsTests-457728226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d3612fb6-3ce0-429f-9871-0c8d3a0ccdbd tempest-AbsoluteLimitsTests-457728226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:26 devstack sudo[96677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:27:26 devstack sudo[96677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:27 devstack sudo[96677]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d3612fb6-3ce0-429f-9871-0c8d3a0ccdbd tempest-AbsoluteLimitsTests-457728226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 1.034s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:27 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-d3612fb6-3ce0-429f-9871-0c8d3a0ccdbd tempest-AbsoluteLimitsTests-457728226 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:27:27 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-d3612fb6-3ce0-429f-9871-0c8d3a0ccdbd tempest-AbsoluteLimitsTests-457728226 None] Deleted volume successfully. Jul 07 17:27:28 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d3612fb6-3ce0-429f-9871-0c8d3a0ccdbd tempest-AbsoluteLimitsTests-457728226 None] Lock "cinder-7e2bd7ac-34da-4a58-91e5-759556241aa6-delete_volume" released by "delete_volume" :: held 3.358s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:27:33 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b201fe6-9eba-477d-bde0-de4900a2871a tempest-VolumesCloneTest-1510157580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:27:33 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4b201fe6-9eba-477d-bde0-de4900a2871a tempest-VolumesCloneTest-1510157580 None] Flow 'volume_create_manager' (51640261-a006-46b2-9acf-30bf4895610e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:27:33 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4b201fe6-9eba-477d-bde0-de4900a2871a tempest-VolumesCloneTest-1510157580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6034cd17-512b-4977-a4dd-846ca7e296c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:33 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4b201fe6-9eba-477d-bde0-de4900a2871a tempest-VolumesCloneTest-1510157580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6034cd17-512b-4977-a4dd-846ca7e296c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1900303523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a1a0fbe-1297-49de-8c46-45f18b331914,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d1a6e3ad79048c69d4a675666224b37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:27:33Z,use_quota=True,user_id='8a200e4eddd3424898ced29c1e599767',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:33 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4b201fe6-9eba-477d-bde0-de4900a2871a tempest-VolumesCloneTest-1510157580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58ec634f-8fe2-4bcf-9fbb-71fb991b3e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:33 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4b201fe6-9eba-477d-bde0-de4900a2871a tempest-VolumesCloneTest-1510157580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58ec634f-8fe2-4bcf-9fbb-71fb991b3e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:33 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4b201fe6-9eba-477d-bde0-de4900a2871a tempest-VolumesCloneTest-1510157580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb726c36-f9f1-436a-be33-d22529d5c2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:33 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4b201fe6-9eba-477d-bde0-de4900a2871a tempest-VolumesCloneTest-1510157580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb726c36-f9f1-436a-be33-d22529d5c2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a1a0fbe-1297-49de-8c46-45f18b331914', 'volume_name': 'volume-1a1a0fbe-1297-49de-8c46-45f18b331914', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:33 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4b201fe6-9eba-477d-bde0-de4900a2871a tempest-VolumesCloneTest-1510157580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fafb84e5-6263-47e8-92f3-cadaa3431393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:33 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4b201fe6-9eba-477d-bde0-de4900a2871a tempest-VolumesCloneTest-1510157580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fafb84e5-6263-47e8-92f3-cadaa3431393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:33 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4b201fe6-9eba-477d-bde0-de4900a2871a tempest-VolumesCloneTest-1510157580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78686dfa-00d6-4b08-8913-ae43c9db67e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:33 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-4b201fe6-9eba-477d-bde0-de4900a2871a tempest-VolumesCloneTest-1510157580 None] Volume 1a1a0fbe-1297-49de-8c46-45f18b331914: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a1a0fbe-1297-49de-8c46-45f18b331914', 'volume_size': 1} Jul 07 17:27:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4b201fe6-9eba-477d-bde0-de4900a2871a tempest-VolumesCloneTest-1510157580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4b201fe6-9eba-477d-bde0-de4900a2871a tempest-VolumesCloneTest-1510157580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:33 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-4b201fe6-9eba-477d-bde0-de4900a2871a tempest-VolumesCloneTest-1510157580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1900303523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a1a0fbe-1297-49de-8c46-45f18b331914,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d1a6e3ad79048c69d4a675666224b37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:27:33Z,use_quota=True,user_id='8a200e4eddd3424898ced29c1e599767',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:27:33 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-4b201fe6-9eba-477d-bde0-de4900a2871a tempest-VolumesCloneTest-1510157580 None] Creating volume 1a1a0fbe-1297-49de-8c46-45f18b331914 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:27:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4b201fe6-9eba-477d-bde0-de4900a2871a tempest-VolumesCloneTest-1510157580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4b201fe6-9eba-477d-bde0-de4900a2871a tempest-VolumesCloneTest-1510157580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:33 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-4b201fe6-9eba-477d-bde0-de4900a2871a tempest-VolumesCloneTest-1510157580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:27:33 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-4b201fe6-9eba-477d-bde0-de4900a2871a tempest-VolumesCloneTest-1510157580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:27:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4b201fe6-9eba-477d-bde0-de4900a2871a tempest-VolumesCloneTest-1510157580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:33 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-4b201fe6-9eba-477d-bde0-de4900a2871a tempest-VolumesCloneTest-1510157580 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:27:33 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-4b201fe6-9eba-477d-bde0-de4900a2871a tempest-VolumesCloneTest-1510157580 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:27:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4b201fe6-9eba-477d-bde0-de4900a2871a tempest-VolumesCloneTest-1510157580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:33 devstack sudo[96751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914 1073741824 Jul 07 17:27:33 devstack sudo[96751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:34 devstack sudo[96751]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4b201fe6-9eba-477d-bde0-de4900a2871a tempest-VolumesCloneTest-1510157580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914 1073741824" returned: 0 in 1.495s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4b201fe6-9eba-477d-bde0-de4900a2871a tempest-VolumesCloneTest-1510157580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:35 devstack sudo[96763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914 Jul 07 17:27:35 devstack sudo[96763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:36 devstack sudo[96763]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4b201fe6-9eba-477d-bde0-de4900a2871a tempest-VolumesCloneTest-1510157580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914" returned: 0 in 1.233s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:36 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-4b201fe6-9eba-477d-bde0-de4900a2871a tempest-VolumesCloneTest-1510157580 None] <== create_volume: return (2821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:27:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4b201fe6-9eba-477d-bde0-de4900a2871a tempest-VolumesCloneTest-1510157580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.825s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4b201fe6-9eba-477d-bde0-de4900a2871a tempest-VolumesCloneTest-1510157580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78686dfa-00d6-4b08-8913-ae43c9db67e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a1a0fbe-1297-49de-8c46-45f18b331914', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4b201fe6-9eba-477d-bde0-de4900a2871a tempest-VolumesCloneTest-1510157580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86a3b299-65fd-4ee2-ad09-30eedefc44d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:36 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-4b201fe6-9eba-477d-bde0-de4900a2871a tempest-VolumesCloneTest-1510157580 None] Volume volume-1a1a0fbe-1297-49de-8c46-45f18b331914 (1a1a0fbe-1297-49de-8c46-45f18b331914): created successfully Jul 07 17:27:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4b201fe6-9eba-477d-bde0-de4900a2871a tempest-VolumesCloneTest-1510157580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86a3b299-65fd-4ee2-ad09-30eedefc44d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4b201fe6-9eba-477d-bde0-de4900a2871a tempest-VolumesCloneTest-1510157580 None] Flow 'volume_create_manager' (51640261-a006-46b2-9acf-30bf4895610e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:27:36 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-4b201fe6-9eba-477d-bde0-de4900a2871a tempest-VolumesCloneTest-1510157580 None] Created volume successfully. Jul 07 17:27:37 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:27:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Flow 'volume_create_manager' (d6992533-426a-49d1-9554-b53cf866755e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:27:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aee59669-4ecb-4484-8745-de2737c8d912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aee59669-4ecb-4484-8745-de2737c8d912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1477537944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb8538de-2ce0-459b-94af-65b60f77e30d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d1a6e3ad79048c69d4a675666224b37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:27:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=1a1a0fbe-1297-49de-8c46-45f18b331914,status='creating',terminated_at=None,updated_at=2026-07-07T15:27:37Z,use_quota=True,user_id='8a200e4eddd3424898ced29c1e599767',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0762c1b6-70e4-4e10-80de-32dc1a629833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0762c1b6-70e4-4e10-80de-32dc1a629833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59cc31e9-158e-42e5-9fe6-0450b091133f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59cc31e9-158e-42e5-9fe6-0450b091133f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'eb8538de-2ce0-459b-94af-65b60f77e30d', 'volume_name': 'volume-eb8538de-2ce0-459b-94af-65b60f77e30d', 'volume_size': 2, 'source_volid': '1a1a0fbe-1297-49de-8c46-45f18b331914', 'source_volstatus': 'available'}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb9ae8c2-9647-47e3-a161-0de7d9eb2df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb9ae8c2-9647-47e3-a161-0de7d9eb2df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31c86f03-8780-4e7d-86d6-d8a06fc1db62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:37 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Volume eb8538de-2ce0-459b-94af-65b60f77e30d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-eb8538de-2ce0-459b-94af-65b60f77e30d', 'volume_size': 2, 'source_volid': '1a1a0fbe-1297-49de-8c46-45f18b331914', 'source_volstatus': 'available'} Jul 07 17:27:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:37 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Cloning volume 1a1a0fbe-1297-49de-8c46-45f18b331914 to volume eb8538de-2ce0-459b-94af-65b60f77e30d Jul 07 17:27:37 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Creating offline snapshot ea9ff300-8ac1-472e-81aa-e284984c7d3c of volume 1a1a0fbe-1297-49de-8c46-45f18b331914 {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:27:37 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ccd1f5-d767-4170-8da4-8f872faa3675]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:27:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:37 devstack sudo[96767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914 Jul 07 17:27:37 devstack sudo[96767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:38 devstack sudo[96767]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914" returned: 0 in 1.329s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914.ea9ff300-8ac1-472e-81aa-e284984c7d3c 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:38 devstack sudo[96773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914.ea9ff300-8ac1-472e-81aa-e284984c7d3c 1G Jul 07 17:27:38 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:40 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914.ea9ff300-8ac1-472e-81aa-e284984c7d3c 1G" returned: 0 in 1.680s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a1a0fbe-1297-49de-8c46-45f18b331914 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914.ea9ff300-8ac1-472e-81aa-e284984c7d3c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:40 devstack sudo[96779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a1a0fbe-1297-49de-8c46-45f18b331914 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914.ea9ff300-8ac1-472e-81aa-e284984c7d3c Jul 07 17:27:40 devstack sudo[96779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:41 devstack sudo[96779]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a1a0fbe-1297-49de-8c46-45f18b331914 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914.ea9ff300-8ac1-472e-81aa-e284984c7d3c" returned: 0 in 1.167s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:41 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914.ea9ff300-8ac1-472e-81aa-e284984c7d3c is being set with open permissions: ugo+rw Jul 07 17:27:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914.ea9ff300-8ac1-472e-81aa-e284984c7d3c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:41 devstack sudo[96794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914.ea9ff300-8ac1-472e-81aa-e284984c7d3c Jul 07 17:27:41 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:42 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914.ea9ff300-8ac1-472e-81aa-e284984c7d3c" returned: 0 in 1.151s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:42 devstack sudo[96803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914.info Jul 07 17:27:42 devstack sudo[96803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:43 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:27:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:27:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:27:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:43 devstack sudo[96805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:27:43 devstack sudo[96805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:43 devstack sudo[96803]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914.info" returned: 0 in 0.986s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:43 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914.info is being set with open permissions: ugo+rw Jul 07 17:27:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:44 devstack sudo[96808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914.info Jul 07 17:27:44 devstack sudo[96808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:44 devstack sudo[96805]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.941s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:44 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:27:44 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:27:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread count: 28 {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:27:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread info: [<_MainThread(MainThread, started 126077716062336)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:27:44 devstack sudo[96808]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914.info" returned: 0 in 0.815s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:44 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Acquiring lock "cinder-quobyte-eb8538de-2ce0-459b-94af-65b60f77e30d" by "_copy_volume_from_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:27:44 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Lock "cinder-quobyte-eb8538de-2ce0-459b-94af-65b60f77e30d" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:27:44 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] snapshot: ea9ff300-8ac1-472e-81aa-e284984c7d3c, volume: eb8538de-2ce0-459b-94af-65b60f77e30d, {{(pid=87233) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 17:27:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:44 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:27:44 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:27:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:44 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a521b5-81ea-44cf-98b9-086f19b778c9]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:27:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914.ea9ff300-8ac1-472e-81aa-e284984c7d3c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:45 devstack sudo[96812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914.ea9ff300-8ac1-472e-81aa-e284984c7d3c Jul 07 17:27:45 devstack sudo[96812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:46 devstack sudo[96812]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914.ea9ff300-8ac1-472e-81aa-e284984c7d3c" returned: 0 in 1.068s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:46 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a1a0fbe-1297-49de-8c46-45f18b331914(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:27:46 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] will copy from snapshot at /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914 {{(pid=87233) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 17:27:46 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Creating direct copy from snapshot {{(pid=87233) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 17:27:46 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4df65dd-b97e-4c19-ad1b-a1e188fa5b51]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:27:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:46 devstack sudo[96818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914 Jul 07 17:27:46 devstack sudo[96818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:47 devstack sudo[96818]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914" returned: 0 in 1.200s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:47 devstack cinder-volume[87233]: DEBUG cinder.utils [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Path /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-eb8538de-2ce0-459b-94af-65b60f77e30d not found in is_blk_device check {{(pid=87233) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 17:27:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-eb8538de-2ce0-459b-94af-65b60f77e30d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:47 devstack sudo[96872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-eb8538de-2ce0-459b-94af-65b60f77e30d Jul 07 17:27:47 devstack sudo[96872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:52 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:SELECT=8,cinder:INSERT=4,cinder:UPDATE=11,cinder:DELETE=2 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:27:52 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:SELECT=13,cinder:INSERT=3,cinder:UPDATE=12 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:27:53 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-26d845c0-6f30-4f99-9e52-f072764df02d tempest-VolumesActionsTest-1271669291 None] Acquiring lock "cinder-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d" by "attach_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:27:53 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-26d845c0-6f30-4f99-9e52-f072764df02d tempest-VolumesActionsTest-1271669291 None] Lock "cinder-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d" acquired by "attach_volume" :: waited 0.087s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:27:53 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-26d845c0-6f30-4f99-9e52-f072764df02d tempest-VolumesActionsTest-1271669291 None] Attaching volume 6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d to instance 52f3cfc7-877b-4259-a4d4-60ed64929858 at mountpoint /dev/vdb on host None. Jul 07 17:27:53 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-26d845c0-6f30-4f99-9e52-f072764df02d tempest-VolumesActionsTest-1271669291 None] Attach volume completed successfully. Jul 07 17:27:53 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-26d845c0-6f30-4f99-9e52-f072764df02d tempest-VolumesActionsTest-1271669291 None] Lock "cinder-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d" released by "attach_volume" :: held 0.228s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:27:54 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-e2971077-701c-44ff-93e2-3849ed53422e tempest-VolumesActionsTest-1271669291 None] Acquiring lock "cinder-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d-detach_volume" by "detach_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:27:54 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-e2971077-701c-44ff-93e2-3849ed53422e tempest-VolumesActionsTest-1271669291 None] Lock "cinder-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:27:54 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-e2971077-701c-44ff-93e2-3849ed53422e tempest-VolumesActionsTest-1271669291 None] Detaching volume 6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d from instance 52f3cfc7-877b-4259-a4d4-60ed64929858. Jul 07 17:27:54 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-e2971077-701c-44ff-93e2-3849ed53422e tempest-VolumesActionsTest-1271669291 None] Detach volume completed successfully. Jul 07 17:27:54 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-e2971077-701c-44ff-93e2-3849ed53422e tempest-VolumesActionsTest-1271669291 None] Lock "cinder-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d-detach_volume" released by "detach_volume" :: held 0.121s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:27:54 devstack sudo[96872]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-eb8538de-2ce0-459b-94af-65b60f77e30d" returned: 0 in 7.515s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:54 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac85e7d-35b5-498d-8fc6-a286f5fe6557]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:27:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:54 devstack sudo[96939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914 Jul 07 17:27:54 devstack sudo[96939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:56 devstack sudo[96939]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914" returned: 0 in 1.688s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:56 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Image conversion details: src /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914, size 1024.00 MB, duration 7.52 sec, destination /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-eb8538de-2ce0-459b-94af-65b60f77e30d {{(pid=87233) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:27:56 devstack cinder-volume[87233]: INFO cinder.image.image_utils [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Converted 1024.00 MB image at 136.20 MB/s Jul 07 17:27:56 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-eb8538de-2ce0-459b-94af-65b60f77e30d is being set with open permissions: ugo+rw Jul 07 17:27:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-eb8538de-2ce0-459b-94af-65b60f77e30d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:56 devstack sudo[96948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-eb8538de-2ce0-459b-94af-65b60f77e30d Jul 07 17:27:56 devstack sudo[96948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:57 devstack sudo[96948]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-eb8538de-2ce0-459b-94af-65b60f77e30d" returned: 0 in 0.695s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:57 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Lock "cinder-quobyte-eb8538de-2ce0-459b-94af-65b60f77e30d" released by "_copy_volume_from_snapshot" :: held 12.366s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:27:57 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Acquiring lock "cinder-quobyte-ea9ff300-8ac1-472e-81aa-e284984c7d3c" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:27:57 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Lock "cinder-quobyte-ea9ff300-8ac1-472e-81aa-e284984c7d3c" acquired by "_delete_snapshot" :: waited 0.072s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:27:57 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Deleting offline snapshot ea9ff300-8ac1-472e-81aa-e284984c7d3c of volume 1a1a0fbe-1297-49de-8c46-45f18b331914 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:27:57 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] snapshot_file for this snap is: volume-1a1a0fbe-1297-49de-8c46-45f18b331914.ea9ff300-8ac1-472e-81aa-e284984c7d3c {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:27:57 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d969a1-bc6a-4f4e-bd7a-45ad36c4b8b9]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:27:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914.ea9ff300-8ac1-472e-81aa-e284984c7d3c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:57 devstack sudo[96967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914.ea9ff300-8ac1-472e-81aa-e284984c7d3c Jul 07 17:27:57 devstack sudo[96967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:58 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe5a9561-74f9-4083-b112-3c28e77e1977 tempest-AttachVolumeNegativeTest-1224056977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:27:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fe5a9561-74f9-4083-b112-3c28e77e1977 tempest-AttachVolumeNegativeTest-1224056977 None] Flow 'volume_create_manager' (778e3952-fde0-4385-b1fc-759402900731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:27:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fe5a9561-74f9-4083-b112-3c28e77e1977 tempest-AttachVolumeNegativeTest-1224056977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7a8cecf-ac04-4a8b-8dbc-eedb0174d1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fe5a9561-74f9-4083-b112-3c28e77e1977 tempest-AttachVolumeNegativeTest-1224056977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7a8cecf-ac04-4a8b-8dbc-eedb0174d1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1455779930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4282389f-9295-4497-aea7-3d663dc461eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='796ca6dac1614b198cf7645ae5f214d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:27:58Z,use_quota=True,user_id='9a53ffa5a72b41cab5f1a6dbcfee9d66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fe5a9561-74f9-4083-b112-3c28e77e1977 tempest-AttachVolumeNegativeTest-1224056977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c85d90af-208c-448b-ac78-9122c667d008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fe5a9561-74f9-4083-b112-3c28e77e1977 tempest-AttachVolumeNegativeTest-1224056977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c85d90af-208c-448b-ac78-9122c667d008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fe5a9561-74f9-4083-b112-3c28e77e1977 tempest-AttachVolumeNegativeTest-1224056977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e85af59-1f94-4e8f-8a0c-b501f8934ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fe5a9561-74f9-4083-b112-3c28e77e1977 tempest-AttachVolumeNegativeTest-1224056977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e85af59-1f94-4e8f-8a0c-b501f8934ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4282389f-9295-4497-aea7-3d663dc461eb', 'volume_name': 'volume-4282389f-9295-4497-aea7-3d663dc461eb', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fe5a9561-74f9-4083-b112-3c28e77e1977 tempest-AttachVolumeNegativeTest-1224056977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69381db3-9eea-4f74-86ed-5c50a307d089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fe5a9561-74f9-4083-b112-3c28e77e1977 tempest-AttachVolumeNegativeTest-1224056977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69381db3-9eea-4f74-86ed-5c50a307d089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fe5a9561-74f9-4083-b112-3c28e77e1977 tempest-AttachVolumeNegativeTest-1224056977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (539c1e4d-eb30-4639-a1dc-358e6e577306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:58 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-fe5a9561-74f9-4083-b112-3c28e77e1977 tempest-AttachVolumeNegativeTest-1224056977 None] Volume 4282389f-9295-4497-aea7-3d663dc461eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4282389f-9295-4497-aea7-3d663dc461eb', 'volume_size': 1} Jul 07 17:27:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-fe5a9561-74f9-4083-b112-3c28e77e1977 tempest-AttachVolumeNegativeTest-1224056977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:58 devstack sudo[96967]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914.ea9ff300-8ac1-472e-81aa-e284984c7d3c" returned: 0 in 1.269s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:58 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a1a0fbe-1297-49de-8c46-45f18b331914(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:27:58 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5553ae-d765-4e63-a7f2-73afe74d51ba]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:27:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:58 devstack sudo[96979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914 Jul 07 17:27:58 devstack sudo[96979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:59 devstack sudo[96979]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914" returned: 0 in 0.996s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914.ea9ff300-8ac1-472e-81aa-e284984c7d3c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:59 devstack sudo[96986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914.ea9ff300-8ac1-472e-81aa-e284984c7d3c Jul 07 17:27:59 devstack sudo[96986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:00 devstack sudo[96986]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914.ea9ff300-8ac1-472e-81aa-e284984c7d3c" returned: 0 in 0.928s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914.ea9ff300-8ac1-472e-81aa-e284984c7d3c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:00 devstack sudo[96992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914.ea9ff300-8ac1-472e-81aa-e284984c7d3c Jul 07 17:28:00 devstack sudo[96992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:01 devstack sudo[96992]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914.ea9ff300-8ac1-472e-81aa-e284984c7d3c" returned: 0 in 0.715s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:01 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Lock "cinder-quobyte-ea9ff300-8ac1-472e-81aa-e284984c7d3c" released by "_delete_snapshot" :: held 4.079s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:28:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 23.926s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-fe5a9561-74f9-4083-b112-3c28e77e1977 tempest-AttachVolumeNegativeTest-1224056977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.095s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:01 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-fe5a9561-74f9-4083-b112-3c28e77e1977 tempest-AttachVolumeNegativeTest-1224056977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1455779930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4282389f-9295-4497-aea7-3d663dc461eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='796ca6dac1614b198cf7645ae5f214d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:27:58Z,use_quota=True,user_id='9a53ffa5a72b41cab5f1a6dbcfee9d66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:28:01 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-fe5a9561-74f9-4083-b112-3c28e77e1977 tempest-AttachVolumeNegativeTest-1224056977 None] Creating volume 4282389f-9295-4497-aea7-3d663dc461eb {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:28:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-fe5a9561-74f9-4083-b112-3c28e77e1977 tempest-AttachVolumeNegativeTest-1224056977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-fe5a9561-74f9-4083-b112-3c28e77e1977 tempest-AttachVolumeNegativeTest-1224056977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:01 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-fe5a9561-74f9-4083-b112-3c28e77e1977 tempest-AttachVolumeNegativeTest-1224056977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:28:01 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-fe5a9561-74f9-4083-b112-3c28e77e1977 tempest-AttachVolumeNegativeTest-1224056977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:28:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-fe5a9561-74f9-4083-b112-3c28e77e1977 tempest-AttachVolumeNegativeTest-1224056977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:01 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-fe5a9561-74f9-4083-b112-3c28e77e1977 tempest-AttachVolumeNegativeTest-1224056977 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:28:01 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-fe5a9561-74f9-4083-b112-3c28e77e1977 tempest-AttachVolumeNegativeTest-1224056977 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:28:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fe5a9561-74f9-4083-b112-3c28e77e1977 tempest-AttachVolumeNegativeTest-1224056977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4282389f-9295-4497-aea7-3d663dc461eb 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:01 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31c86f03-8780-4e7d-86d6-d8a06fc1db62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb8538de-2ce0-459b-94af-65b60f77e30d', 'volume_size': 2, 'source_volid': '1a1a0fbe-1297-49de-8c46-45f18b331914', 'source_volstatus': 'available'}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:01 devstack sudo[96995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4282389f-9295-4497-aea7-3d663dc461eb 1073741824 Jul 07 17:28:01 devstack sudo[96995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:01 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ea5aa4-a3f0-460b-b876-a36b2c4a2b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:01 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Volume volume-eb8538de-2ce0-459b-94af-65b60f77e30d (eb8538de-2ce0-459b-94af-65b60f77e30d): created successfully Jul 07 17:28:01 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ea5aa4-a3f0-460b-b876-a36b2c4a2b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:01 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Flow 'volume_create_manager' (d6992533-426a-49d1-9554-b53cf866755e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:28:01 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-ce72f961-f2d8-40fa-b7ad-297fb7e13907 tempest-VolumesCloneTest-1510157580 None] Created volume successfully. Jul 07 17:28:02 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-2b604aaf-0c61-4681-be30-e82ab81d110c tempest-VolumesCloneTest-1510157580 None] Acquiring lock "cinder-eb8538de-2ce0-459b-94af-65b60f77e30d-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:28:02 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-2b604aaf-0c61-4681-be30-e82ab81d110c tempest-VolumesCloneTest-1510157580 None] Lock "cinder-eb8538de-2ce0-459b-94af-65b60f77e30d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:28:02 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-2b604aaf-0c61-4681-be30-e82ab81d110c tempest-VolumesCloneTest-1510157580 None] Acquiring lock "cinder-quobyte-eb8538de-2ce0-459b-94af-65b60f77e30d" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:28:02 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-2b604aaf-0c61-4681-be30-e82ab81d110c tempest-VolumesCloneTest-1510157580 None] Lock "cinder-quobyte-eb8538de-2ce0-459b-94af-65b60f77e30d" acquired by "delete_volume" :: waited 0.019s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:28:02 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33ddb50-ca1c-4315-8557-a005d4d9f103]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:28:02 devstack sudo[96995]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2b604aaf-0c61-4681-be30-e82ab81d110c tempest-VolumesCloneTest-1510157580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-eb8538de-2ce0-459b-94af-65b60f77e30d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fe5a9561-74f9-4083-b112-3c28e77e1977 tempest-AttachVolumeNegativeTest-1224056977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4282389f-9295-4497-aea7-3d663dc461eb 1073741824" returned: 0 in 1.179s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fe5a9561-74f9-4083-b112-3c28e77e1977 tempest-AttachVolumeNegativeTest-1224056977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4282389f-9295-4497-aea7-3d663dc461eb {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:02 devstack sudo[97002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4282389f-9295-4497-aea7-3d663dc461eb Jul 07 17:28:02 devstack sudo[97002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:02 devstack sudo[97001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-eb8538de-2ce0-459b-94af-65b60f77e30d Jul 07 17:28:02 devstack sudo[97001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:03 devstack sudo[97002]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fe5a9561-74f9-4083-b112-3c28e77e1977 tempest-AttachVolumeNegativeTest-1224056977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4282389f-9295-4497-aea7-3d663dc461eb" returned: 0 in 0.887s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:03 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-fe5a9561-74f9-4083-b112-3c28e77e1977 tempest-AttachVolumeNegativeTest-1224056977 None] <== create_volume: return (2134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:28:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-fe5a9561-74f9-4083-b112-3c28e77e1977 tempest-AttachVolumeNegativeTest-1224056977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.140s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:03 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fe5a9561-74f9-4083-b112-3c28e77e1977 tempest-AttachVolumeNegativeTest-1224056977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (539c1e4d-eb30-4639-a1dc-358e6e577306) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4282389f-9295-4497-aea7-3d663dc461eb', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:03 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fe5a9561-74f9-4083-b112-3c28e77e1977 tempest-AttachVolumeNegativeTest-1224056977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb1f1453-fc64-429e-9862-358ff9f6eedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:03 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-fe5a9561-74f9-4083-b112-3c28e77e1977 tempest-AttachVolumeNegativeTest-1224056977 None] Volume volume-4282389f-9295-4497-aea7-3d663dc461eb (4282389f-9295-4497-aea7-3d663dc461eb): created successfully Jul 07 17:28:03 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fe5a9561-74f9-4083-b112-3c28e77e1977 tempest-AttachVolumeNegativeTest-1224056977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb1f1453-fc64-429e-9862-358ff9f6eedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:03 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fe5a9561-74f9-4083-b112-3c28e77e1977 tempest-AttachVolumeNegativeTest-1224056977 None] Flow 'volume_create_manager' (778e3952-fde0-4385-b1fc-759402900731) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:28:03 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-fe5a9561-74f9-4083-b112-3c28e77e1977 tempest-AttachVolumeNegativeTest-1224056977 None] Created volume successfully. Jul 07 17:28:03 devstack sudo[97001]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2b604aaf-0c61-4681-be30-e82ab81d110c tempest-VolumesCloneTest-1510157580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-eb8538de-2ce0-459b-94af-65b60f77e30d" returned: 0 in 1.111s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2b604aaf-0c61-4681-be30-e82ab81d110c tempest-VolumesCloneTest-1510157580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-eb8538de-2ce0-459b-94af-65b60f77e30d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:03 devstack sudo[97013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-eb8538de-2ce0-459b-94af-65b60f77e30d Jul 07 17:28:03 devstack sudo[97013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:04 devstack sudo[97013]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2b604aaf-0c61-4681-be30-e82ab81d110c tempest-VolumesCloneTest-1510157580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-eb8538de-2ce0-459b-94af-65b60f77e30d" returned: 0 in 0.647s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:04 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-2b604aaf-0c61-4681-be30-e82ab81d110c tempest-VolumesCloneTest-1510157580 None] Lock "cinder-quobyte-eb8538de-2ce0-459b-94af-65b60f77e30d" released by "delete_volume" :: held 1.827s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:28:04 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-2b604aaf-0c61-4681-be30-e82ab81d110c tempest-VolumesCloneTest-1510157580 None] Created reservations ['bb40c3c5-0c2a-4600-b07f-407f5142d408', '1894b5eb-f1b9-4387-a6d3-52e9c7636b1c', '2cb1df6e-e553-4ff9-838e-f161d8bc239b', '3fcfcf1b-e8f1-4d57-8917-5908e1cedfed'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:28:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ab4f296d-fc23-40f3-9f6d-85fa58a64837 tempest-VolumesActionsTest-1271669291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ab4f296d-fc23-40f3-9f6d-85fa58a64837 tempest-VolumesActionsTest-1271669291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-2b604aaf-0c61-4681-be30-e82ab81d110c tempest-VolumesCloneTest-1510157580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-2b604aaf-0c61-4681-be30-e82ab81d110c tempest-VolumesCloneTest-1510157580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:04 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-2b604aaf-0c61-4681-be30-e82ab81d110c tempest-VolumesCloneTest-1510157580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:28:04 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-2b604aaf-0c61-4681-be30-e82ab81d110c tempest-VolumesCloneTest-1510157580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:28:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-2b604aaf-0c61-4681-be30-e82ab81d110c tempest-VolumesCloneTest-1510157580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2b604aaf-0c61-4681-be30-e82ab81d110c tempest-VolumesCloneTest-1510157580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:04 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[61952212-0771-4bcb-9571-1542d8af8e4a]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:28:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ab4f296d-fc23-40f3-9f6d-85fa58a64837 tempest-VolumesActionsTest-1271669291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:04 devstack sudo[97016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:28:04 devstack sudo[97016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:04 devstack sudo[97017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d Jul 07 17:28:04 devstack sudo[97017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:04 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-7ec2737b-077f-497f-9a2e-4588ca1adae6 tempest-VolumesCloneTest-1510157580 None] Acquiring lock "cinder-1a1a0fbe-1297-49de-8c46-45f18b331914-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:28:04 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-7ec2737b-077f-497f-9a2e-4588ca1adae6 tempest-VolumesCloneTest-1510157580 None] Lock "cinder-1a1a0fbe-1297-49de-8c46-45f18b331914-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:28:04 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-7ec2737b-077f-497f-9a2e-4588ca1adae6 tempest-VolumesCloneTest-1510157580 None] Acquiring lock "cinder-quobyte-1a1a0fbe-1297-49de-8c46-45f18b331914" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:28:04 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-7ec2737b-077f-497f-9a2e-4588ca1adae6 tempest-VolumesCloneTest-1510157580 None] Lock "cinder-quobyte-1a1a0fbe-1297-49de-8c46-45f18b331914" acquired by "delete_volume" :: waited 0.017s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:28:04 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d539dffd-2bc4-4863-8d53-31193c988b8a]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:28:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7ec2737b-077f-497f-9a2e-4588ca1adae6 tempest-VolumesCloneTest-1510157580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:05 devstack sudo[97023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914 Jul 07 17:28:05 devstack sudo[97023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:05 devstack sudo[97016]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2b604aaf-0c61-4681-be30-e82ab81d110c tempest-VolumesCloneTest-1510157580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.783s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:05 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-2b604aaf-0c61-4681-be30-e82ab81d110c tempest-VolumesCloneTest-1510157580 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:28:05 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-2b604aaf-0c61-4681-be30-e82ab81d110c tempest-VolumesCloneTest-1510157580 None] Deleted volume successfully. Jul 07 17:28:05 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-2b604aaf-0c61-4681-be30-e82ab81d110c tempest-VolumesCloneTest-1510157580 None] Lock "cinder-eb8538de-2ce0-459b-94af-65b60f77e30d-delete_volume" released by "delete_volume" :: held 2.908s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:28:05 devstack sudo[97017]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ab4f296d-fc23-40f3-9f6d-85fa58a64837 tempest-VolumesActionsTest-1271669291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d" returned: 0 in 0.964s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:05 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3923ab-6e8b-4e8e-8282-929b9f79128d]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:28:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ab4f296d-fc23-40f3-9f6d-85fa58a64837 tempest-VolumesActionsTest-1271669291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:05 devstack sudo[97029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d Jul 07 17:28:05 devstack sudo[97029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:05 devstack sudo[97023]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7ec2737b-077f-497f-9a2e-4588ca1adae6 tempest-VolumesCloneTest-1510157580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914" returned: 0 in 0.845s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7ec2737b-077f-497f-9a2e-4588ca1adae6 tempest-VolumesCloneTest-1510157580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:05 devstack sudo[97034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914 Jul 07 17:28:05 devstack sudo[97034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:06 devstack sudo[97029]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ab4f296d-fc23-40f3-9f6d-85fa58a64837 tempest-VolumesActionsTest-1271669291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d" returned: 0 in 0.755s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ab4f296d-fc23-40f3-9f6d-85fa58a64837 tempest-VolumesActionsTest-1271669291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d /opt/stack/data/cinder/conversion/6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d.temp_image.2986b989-b51c-4199-9caa-6e5d0b68ce6fwumg0yrh.img {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:06 devstack sudo[97039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d /opt/stack/data/cinder/conversion/6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d.temp_image.2986b989-b51c-4199-9caa-6e5d0b68ce6fwumg0yrh.img Jul 07 17:28:06 devstack sudo[97039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:06 devstack sudo[97034]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7ec2737b-077f-497f-9a2e-4588ca1adae6 tempest-VolumesCloneTest-1510157580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1a1a0fbe-1297-49de-8c46-45f18b331914" returned: 0 in 0.679s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:06 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-7ec2737b-077f-497f-9a2e-4588ca1adae6 tempest-VolumesCloneTest-1510157580 None] Lock "cinder-quobyte-1a1a0fbe-1297-49de-8c46-45f18b331914" released by "delete_volume" :: held 1.584s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:28:06 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-7ec2737b-077f-497f-9a2e-4588ca1adae6 tempest-VolumesCloneTest-1510157580 None] Created reservations ['522b7392-c4f8-4d3a-a894-e172c5fe6eb0', '1a9f55ea-0227-4180-943f-986a37d00a10', '27f5d30f-3137-4b18-a351-0bb843b4b06f', '04dbc58b-67f4-4bf2-aaf3-90d0d55feedf'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:28:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-7ec2737b-077f-497f-9a2e-4588ca1adae6 tempest-VolumesCloneTest-1510157580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-7ec2737b-077f-497f-9a2e-4588ca1adae6 tempest-VolumesCloneTest-1510157580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:06 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-7ec2737b-077f-497f-9a2e-4588ca1adae6 tempest-VolumesCloneTest-1510157580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:28:06 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-7ec2737b-077f-497f-9a2e-4588ca1adae6 tempest-VolumesCloneTest-1510157580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:28:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-7ec2737b-077f-497f-9a2e-4588ca1adae6 tempest-VolumesCloneTest-1510157580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7ec2737b-077f-497f-9a2e-4588ca1adae6 tempest-VolumesCloneTest-1510157580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:06 devstack sudo[97042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:28:06 devstack sudo[97042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:08 devstack sudo[97042]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7ec2737b-077f-497f-9a2e-4588ca1adae6 tempest-VolumesCloneTest-1510157580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 1.480s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:08 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-7ec2737b-077f-497f-9a2e-4588ca1adae6 tempest-VolumesCloneTest-1510157580 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:28:08 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-7ec2737b-077f-497f-9a2e-4588ca1adae6 tempest-VolumesCloneTest-1510157580 None] Deleted volume successfully. Jul 07 17:28:08 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-7ec2737b-077f-497f-9a2e-4588ca1adae6 tempest-VolumesCloneTest-1510157580 None] Lock "cinder-1a1a0fbe-1297-49de-8c46-45f18b331914-delete_volume" released by "delete_volume" :: held 3.373s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:28:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-05479964-4d7e-4909-9d45-d7cab22f7704 req-41c1c1fa-61e6-403a-9e21-2f163baa0e3f tempest-AttachVolumeNegativeTest-1224056977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:12 devstack sudo[97039]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ab4f296d-fc23-40f3-9f6d-85fa58a64837 tempest-VolumesActionsTest-1271669291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d /opt/stack/data/cinder/conversion/6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d.temp_image.2986b989-b51c-4199-9caa-6e5d0b68ce6fwumg0yrh.img" returned: 0 in 6.244s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:12 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4966f7-79e4-43bd-be72-665c57599534]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:28:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ab4f296d-fc23-40f3-9f6d-85fa58a64837 tempest-VolumesActionsTest-1271669291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:12 devstack sudo[97117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d Jul 07 17:28:12 devstack sudo[97117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:13 devstack sudo[97117]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ab4f296d-fc23-40f3-9f6d-85fa58a64837 tempest-VolumesActionsTest-1271669291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d" returned: 0 in 1.059s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:13 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-ab4f296d-fc23-40f3-9f6d-85fa58a64837 tempest-VolumesActionsTest-1271669291 None] Image conversion details: src /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d, size 1024.00 MB, duration 6.25 sec, destination /opt/stack/data/cinder/conversion/6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d.temp_image.2986b989-b51c-4199-9caa-6e5d0b68ce6fwumg0yrh.img {{(pid=87233) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:28:13 devstack cinder-volume[87233]: INFO cinder.image.image_utils [None req-ab4f296d-fc23-40f3-9f6d-85fa58a64837 tempest-VolumesActionsTest-1271669291 None] Converted 1024.00 MB image at 163.97 MB/s Jul 07 17:28:13 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-ab4f296d-fc23-40f3-9f6d-85fa58a64837 tempest-VolumesActionsTest-1271669291 None] 2986b989-b51c-4199-9caa-6e5d0b68ce6f was raw, no need to convert to raw {{(pid=87233) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 07 17:28:13 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-d94f837d-1014-450e-9738-a49519f38cb4 tempest-VolumesCloneNegativeTest-471607425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:28:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d94f837d-1014-450e-9738-a49519f38cb4 tempest-VolumesCloneNegativeTest-471607425 None] Flow 'volume_create_manager' (d303c703-6c41-4111-a1c5-e4ced542d00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:28:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d94f837d-1014-450e-9738-a49519f38cb4 tempest-VolumesCloneNegativeTest-471607425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80c1d82f-4fd6-403d-ad77-30a27201c0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d94f837d-1014-450e-9738-a49519f38cb4 tempest-VolumesCloneNegativeTest-471607425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80c1d82f-4fd6-403d-ad77-30a27201c0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1286429783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5d0f564-27f7-4ced-b439-8a554e8c88f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d3e8f551fc24f478366d71195ed6270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:28:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:28:14Z,use_quota=True,user_id='48e26ffc68c94f7ebcebaea73676da55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d94f837d-1014-450e-9738-a49519f38cb4 tempest-VolumesCloneNegativeTest-471607425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (580fd01c-952d-475a-bfe3-3c1bc2bdcad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d94f837d-1014-450e-9738-a49519f38cb4 tempest-VolumesCloneNegativeTest-471607425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (580fd01c-952d-475a-bfe3-3c1bc2bdcad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d94f837d-1014-450e-9738-a49519f38cb4 tempest-VolumesCloneNegativeTest-471607425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (707b4022-7a51-41ba-93f8-104be8585bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d94f837d-1014-450e-9738-a49519f38cb4 tempest-VolumesCloneNegativeTest-471607425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (707b4022-7a51-41ba-93f8-104be8585bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5d0f564-27f7-4ced-b439-8a554e8c88f4', 'volume_name': 'volume-c5d0f564-27f7-4ced-b439-8a554e8c88f4', 'volume_size': 2}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:14 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d94f837d-1014-450e-9738-a49519f38cb4 tempest-VolumesCloneNegativeTest-471607425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ffda770-b0de-474f-94a1-e5f82e06399f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:14 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d94f837d-1014-450e-9738-a49519f38cb4 tempest-VolumesCloneNegativeTest-471607425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ffda770-b0de-474f-94a1-e5f82e06399f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:14 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d94f837d-1014-450e-9738-a49519f38cb4 tempest-VolumesCloneNegativeTest-471607425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edf15fc8-6dd6-47c9-85d0-6f919fa4fc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:14 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-d94f837d-1014-450e-9738-a49519f38cb4 tempest-VolumesCloneNegativeTest-471607425 None] Volume c5d0f564-27f7-4ced-b439-8a554e8c88f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5d0f564-27f7-4ced-b439-8a554e8c88f4', 'volume_size': 2} Jul 07 17:28:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d94f837d-1014-450e-9738-a49519f38cb4 tempest-VolumesCloneNegativeTest-471607425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:23 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:INSERT=7,cinder:SELECT=19,cinder:UPDATE=28,cinder:DELETE=3 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:28:23 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:SELECT=27,cinder:INSERT=5,cinder:UPDATE=24,cinder:DELETE=1 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:28:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ab4f296d-fc23-40f3-9f6d-85fa58a64837 tempest-VolumesActionsTest-1271669291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.327s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ab4f296d-fc23-40f3-9f6d-85fa58a64837 tempest-VolumesActionsTest-1271669291 None] Uploaded volume to glance image-id: 2986b989-b51c-4199-9caa-6e5d0b68ce6f. {{(pid=87233) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 07 17:28:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-05479964-4d7e-4909-9d45-d7cab22f7704 req-41c1c1fa-61e6-403a-9e21-2f163baa0e3f tempest-AttachVolumeNegativeTest-1224056977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 26.495s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:34 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5873e3a4-0cfe-4b86-9de1-bb4f78de7e88]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:28:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-05479964-4d7e-4909-9d45-d7cab22f7704 req-41c1c1fa-61e6-403a-9e21-2f163baa0e3f tempest-AttachVolumeNegativeTest-1224056977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4282389f-9295-4497-aea7-3d663dc461eb {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:34 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-ab4f296d-fc23-40f3-9f6d-85fa58a64837 tempest-VolumesActionsTest-1271669291 None] Copy volume to image completed successfully. Jul 07 17:28:35 devstack sudo[97224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4282389f-9295-4497-aea7-3d663dc461eb Jul 07 17:28:35 devstack sudo[97224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:35 devstack sudo[97224]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-05479964-4d7e-4909-9d45-d7cab22f7704 req-41c1c1fa-61e6-403a-9e21-2f163baa0e3f tempest-AttachVolumeNegativeTest-1224056977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4282389f-9295-4497-aea7-3d663dc461eb" returned: 0 in 0.833s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-05479964-4d7e-4909-9d45-d7cab22f7704 req-41c1c1fa-61e6-403a-9e21-2f163baa0e3f tempest-AttachVolumeNegativeTest-1224056977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.856s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d94f837d-1014-450e-9738-a49519f38cb4 tempest-VolumesCloneNegativeTest-471607425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.707s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:35 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d94f837d-1014-450e-9738-a49519f38cb4 tempest-VolumesCloneNegativeTest-471607425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1286429783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5d0f564-27f7-4ced-b439-8a554e8c88f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d3e8f551fc24f478366d71195ed6270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:28:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:28:14Z,use_quota=True,user_id='48e26ffc68c94f7ebcebaea73676da55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:28:35 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-d94f837d-1014-450e-9738-a49519f38cb4 tempest-VolumesCloneNegativeTest-471607425 None] Creating volume c5d0f564-27f7-4ced-b439-8a554e8c88f4 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:28:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d94f837d-1014-450e-9738-a49519f38cb4 tempest-VolumesCloneNegativeTest-471607425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d94f837d-1014-450e-9738-a49519f38cb4 tempest-VolumesCloneNegativeTest-471607425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:35 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d94f837d-1014-450e-9738-a49519f38cb4 tempest-VolumesCloneNegativeTest-471607425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:28:35 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d94f837d-1014-450e-9738-a49519f38cb4 tempest-VolumesCloneNegativeTest-471607425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:28:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d94f837d-1014-450e-9738-a49519f38cb4 tempest-VolumesCloneNegativeTest-471607425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:35 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d94f837d-1014-450e-9738-a49519f38cb4 tempest-VolumesCloneNegativeTest-471607425 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:28:35 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-d94f837d-1014-450e-9738-a49519f38cb4 tempest-VolumesCloneNegativeTest-471607425 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:28:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d94f837d-1014-450e-9738-a49519f38cb4 tempest-VolumesCloneNegativeTest-471607425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c5d0f564-27f7-4ced-b439-8a554e8c88f4 2147483648 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:35 devstack sudo[97229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c5d0f564-27f7-4ced-b439-8a554e8c88f4 2147483648 Jul 07 17:28:35 devstack sudo[97229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:35 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-05479964-4d7e-4909-9d45-d7cab22f7704 req-41c1c1fa-61e6-403a-9e21-2f163baa0e3f tempest-AttachVolumeNegativeTest-1224056977 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7', 'name': 'volume-4282389f-9295-4497-aea7-3d663dc461eb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cd7cfec7-3130-4389-b924-b5094523acbc', 'enforce_multipath': True} {{(pid=87233) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:28:35 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-05479964-4d7e-4909-9d45-d7cab22f7704 req-41c1c1fa-61e6-403a-9e21-2f163baa0e3f tempest-AttachVolumeNegativeTest-1224056977 None] attachment_update completed successfully. Jul 07 17:28:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4fd5d1b4-e1b8-4e50-9b13-7010530f68c4 tempest-VolumesActionsTest-1271669291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:36 devstack sudo[97229]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d94f837d-1014-450e-9738-a49519f38cb4 tempest-VolumesCloneNegativeTest-471607425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c5d0f564-27f7-4ced-b439-8a554e8c88f4 2147483648" returned: 0 in 0.933s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d94f837d-1014-450e-9738-a49519f38cb4 tempest-VolumesCloneNegativeTest-471607425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c5d0f564-27f7-4ced-b439-8a554e8c88f4 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:36 devstack sudo[97302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c5d0f564-27f7-4ced-b439-8a554e8c88f4 Jul 07 17:28:36 devstack sudo[97302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:37 devstack sudo[97302]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d94f837d-1014-450e-9738-a49519f38cb4 tempest-VolumesCloneNegativeTest-471607425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c5d0f564-27f7-4ced-b439-8a554e8c88f4" returned: 0 in 0.672s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:37 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d94f837d-1014-450e-9738-a49519f38cb4 tempest-VolumesCloneNegativeTest-471607425 None] <== create_volume: return (1648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:28:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d94f837d-1014-450e-9738-a49519f38cb4 tempest-VolumesCloneNegativeTest-471607425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4fd5d1b4-e1b8-4e50-9b13-7010530f68c4 tempest-VolumesActionsTest-1271669291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.448s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d94f837d-1014-450e-9738-a49519f38cb4 tempest-VolumesCloneNegativeTest-471607425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edf15fc8-6dd6-47c9-85d0-6f919fa4fc09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5d0f564-27f7-4ced-b439-8a554e8c88f4', 'volume_size': 2}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d94f837d-1014-450e-9738-a49519f38cb4 tempest-VolumesCloneNegativeTest-471607425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c42836ee-6487-4c49-aff8-1deee0c00328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:37 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe12092a-7570-48e3-9dca-9684ffea1ee6]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:28:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4fd5d1b4-e1b8-4e50-9b13-7010530f68c4 tempest-VolumesActionsTest-1271669291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:37 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-d94f837d-1014-450e-9738-a49519f38cb4 tempest-VolumesCloneNegativeTest-471607425 None] Volume volume-c5d0f564-27f7-4ced-b439-8a554e8c88f4 (c5d0f564-27f7-4ced-b439-8a554e8c88f4): created successfully Jul 07 17:28:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d94f837d-1014-450e-9738-a49519f38cb4 tempest-VolumesCloneNegativeTest-471607425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c42836ee-6487-4c49-aff8-1deee0c00328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d94f837d-1014-450e-9738-a49519f38cb4 tempest-VolumesCloneNegativeTest-471607425 None] Flow 'volume_create_manager' (d303c703-6c41-4111-a1c5-e4ced542d00e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:28:37 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-d94f837d-1014-450e-9738-a49519f38cb4 tempest-VolumesCloneNegativeTest-471607425 None] Created volume successfully. Jul 07 17:28:37 devstack sudo[97620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d Jul 07 17:28:37 devstack sudo[97620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:38 devstack sudo[97620]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4fd5d1b4-e1b8-4e50-9b13-7010530f68c4 tempest-VolumesActionsTest-1271669291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d" returned: 0 in 0.759s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:38 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e717a70-f11b-4477-ae69-0e95a11ee582]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:28:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4fd5d1b4-e1b8-4e50-9b13-7010530f68c4 tempest-VolumesActionsTest-1271669291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:38 devstack sudo[97625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d Jul 07 17:28:38 devstack sudo[97625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:38 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-e786f6aa-7a65-4444-a855-f89295c3b196 tempest-VolumesCloneNegativeTest-471607425 None] Acquiring lock "cinder-c5d0f564-27f7-4ced-b439-8a554e8c88f4-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:28:38 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-e786f6aa-7a65-4444-a855-f89295c3b196 tempest-VolumesCloneNegativeTest-471607425 None] Lock "cinder-c5d0f564-27f7-4ced-b439-8a554e8c88f4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:28:38 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-e786f6aa-7a65-4444-a855-f89295c3b196 tempest-VolumesCloneNegativeTest-471607425 None] Acquiring lock "cinder-quobyte-c5d0f564-27f7-4ced-b439-8a554e8c88f4" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:28:38 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-e786f6aa-7a65-4444-a855-f89295c3b196 tempest-VolumesCloneNegativeTest-471607425 None] Lock "cinder-quobyte-c5d0f564-27f7-4ced-b439-8a554e8c88f4" acquired by "delete_volume" :: waited 0.016s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:28:38 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0039bd1-ef7e-4ad8-bf4e-c2ef3fd931cb]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:28:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e786f6aa-7a65-4444-a855-f89295c3b196 tempest-VolumesCloneNegativeTest-471607425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c5d0f564-27f7-4ced-b439-8a554e8c88f4 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:38 devstack sudo[97627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c5d0f564-27f7-4ced-b439-8a554e8c88f4 Jul 07 17:28:38 devstack sudo[97627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:38 devstack sudo[97625]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4fd5d1b4-e1b8-4e50-9b13-7010530f68c4 tempest-VolumesActionsTest-1271669291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d" returned: 0 in 0.795s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4fd5d1b4-e1b8-4e50-9b13-7010530f68c4 tempest-VolumesActionsTest-1271669291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d /opt/stack/data/cinder/conversion/6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d.temp_image.bfcfe54c-b190-4b4e-8779-58f9c7bcee7ashafcbsv.img {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:39 devstack sudo[97633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d /opt/stack/data/cinder/conversion/6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d.temp_image.bfcfe54c-b190-4b4e-8779-58f9c7bcee7ashafcbsv.img Jul 07 17:28:39 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:39 devstack sudo[97627]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e786f6aa-7a65-4444-a855-f89295c3b196 tempest-VolumesCloneNegativeTest-471607425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c5d0f564-27f7-4ced-b439-8a554e8c88f4" returned: 0 in 0.787s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e786f6aa-7a65-4444-a855-f89295c3b196 tempest-VolumesCloneNegativeTest-471607425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c5d0f564-27f7-4ced-b439-8a554e8c88f4 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:39 devstack sudo[97638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c5d0f564-27f7-4ced-b439-8a554e8c88f4 Jul 07 17:28:39 devstack sudo[97638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:40 devstack sudo[97638]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e786f6aa-7a65-4444-a855-f89295c3b196 tempest-VolumesCloneNegativeTest-471607425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c5d0f564-27f7-4ced-b439-8a554e8c88f4" returned: 0 in 1.497s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:40 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-e786f6aa-7a65-4444-a855-f89295c3b196 tempest-VolumesCloneNegativeTest-471607425 None] Lock "cinder-quobyte-c5d0f564-27f7-4ced-b439-8a554e8c88f4" released by "delete_volume" :: held 2.360s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:28:40 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-e786f6aa-7a65-4444-a855-f89295c3b196 tempest-VolumesCloneNegativeTest-471607425 None] Created reservations ['ec2f33ce-7a60-4e43-84e1-8cabeea9963b', 'f7dd7d0e-ec7c-4852-8997-f6f89b85a87a', '10d136f4-1e3e-43b1-9bf7-714bf41f218e', '9032c90e-1eb0-4d90-8953-bea207cbb151'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:28:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e786f6aa-7a65-4444-a855-f89295c3b196 tempest-VolumesCloneNegativeTest-471607425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e786f6aa-7a65-4444-a855-f89295c3b196 tempest-VolumesCloneNegativeTest-471607425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:41 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-e786f6aa-7a65-4444-a855-f89295c3b196 tempest-VolumesCloneNegativeTest-471607425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:28:41 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-e786f6aa-7a65-4444-a855-f89295c3b196 tempest-VolumesCloneNegativeTest-471607425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:28:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e786f6aa-7a65-4444-a855-f89295c3b196 tempest-VolumesCloneNegativeTest-471607425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e786f6aa-7a65-4444-a855-f89295c3b196 tempest-VolumesCloneNegativeTest-471607425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:41 devstack sudo[97652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:28:41 devstack sudo[97652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:43 devstack sudo[97652]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e786f6aa-7a65-4444-a855-f89295c3b196 tempest-VolumesCloneNegativeTest-471607425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 1.862s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:43 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-e786f6aa-7a65-4444-a855-f89295c3b196 tempest-VolumesCloneNegativeTest-471607425 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:28:43 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-e786f6aa-7a65-4444-a855-f89295c3b196 tempest-VolumesCloneNegativeTest-471607425 None] Deleted volume successfully. Jul 07 17:28:43 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-e786f6aa-7a65-4444-a855-f89295c3b196 tempest-VolumesCloneNegativeTest-471607425 None] Lock "cinder-c5d0f564-27f7-4ced-b439-8a554e8c88f4-delete_volume" released by "delete_volume" :: held 4.866s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:28:43 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:28:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:28:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:28:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:43 devstack sudo[97655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:28:43 devstack sudo[97655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:44 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-32361d16-97a7-4729-8dfd-5b29859a2743 req-b354043d-9e88-435f-94cc-ccf03da177d7 tempest-AttachVolumeNegativeTest-1224056977 None] Terminate volume connection completed successfully. Jul 07 17:28:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-32361d16-97a7-4729-8dfd-5b29859a2743 req-b354043d-9e88-435f-94cc-ccf03da177d7 tempest-AttachVolumeNegativeTest-1224056977 None] Deleting attachment cd7cfec7-3130-4389-b924-b5094523acbc. {{(pid=87233) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:28:45 devstack sudo[97655]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 1.748s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:45 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:28:45 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:28:45 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread count: 28 {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:28:45 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread info: [<_MainThread(MainThread, started 126077716062336)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:28:45 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4fd5d1b4-e1b8-4e50-9b13-7010530f68c4 tempest-VolumesActionsTest-1271669291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d /opt/stack/data/cinder/conversion/6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d.temp_image.bfcfe54c-b190-4b4e-8779-58f9c7bcee7ashafcbsv.img" returned: 0 in 6.669s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:45 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce31178-81a2-4666-8032-00ecfb47a02c]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:28:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4fd5d1b4-e1b8-4e50-9b13-7010530f68c4 tempest-VolumesActionsTest-1271669291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:45 devstack sudo[97689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d Jul 07 17:28:45 devstack sudo[97689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:46 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab66ab60-2f4c-4adb-a8b6-4296c38cbf54 tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:28:46 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ab66ab60-2f4c-4adb-a8b6-4296c38cbf54 tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Flow 'volume_create_manager' (bad8f8b2-bd1c-4f54-bc5c-108ac65a8c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:28:46 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ab66ab60-2f4c-4adb-a8b6-4296c38cbf54 tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83e4d99b-8726-4799-9b8a-ae399efce1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:46 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ab66ab60-2f4c-4adb-a8b6-4296c38cbf54 tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83e4d99b-8726-4799-9b8a-ae399efce1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-862415948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baea686c-2893-4816-b367-afde9da42d9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c504e6e71ae5438b8c2046a2017850e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:28:46Z,use_quota=True,user_id='6f38a48a0b3940979f621e8151916fda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:46 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ab66ab60-2f4c-4adb-a8b6-4296c38cbf54 tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2653692-af12-447c-b41f-61646359c2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:46 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ab66ab60-2f4c-4adb-a8b6-4296c38cbf54 tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2653692-af12-447c-b41f-61646359c2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:46 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ab66ab60-2f4c-4adb-a8b6-4296c38cbf54 tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83f0bfda-cb55-4d4c-8a84-0316480089ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:46 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ab66ab60-2f4c-4adb-a8b6-4296c38cbf54 tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83f0bfda-cb55-4d4c-8a84-0316480089ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'baea686c-2893-4816-b367-afde9da42d9d', 'volume_name': 'volume-baea686c-2893-4816-b367-afde9da42d9d', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:46 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ab66ab60-2f4c-4adb-a8b6-4296c38cbf54 tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26ec4638-8d46-47e4-a0c7-864a8985346c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:46 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ab66ab60-2f4c-4adb-a8b6-4296c38cbf54 tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26ec4638-8d46-47e4-a0c7-864a8985346c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:46 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ab66ab60-2f4c-4adb-a8b6-4296c38cbf54 tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6c29856-b97b-48de-a91e-14962d8d7605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:46 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-ab66ab60-2f4c-4adb-a8b6-4296c38cbf54 tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Volume baea686c-2893-4816-b367-afde9da42d9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-baea686c-2893-4816-b367-afde9da42d9d', 'volume_size': 1} Jul 07 17:28:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ab66ab60-2f4c-4adb-a8b6-4296c38cbf54 tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:46 devstack sudo[97689]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4fd5d1b4-e1b8-4e50-9b13-7010530f68c4 tempest-VolumesActionsTest-1271669291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d" returned: 0 in 1.193s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:46 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-4fd5d1b4-e1b8-4e50-9b13-7010530f68c4 tempest-VolumesActionsTest-1271669291 None] Image conversion details: src /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d, size 1024.00 MB, duration 6.67 sec, destination /opt/stack/data/cinder/conversion/6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d.temp_image.bfcfe54c-b190-4b4e-8779-58f9c7bcee7ashafcbsv.img {{(pid=87233) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:28:46 devstack cinder-volume[87233]: INFO cinder.image.image_utils [None req-4fd5d1b4-e1b8-4e50-9b13-7010530f68c4 tempest-VolumesActionsTest-1271669291 None] Converted 1024.00 MB image at 153.52 MB/s Jul 07 17:28:46 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-4fd5d1b4-e1b8-4e50-9b13-7010530f68c4 tempest-VolumesActionsTest-1271669291 None] bfcfe54c-b190-4b4e-8779-58f9c7bcee7a was raw, converting to qcow2 {{(pid=87233) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 07 17:28:46 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f9dd9c-2248-4143-a9f5-b49d603f1ee4]: (4, 'raw') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:28:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4fd5d1b4-e1b8-4e50-9b13-7010530f68c4 tempest-VolumesActionsTest-1271669291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d.temp_image.bfcfe54c-b190-4b4e-8779-58f9c7bcee7ashafcbsv.img {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:47 devstack sudo[97694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d.temp_image.bfcfe54c-b190-4b4e-8779-58f9c7bcee7ashafcbsv.img Jul 07 17:28:47 devstack sudo[97694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:47 devstack sudo[97694]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4fd5d1b4-e1b8-4e50-9b13-7010530f68c4 tempest-VolumesActionsTest-1271669291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d.temp_image.bfcfe54c-b190-4b4e-8779-58f9c7bcee7ashafcbsv.img" returned: 0 in 0.833s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4fd5d1b4-e1b8-4e50-9b13-7010530f68c4 tempest-VolumesActionsTest-1271669291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d.temp_image.bfcfe54c-b190-4b4e-8779-58f9c7bcee7ashafcbsv.img {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:47 devstack sudo[97704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d.temp_image.bfcfe54c-b190-4b4e-8779-58f9c7bcee7ashafcbsv.img Jul 07 17:28:47 devstack sudo[97704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:48 devstack sudo[97704]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4fd5d1b4-e1b8-4e50-9b13-7010530f68c4 tempest-VolumesActionsTest-1271669291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d.temp_image.bfcfe54c-b190-4b4e-8779-58f9c7bcee7ashafcbsv.img" returned: 1 in 0.929s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4fd5d1b4-e1b8-4e50-9b13-7010530f68c4 tempest-VolumesActionsTest-1271669291 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d.temp_image.bfcfe54c-b190-4b4e-8779-58f9c7bcee7ashafcbsv.img' failed. Not Retrying. {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:28:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4fd5d1b4-e1b8-4e50-9b13-7010530f68c4 tempest-VolumesActionsTest-1271669291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d.temp_image.bfcfe54c-b190-4b4e-8779-58f9c7bcee7ashafcbsv.img /opt/stack/data/cinder/conversion/vol_upload_mb4b8632 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:48 devstack sudo[97724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d.temp_image.bfcfe54c-b190-4b4e-8779-58f9c7bcee7ashafcbsv.img /opt/stack/data/cinder/conversion/vol_upload_mb4b8632 Jul 07 17:28:48 devstack sudo[97724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:49 devstack sudo[97724]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4fd5d1b4-e1b8-4e50-9b13-7010530f68c4 tempest-VolumesActionsTest-1271669291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d.temp_image.bfcfe54c-b190-4b4e-8779-58f9c7bcee7ashafcbsv.img /opt/stack/data/cinder/conversion/vol_upload_mb4b8632" returned: 0 in 0.869s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:49 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-4fd5d1b4-e1b8-4e50-9b13-7010530f68c4 tempest-VolumesActionsTest-1271669291 None] Image conversion details: src /opt/stack/data/cinder/conversion/6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d.temp_image.bfcfe54c-b190-4b4e-8779-58f9c7bcee7ashafcbsv.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_mb4b8632 {{(pid=87233) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:28:49 devstack cinder-volume[87233]: INFO cinder.image.image_utils [None req-4fd5d1b4-e1b8-4e50-9b13-7010530f68c4 tempest-VolumesActionsTest-1271669291 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 07 17:28:49 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed75494-399f-413c-a076-4e36f792c7ae]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:28:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4fd5d1b4-e1b8-4e50-9b13-7010530f68c4 tempest-VolumesActionsTest-1271669291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_mb4b8632 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:49 devstack sudo[97735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_mb4b8632 Jul 07 17:28:49 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:50 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4fd5d1b4-e1b8-4e50-9b13-7010530f68c4 tempest-VolumesActionsTest-1271669291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_mb4b8632" returned: 0 in 1.009s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4fd5d1b4-e1b8-4e50-9b13-7010530f68c4 tempest-VolumesActionsTest-1271669291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.981s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:52 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4fd5d1b4-e1b8-4e50-9b13-7010530f68c4 tempest-VolumesActionsTest-1271669291 None] Uploaded volume to glance image-id: bfcfe54c-b190-4b4e-8779-58f9c7bcee7a. {{(pid=87233) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 07 17:28:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ab66ab60-2f4c-4adb-a8b6-4296c38cbf54 tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.758s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:52 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ab66ab60-2f4c-4adb-a8b6-4296c38cbf54 tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-862415948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baea686c-2893-4816-b367-afde9da42d9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c504e6e71ae5438b8c2046a2017850e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:28:46Z,use_quota=True,user_id='6f38a48a0b3940979f621e8151916fda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:28:52 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-ab66ab60-2f4c-4adb-a8b6-4296c38cbf54 tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Creating volume baea686c-2893-4816-b367-afde9da42d9d {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:28:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ab66ab60-2f4c-4adb-a8b6-4296c38cbf54 tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ab66ab60-2f4c-4adb-a8b6-4296c38cbf54 tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:52 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ab66ab60-2f4c-4adb-a8b6-4296c38cbf54 tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:28:52 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ab66ab60-2f4c-4adb-a8b6-4296c38cbf54 tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:28:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ab66ab60-2f4c-4adb-a8b6-4296c38cbf54 tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:52 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ab66ab60-2f4c-4adb-a8b6-4296c38cbf54 tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:28:52 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-ab66ab60-2f4c-4adb-a8b6-4296c38cbf54 tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:28:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ab66ab60-2f4c-4adb-a8b6-4296c38cbf54 tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-baea686c-2893-4816-b367-afde9da42d9d 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:52 devstack sudo[97747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-baea686c-2893-4816-b367-afde9da42d9d 1073741824 Jul 07 17:28:52 devstack sudo[97747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:52 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-4fd5d1b4-e1b8-4e50-9b13-7010530f68c4 tempest-VolumesActionsTest-1271669291 None] Copy volume to image completed successfully. Jul 07 17:28:53 devstack sudo[97747]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ab66ab60-2f4c-4adb-a8b6-4296c38cbf54 tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-baea686c-2893-4816-b367-afde9da42d9d 1073741824" returned: 0 in 1.036s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ab66ab60-2f4c-4adb-a8b6-4296c38cbf54 tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-baea686c-2893-4816-b367-afde9da42d9d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:53 devstack sudo[97753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-baea686c-2893-4816-b367-afde9da42d9d Jul 07 17:28:53 devstack sudo[97753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:53 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-298a1adf-6828-4086-8eb7-35b2eb41be6a tempest-VolumesActionsTest-1271669291 None] Acquiring lock "cinder-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:28:53 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-298a1adf-6828-4086-8eb7-35b2eb41be6a tempest-VolumesActionsTest-1271669291 None] Lock "cinder-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:28:53 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-298a1adf-6828-4086-8eb7-35b2eb41be6a tempest-VolumesActionsTest-1271669291 None] Acquiring lock "cinder-quobyte-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:28:53 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-298a1adf-6828-4086-8eb7-35b2eb41be6a tempest-VolumesActionsTest-1271669291 None] Lock "cinder-quobyte-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d" acquired by "delete_volume" :: waited 0.017s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:28:53 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[45aed3f8-83ae-4a53-9f22-aaeaa3fa9c21]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:28:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-298a1adf-6828-4086-8eb7-35b2eb41be6a tempest-VolumesActionsTest-1271669291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:53 devstack sudo[97755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d Jul 07 17:28:53 devstack sudo[97755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:54 devstack sudo[97753]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ab66ab60-2f4c-4adb-a8b6-4296c38cbf54 tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-baea686c-2893-4816-b367-afde9da42d9d" returned: 0 in 0.910s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:54 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ab66ab60-2f4c-4adb-a8b6-4296c38cbf54 tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] <== create_volume: return (2000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:28:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ab66ab60-2f4c-4adb-a8b6-4296c38cbf54 tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.004s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ab66ab60-2f4c-4adb-a8b6-4296c38cbf54 tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6c29856-b97b-48de-a91e-14962d8d7605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baea686c-2893-4816-b367-afde9da42d9d', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ab66ab60-2f4c-4adb-a8b6-4296c38cbf54 tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d360b6a7-6b2b-41c3-9aee-f6b033040de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:54 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-ab66ab60-2f4c-4adb-a8b6-4296c38cbf54 tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Volume volume-baea686c-2893-4816-b367-afde9da42d9d (baea686c-2893-4816-b367-afde9da42d9d): created successfully Jul 07 17:28:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ab66ab60-2f4c-4adb-a8b6-4296c38cbf54 tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d360b6a7-6b2b-41c3-9aee-f6b033040de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ab66ab60-2f4c-4adb-a8b6-4296c38cbf54 tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Flow 'volume_create_manager' (bad8f8b2-bd1c-4f54-bc5c-108ac65a8c6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:28:54 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-ab66ab60-2f4c-4adb-a8b6-4296c38cbf54 tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Created volume successfully. Jul 07 17:28:55 devstack sudo[97755]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-298a1adf-6828-4086-8eb7-35b2eb41be6a tempest-VolumesActionsTest-1271669291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d" returned: 0 in 1.248s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-298a1adf-6828-4086-8eb7-35b2eb41be6a tempest-VolumesActionsTest-1271669291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:55 devstack sudo[97761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d Jul 07 17:28:55 devstack sudo[97761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:55 devstack sudo[97761]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-298a1adf-6828-4086-8eb7-35b2eb41be6a tempest-VolumesActionsTest-1271669291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d" returned: 0 in 0.884s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:55 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-298a1adf-6828-4086-8eb7-35b2eb41be6a tempest-VolumesActionsTest-1271669291 None] Lock "cinder-quobyte-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d" released by "delete_volume" :: held 2.193s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:28:55 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-298a1adf-6828-4086-8eb7-35b2eb41be6a tempest-VolumesActionsTest-1271669291 None] Created reservations ['6a311734-88fd-4c23-a725-6b81b3846c19', 'f64e18ba-1975-41e9-9fa6-bcf7cfd1e1c6', '19ae65a0-de17-45b8-9685-4cdf0f154f0a', '063eb529-a0e9-4a7e-b869-419633a697a7'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:28:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-298a1adf-6828-4086-8eb7-35b2eb41be6a tempest-VolumesActionsTest-1271669291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-298a1adf-6828-4086-8eb7-35b2eb41be6a tempest-VolumesActionsTest-1271669291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:56 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-298a1adf-6828-4086-8eb7-35b2eb41be6a tempest-VolumesActionsTest-1271669291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:28:56 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-298a1adf-6828-4086-8eb7-35b2eb41be6a tempest-VolumesActionsTest-1271669291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:28:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-298a1adf-6828-4086-8eb7-35b2eb41be6a tempest-VolumesActionsTest-1271669291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-298a1adf-6828-4086-8eb7-35b2eb41be6a tempest-VolumesActionsTest-1271669291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:56 devstack sudo[97767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:28:56 devstack sudo[97767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:56 devstack sudo[97767]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-298a1adf-6828-4086-8eb7-35b2eb41be6a tempest-VolumesActionsTest-1271669291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.721s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:56 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-298a1adf-6828-4086-8eb7-35b2eb41be6a tempest-VolumesActionsTest-1271669291 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:28:56 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-298a1adf-6828-4086-8eb7-35b2eb41be6a tempest-VolumesActionsTest-1271669291 None] Deleted volume successfully. Jul 07 17:28:56 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-298a1adf-6828-4086-8eb7-35b2eb41be6a tempest-VolumesActionsTest-1271669291 None] Lock "cinder-6e7885d3-1ef7-4192-92b9-6d0afdbf7c0d-delete_volume" released by "delete_volume" :: held 3.227s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:28:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-938507f7-3462-41a5-a729-f68196d697a7 req-17dda917-2211-4409-9fc4-70903b81147a tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-938507f7-3462-41a5-a729-f68196d697a7 req-17dda917-2211-4409-9fc4-70903b81147a tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:58 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b332cfc-1687-4b45-831b-71cd346ab9ce]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:28:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-938507f7-3462-41a5-a729-f68196d697a7 req-17dda917-2211-4409-9fc4-70903b81147a tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-baea686c-2893-4816-b367-afde9da42d9d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:58 devstack sudo[97778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-baea686c-2893-4816-b367-afde9da42d9d Jul 07 17:28:58 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:59 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-938507f7-3462-41a5-a729-f68196d697a7 req-17dda917-2211-4409-9fc4-70903b81147a tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-baea686c-2893-4816-b367-afde9da42d9d" returned: 0 in 0.884s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-938507f7-3462-41a5-a729-f68196d697a7 req-17dda917-2211-4409-9fc4-70903b81147a tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.906s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-938507f7-3462-41a5-a729-f68196d697a7 req-17dda917-2211-4409-9fc4-70903b81147a tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7', 'name': 'volume-baea686c-2893-4816-b367-afde9da42d9d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '76a08025-ed92-44d1-b51c-646aec90d3a1', 'enforce_multipath': True} {{(pid=87233) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:28:59 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-938507f7-3462-41a5-a729-f68196d697a7 req-17dda917-2211-4409-9fc4-70903b81147a tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] attachment_update completed successfully. Jul 07 17:29:08 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-aaf75a17-cd74-4015-befb-2eb5f8208466 req-3d4e40b8-ce91-49a9-ac0b-a8bf428eb482 tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Terminate volume connection completed successfully. Jul 07 17:29:08 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-aaf75a17-cd74-4015-befb-2eb5f8208466 req-3d4e40b8-ce91-49a9-ac0b-a8bf428eb482 tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Deleting attachment 76a08025-ed92-44d1-b51c-646aec90d3a1. {{(pid=87233) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:29:10 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d3cfbc92-c52f-458e-ac78-cea19db1fc2a tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Acquiring lock "cinder-baea686c-2893-4816-b367-afde9da42d9d-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:10 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d3cfbc92-c52f-458e-ac78-cea19db1fc2a tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Lock "cinder-baea686c-2893-4816-b367-afde9da42d9d-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:10 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d3cfbc92-c52f-458e-ac78-cea19db1fc2a tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Acquiring lock "cinder-quobyte-baea686c-2893-4816-b367-afde9da42d9d" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:10 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d3cfbc92-c52f-458e-ac78-cea19db1fc2a tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Lock "cinder-quobyte-baea686c-2893-4816-b367-afde9da42d9d" acquired by "delete_volume" :: waited 0.017s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:10 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ba9dc7-f460-48b5-9672-38fc76c6c711]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:29:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d3cfbc92-c52f-458e-ac78-cea19db1fc2a tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-baea686c-2893-4816-b367-afde9da42d9d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:10 devstack sudo[98218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-baea686c-2893-4816-b367-afde9da42d9d Jul 07 17:29:10 devstack sudo[98218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:11 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-94c11e1a-5944-4ceb-b70a-4a646a1741e6 tempest-VolumesNegativeTest-1114531016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:29:11 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-94c11e1a-5944-4ceb-b70a-4a646a1741e6 tempest-VolumesNegativeTest-1114531016 None] Flow 'volume_create_manager' (8494719a-7c5c-4c44-9b51-ba207d43f947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:11 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-94c11e1a-5944-4ceb-b70a-4a646a1741e6 tempest-VolumesNegativeTest-1114531016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01b28a9f-3577-4a52-89d6-1f46cb1e6e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:11 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-94c11e1a-5944-4ceb-b70a-4a646a1741e6 tempest-VolumesNegativeTest-1114531016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01b28a9f-3577-4a52-89d6-1f46cb1e6e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-792809636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3e10253-3e28-40ee-9e56-3c169f9e0b30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fba56f621204c85ae2dc5efb8da9d19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:11Z,use_quota=True,user_id='a6df8360678943ab9be27e42597c6e84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:11 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-94c11e1a-5944-4ceb-b70a-4a646a1741e6 tempest-VolumesNegativeTest-1114531016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a53a254a-2218-4c6f-ad0d-e3770e95c436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:11 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-94c11e1a-5944-4ceb-b70a-4a646a1741e6 tempest-VolumesNegativeTest-1114531016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a53a254a-2218-4c6f-ad0d-e3770e95c436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:11 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-94c11e1a-5944-4ceb-b70a-4a646a1741e6 tempest-VolumesNegativeTest-1114531016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (210e0ccd-788c-4b60-b892-71acfc40a55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:11 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-94c11e1a-5944-4ceb-b70a-4a646a1741e6 tempest-VolumesNegativeTest-1114531016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (210e0ccd-788c-4b60-b892-71acfc40a55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3e10253-3e28-40ee-9e56-3c169f9e0b30', 'volume_name': 'volume-f3e10253-3e28-40ee-9e56-3c169f9e0b30', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:11 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-94c11e1a-5944-4ceb-b70a-4a646a1741e6 tempest-VolumesNegativeTest-1114531016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14e58b89-de63-4423-915a-19e8096fbe3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:11 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-94c11e1a-5944-4ceb-b70a-4a646a1741e6 tempest-VolumesNegativeTest-1114531016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14e58b89-de63-4423-915a-19e8096fbe3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:11 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-94c11e1a-5944-4ceb-b70a-4a646a1741e6 tempest-VolumesNegativeTest-1114531016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48e6e17d-18ff-4d48-8809-0a8198cd2dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:11 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-94c11e1a-5944-4ceb-b70a-4a646a1741e6 tempest-VolumesNegativeTest-1114531016 None] Volume f3e10253-3e28-40ee-9e56-3c169f9e0b30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3e10253-3e28-40ee-9e56-3c169f9e0b30', 'volume_size': 1} Jul 07 17:29:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-94c11e1a-5944-4ceb-b70a-4a646a1741e6 tempest-VolumesNegativeTest-1114531016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-94c11e1a-5944-4ceb-b70a-4a646a1741e6 tempest-VolumesNegativeTest-1114531016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:11 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-94c11e1a-5944-4ceb-b70a-4a646a1741e6 tempest-VolumesNegativeTest-1114531016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-792809636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3e10253-3e28-40ee-9e56-3c169f9e0b30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fba56f621204c85ae2dc5efb8da9d19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:11Z,use_quota=True,user_id='a6df8360678943ab9be27e42597c6e84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:29:11 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-94c11e1a-5944-4ceb-b70a-4a646a1741e6 tempest-VolumesNegativeTest-1114531016 None] Creating volume f3e10253-3e28-40ee-9e56-3c169f9e0b30 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:29:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-94c11e1a-5944-4ceb-b70a-4a646a1741e6 tempest-VolumesNegativeTest-1114531016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-94c11e1a-5944-4ceb-b70a-4a646a1741e6 tempest-VolumesNegativeTest-1114531016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:11 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-94c11e1a-5944-4ceb-b70a-4a646a1741e6 tempest-VolumesNegativeTest-1114531016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:11 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-94c11e1a-5944-4ceb-b70a-4a646a1741e6 tempest-VolumesNegativeTest-1114531016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-94c11e1a-5944-4ceb-b70a-4a646a1741e6 tempest-VolumesNegativeTest-1114531016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:11 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-94c11e1a-5944-4ceb-b70a-4a646a1741e6 tempest-VolumesNegativeTest-1114531016 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:29:11 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-94c11e1a-5944-4ceb-b70a-4a646a1741e6 tempest-VolumesNegativeTest-1114531016 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:29:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-94c11e1a-5944-4ceb-b70a-4a646a1741e6 tempest-VolumesNegativeTest-1114531016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f3e10253-3e28-40ee-9e56-3c169f9e0b30 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:11 devstack sudo[98220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f3e10253-3e28-40ee-9e56-3c169f9e0b30 1073741824 Jul 07 17:29:11 devstack sudo[98220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:11 devstack sudo[98218]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d3cfbc92-c52f-458e-ac78-cea19db1fc2a tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-baea686c-2893-4816-b367-afde9da42d9d" returned: 0 in 1.143s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d3cfbc92-c52f-458e-ac78-cea19db1fc2a tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-baea686c-2893-4816-b367-afde9da42d9d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:11 devstack sudo[98225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-baea686c-2893-4816-b367-afde9da42d9d Jul 07 17:29:11 devstack sudo[98225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:12 devstack sudo[98220]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-94c11e1a-5944-4ceb-b70a-4a646a1741e6 tempest-VolumesNegativeTest-1114531016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f3e10253-3e28-40ee-9e56-3c169f9e0b30 1073741824" returned: 0 in 1.369s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-94c11e1a-5944-4ceb-b70a-4a646a1741e6 tempest-VolumesNegativeTest-1114531016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f3e10253-3e28-40ee-9e56-3c169f9e0b30 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:12 devstack sudo[98235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f3e10253-3e28-40ee-9e56-3c169f9e0b30 Jul 07 17:29:12 devstack sudo[98235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:12 devstack sudo[98225]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d3cfbc92-c52f-458e-ac78-cea19db1fc2a tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-baea686c-2893-4816-b367-afde9da42d9d" returned: 0 in 0.836s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:12 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d3cfbc92-c52f-458e-ac78-cea19db1fc2a tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Lock "cinder-quobyte-baea686c-2893-4816-b367-afde9da42d9d" released by "delete_volume" :: held 2.054s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:12 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-d3cfbc92-c52f-458e-ac78-cea19db1fc2a tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Created reservations ['5bcb48c4-0e07-458d-9129-dc366884a904', '7fa72356-ff75-4f6e-a435-431e9e077b19', '7437169e-8038-4d58-82be-7920ab28614c', '3f16b374-dfe2-4c17-8c48-c3b203065431'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:29:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d3cfbc92-c52f-458e-ac78-cea19db1fc2a tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d3cfbc92-c52f-458e-ac78-cea19db1fc2a tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:13 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d3cfbc92-c52f-458e-ac78-cea19db1fc2a tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:13 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d3cfbc92-c52f-458e-ac78-cea19db1fc2a tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d3cfbc92-c52f-458e-ac78-cea19db1fc2a tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d3cfbc92-c52f-458e-ac78-cea19db1fc2a tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:13 devstack sudo[98268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:29:13 devstack sudo[98268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:13 devstack sudo[98235]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-94c11e1a-5944-4ceb-b70a-4a646a1741e6 tempest-VolumesNegativeTest-1114531016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f3e10253-3e28-40ee-9e56-3c169f9e0b30" returned: 0 in 1.191s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:13 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-94c11e1a-5944-4ceb-b70a-4a646a1741e6 tempest-VolumesNegativeTest-1114531016 None] <== create_volume: return (2632ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:29:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-94c11e1a-5944-4ceb-b70a-4a646a1741e6 tempest-VolumesNegativeTest-1114531016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.635s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-94c11e1a-5944-4ceb-b70a-4a646a1741e6 tempest-VolumesNegativeTest-1114531016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48e6e17d-18ff-4d48-8809-0a8198cd2dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3e10253-3e28-40ee-9e56-3c169f9e0b30', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-94c11e1a-5944-4ceb-b70a-4a646a1741e6 tempest-VolumesNegativeTest-1114531016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d54336-be19-4557-b724-914bcf2b778a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:13 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-94c11e1a-5944-4ceb-b70a-4a646a1741e6 tempest-VolumesNegativeTest-1114531016 None] Volume volume-f3e10253-3e28-40ee-9e56-3c169f9e0b30 (f3e10253-3e28-40ee-9e56-3c169f9e0b30): created successfully Jul 07 17:29:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-94c11e1a-5944-4ceb-b70a-4a646a1741e6 tempest-VolumesNegativeTest-1114531016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d54336-be19-4557-b724-914bcf2b778a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-94c11e1a-5944-4ceb-b70a-4a646a1741e6 tempest-VolumesNegativeTest-1114531016 None] Flow 'volume_create_manager' (8494719a-7c5c-4c44-9b51-ba207d43f947) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:13 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-94c11e1a-5944-4ceb-b70a-4a646a1741e6 tempest-VolumesNegativeTest-1114531016 None] Created volume successfully. Jul 07 17:29:14 devstack sudo[98268]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d3cfbc92-c52f-458e-ac78-cea19db1fc2a tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 1.082s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:14 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-d3cfbc92-c52f-458e-ac78-cea19db1fc2a tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:29:14 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-d3cfbc92-c52f-458e-ac78-cea19db1fc2a tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Deleted volume successfully. Jul 07 17:29:14 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d3cfbc92-c52f-458e-ac78-cea19db1fc2a tempest-TestServerVolumeAttachScenarioOldVersion-1659114947 None] Lock "cinder-baea686c-2893-4816-b367-afde9da42d9d-delete_volume" released by "delete_volume" :: held 3.531s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:18 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-74ebf906-c3b3-46e8-b05a-2cd1dfd8dc46 tempest-TestInstancesWithCinderVolumes-1646852817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:29:18 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-74ebf906-c3b3-46e8-b05a-2cd1dfd8dc46 tempest-TestInstancesWithCinderVolumes-1646852817 None] Flow 'volume_create_manager' (474ae82e-4568-4b80-84fe-6002e7a02e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:18 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-74ebf906-c3b3-46e8-b05a-2cd1dfd8dc46 tempest-TestInstancesWithCinderVolumes-1646852817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ef07add-2a67-4ac6-912e-809d16b2dd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:18 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-74ebf906-c3b3-46e8-b05a-2cd1dfd8dc46 tempest-TestInstancesWithCinderVolumes-1646852817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ef07add-2a67-4ac6-912e-809d16b2dd20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-581373117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78f0654b-9a17-414b-accd-e95532854069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7917198829cb4bcf92c5f555fbe1e5e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:19Z,use_quota=True,user_id='c83701e8dc4643929fa1573d4cefdb8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13e817d5-f0e4-4876-b9ba-11387fd2678e),volume_type_id=13e817d5-f0e4-4876-b9ba-11387fd2678e)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:18 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-74ebf906-c3b3-46e8-b05a-2cd1dfd8dc46 tempest-TestInstancesWithCinderVolumes-1646852817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f80271e-1778-4172-b50c-954630fe887a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:18 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-74ebf906-c3b3-46e8-b05a-2cd1dfd8dc46 tempest-TestInstancesWithCinderVolumes-1646852817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f80271e-1778-4172-b50c-954630fe887a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:18 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-74ebf906-c3b3-46e8-b05a-2cd1dfd8dc46 tempest-TestInstancesWithCinderVolumes-1646852817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f712943-eabc-4b9e-aa86-9b616e7a837d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:18 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-74ebf906-c3b3-46e8-b05a-2cd1dfd8dc46 tempest-TestInstancesWithCinderVolumes-1646852817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f712943-eabc-4b9e-aa86-9b616e7a837d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78f0654b-9a17-414b-accd-e95532854069', 'volume_name': 'volume-78f0654b-9a17-414b-accd-e95532854069', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:18 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-74ebf906-c3b3-46e8-b05a-2cd1dfd8dc46 tempest-TestInstancesWithCinderVolumes-1646852817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (112e2625-ec0c-4991-a24c-e31096f0c645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:18 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-74ebf906-c3b3-46e8-b05a-2cd1dfd8dc46 tempest-TestInstancesWithCinderVolumes-1646852817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (112e2625-ec0c-4991-a24c-e31096f0c645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:19 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-74ebf906-c3b3-46e8-b05a-2cd1dfd8dc46 tempest-TestInstancesWithCinderVolumes-1646852817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a71a941-ac67-4f2f-a4df-96411e3e5392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:19 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-74ebf906-c3b3-46e8-b05a-2cd1dfd8dc46 tempest-TestInstancesWithCinderVolumes-1646852817 None] Volume 78f0654b-9a17-414b-accd-e95532854069: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78f0654b-9a17-414b-accd-e95532854069', 'volume_size': 1} Jul 07 17:29:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-74ebf906-c3b3-46e8-b05a-2cd1dfd8dc46 tempest-TestInstancesWithCinderVolumes-1646852817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-74ebf906-c3b3-46e8-b05a-2cd1dfd8dc46 tempest-TestInstancesWithCinderVolumes-1646852817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:19 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-74ebf906-c3b3-46e8-b05a-2cd1dfd8dc46 tempest-TestInstancesWithCinderVolumes-1646852817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-581373117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78f0654b-9a17-414b-accd-e95532854069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7917198829cb4bcf92c5f555fbe1e5e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:19Z,use_quota=True,user_id='c83701e8dc4643929fa1573d4cefdb8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13e817d5-f0e4-4876-b9ba-11387fd2678e),volume_type_id=13e817d5-f0e4-4876-b9ba-11387fd2678e)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:29:19 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-74ebf906-c3b3-46e8-b05a-2cd1dfd8dc46 tempest-TestInstancesWithCinderVolumes-1646852817 None] Creating volume 78f0654b-9a17-414b-accd-e95532854069 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:29:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-74ebf906-c3b3-46e8-b05a-2cd1dfd8dc46 tempest-TestInstancesWithCinderVolumes-1646852817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-74ebf906-c3b3-46e8-b05a-2cd1dfd8dc46 tempest-TestInstancesWithCinderVolumes-1646852817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:19 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-74ebf906-c3b3-46e8-b05a-2cd1dfd8dc46 tempest-TestInstancesWithCinderVolumes-1646852817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:19 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-74ebf906-c3b3-46e8-b05a-2cd1dfd8dc46 tempest-TestInstancesWithCinderVolumes-1646852817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-74ebf906-c3b3-46e8-b05a-2cd1dfd8dc46 tempest-TestInstancesWithCinderVolumes-1646852817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:19 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-74ebf906-c3b3-46e8-b05a-2cd1dfd8dc46 tempest-TestInstancesWithCinderVolumes-1646852817 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:29:19 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-74ebf906-c3b3-46e8-b05a-2cd1dfd8dc46 tempest-TestInstancesWithCinderVolumes-1646852817 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:29:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-74ebf906-c3b3-46e8-b05a-2cd1dfd8dc46 tempest-TestInstancesWithCinderVolumes-1646852817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-78f0654b-9a17-414b-accd-e95532854069 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:19 devstack sudo[98361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-78f0654b-9a17-414b-accd-e95532854069 1073741824 Jul 07 17:29:19 devstack sudo[98361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:19 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-664a1263-b2ff-4cb2-a3c9-90bd66dc2950 tempest-TestInstancesWithCinderVolumes-1646852817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:29:19 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-664a1263-b2ff-4cb2-a3c9-90bd66dc2950 tempest-TestInstancesWithCinderVolumes-1646852817 None] Flow 'volume_create_manager' (ce8f22e4-bac7-402c-a2b6-d324bb0aedee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:19 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-664a1263-b2ff-4cb2-a3c9-90bd66dc2950 tempest-TestInstancesWithCinderVolumes-1646852817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7fa9972-1d12-434a-9c92-2c0df8d7fe95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:19 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-664a1263-b2ff-4cb2-a3c9-90bd66dc2950 tempest-TestInstancesWithCinderVolumes-1646852817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7fa9972-1d12-434a-9c92-2c0df8d7fe95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1136743873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f21ac044-33b9-4741-8eb1-588290f3615e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7917198829cb4bcf92c5f555fbe1e5e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:20Z,use_quota=True,user_id='c83701e8dc4643929fa1573d4cefdb8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c4cc1a1b-5611-4d40-835e-24549ece104d),volume_type_id=c4cc1a1b-5611-4d40-835e-24549ece104d)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:19 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-664a1263-b2ff-4cb2-a3c9-90bd66dc2950 tempest-TestInstancesWithCinderVolumes-1646852817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef7fc3b5-f4f4-43c5-b325-74cf2c24e325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:19 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-664a1263-b2ff-4cb2-a3c9-90bd66dc2950 tempest-TestInstancesWithCinderVolumes-1646852817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef7fc3b5-f4f4-43c5-b325-74cf2c24e325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:19 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-664a1263-b2ff-4cb2-a3c9-90bd66dc2950 tempest-TestInstancesWithCinderVolumes-1646852817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9be7b876-d477-4c0d-a863-915f9f01242c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:20 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-664a1263-b2ff-4cb2-a3c9-90bd66dc2950 tempest-TestInstancesWithCinderVolumes-1646852817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9be7b876-d477-4c0d-a863-915f9f01242c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f21ac044-33b9-4741-8eb1-588290f3615e', 'volume_name': 'volume-f21ac044-33b9-4741-8eb1-588290f3615e', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:20 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-664a1263-b2ff-4cb2-a3c9-90bd66dc2950 tempest-TestInstancesWithCinderVolumes-1646852817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5ee0662-fea1-41d4-b2f7-ac41260cdcee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:20 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-664a1263-b2ff-4cb2-a3c9-90bd66dc2950 tempest-TestInstancesWithCinderVolumes-1646852817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5ee0662-fea1-41d4-b2f7-ac41260cdcee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:20 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-664a1263-b2ff-4cb2-a3c9-90bd66dc2950 tempest-TestInstancesWithCinderVolumes-1646852817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5d11154-c5d1-4433-8977-683d14530064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:20 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-664a1263-b2ff-4cb2-a3c9-90bd66dc2950 tempest-TestInstancesWithCinderVolumes-1646852817 None] Volume f21ac044-33b9-4741-8eb1-588290f3615e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f21ac044-33b9-4741-8eb1-588290f3615e', 'volume_size': 1} Jul 07 17:29:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-664a1263-b2ff-4cb2-a3c9-90bd66dc2950 tempest-TestInstancesWithCinderVolumes-1646852817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:21 devstack sudo[98361]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-74ebf906-c3b3-46e8-b05a-2cd1dfd8dc46 tempest-TestInstancesWithCinderVolumes-1646852817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-78f0654b-9a17-414b-accd-e95532854069 1073741824" returned: 0 in 2.082s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:21 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:29:21 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Flow 'volume_create_manager' (1359517b-a35c-4f52-9c96-2921f87278fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:21 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12260d04-feb1-445f-8874-27d07afef63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:21 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12260d04-feb1-445f-8874-27d07afef63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1488669582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3dc9c94-4ad2-41b1-a4d0-621baf2611b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7917198829cb4bcf92c5f555fbe1e5e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:21Z,use_quota=True,user_id='c83701e8dc4643929fa1573d4cefdb8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dcde221-4ea8-4715-92b0-2f724552a845),volume_type_id=9dcde221-4ea8-4715-92b0-2f724552a845)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:21 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eab404c0-e3fb-4a77-8440-d158060885d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:21 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eab404c0-e3fb-4a77-8440-d158060885d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:21 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9426efd6-c9c6-4b56-b562-1b1812231d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:21 devstack cinder-volume[87233]: DEBUG cinder.image.glance [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Creating Keystone auth plugin from conf {{(pid=87233) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 17:29:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-74ebf906-c3b3-46e8-b05a-2cd1dfd8dc46 tempest-TestInstancesWithCinderVolumes-1646852817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-78f0654b-9a17-414b-accd-e95532854069 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:21 devstack sudo[98380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-78f0654b-9a17-414b-accd-e95532854069 Jul 07 17:29:21 devstack sudo[98380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:22 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9426efd6-c9c6-4b56-b562-1b1812231d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c3dc9c94-4ad2-41b1-a4d0-621baf2611b3', 'volume_name': 'volume-c3dc9c94-4ad2-41b1-a4d0-621baf2611b3', 'volume_size': 1, 'image_id': '73638e94-506e-4bd4-9e8c-70c6f8f75e0e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/73638e94-506e-4bd4-9e8c-70c6f8f75e0e', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2120840487', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7917198829cb4bcf92c5f555fbe1e5e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '73638e94-506e-4bd4-9e8c-70c6f8f75e0e', 'created_at': datetime.datetime(2026, 7, 7, 15, 29, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 29, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/73638e94-506e-4bd4-9e8c-70c6f8f75e0e/file', 'properties': {}}, 'image_service': }' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:22 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a348ed84-5c4b-46c8-9555-6cf9c72e9d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:22 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a348ed84-5c4b-46c8-9555-6cf9c72e9d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:22 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7073b6a-f04c-45c6-97eb-f962b0dfd869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:22 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Volume c3dc9c94-4ad2-41b1-a4d0-621baf2611b3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c3dc9c94-4ad2-41b1-a4d0-621baf2611b3', 'volume_size': 1, 'image_id': '73638e94-506e-4bd4-9e8c-70c6f8f75e0e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/73638e94-506e-4bd4-9e8c-70c6f8f75e0e', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2120840487', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7917198829cb4bcf92c5f555fbe1e5e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '73638e94-506e-4bd4-9e8c-70c6f8f75e0e', 'created_at': datetime.datetime(2026, 7, 7, 15, 29, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 29, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/73638e94-506e-4bd4-9e8c-70c6f8f75e0e/file', 'properties': {}}, 'image_service': } Jul 07 17:29:22 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Trying to clone c3dc9c94-4ad2-41b1-a4d0-621baf2611b3 from image 73638e94-506e-4bd4-9e8c-70c6f8f75e0e at location (None, [{'url': 'file:///opt/stack/data/glance/images/73638e94-506e-4bd4-9e8c-70c6f8f75e0e', 'metadata': {}}]). {{(pid=87233) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 17:29:23 devstack sudo[98380]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-74ebf906-c3b3-46e8-b05a-2cd1dfd8dc46 tempest-TestInstancesWithCinderVolumes-1646852817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-78f0654b-9a17-414b-accd-e95532854069" returned: 0 in 1.776s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:23 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-74ebf906-c3b3-46e8-b05a-2cd1dfd8dc46 tempest-TestInstancesWithCinderVolumes-1646852817 None] <== create_volume: return (4199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:29:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-74ebf906-c3b3-46e8-b05a-2cd1dfd8dc46 tempest-TestInstancesWithCinderVolumes-1646852817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.204s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-664a1263-b2ff-4cb2-a3c9-90bd66dc2950 tempest-TestInstancesWithCinderVolumes-1646852817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.172s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:23 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-664a1263-b2ff-4cb2-a3c9-90bd66dc2950 tempest-TestInstancesWithCinderVolumes-1646852817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1136743873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f21ac044-33b9-4741-8eb1-588290f3615e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7917198829cb4bcf92c5f555fbe1e5e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:20Z,use_quota=True,user_id='c83701e8dc4643929fa1573d4cefdb8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c4cc1a1b-5611-4d40-835e-24549ece104d),volume_type_id=c4cc1a1b-5611-4d40-835e-24549ece104d)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:29:23 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-664a1263-b2ff-4cb2-a3c9-90bd66dc2950 tempest-TestInstancesWithCinderVolumes-1646852817 None] Creating volume f21ac044-33b9-4741-8eb1-588290f3615e {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:29:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-664a1263-b2ff-4cb2-a3c9-90bd66dc2950 tempest-TestInstancesWithCinderVolumes-1646852817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-664a1263-b2ff-4cb2-a3c9-90bd66dc2950 tempest-TestInstancesWithCinderVolumes-1646852817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:23 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-664a1263-b2ff-4cb2-a3c9-90bd66dc2950 tempest-TestInstancesWithCinderVolumes-1646852817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:23 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-664a1263-b2ff-4cb2-a3c9-90bd66dc2950 tempest-TestInstancesWithCinderVolumes-1646852817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-664a1263-b2ff-4cb2-a3c9-90bd66dc2950 tempest-TestInstancesWithCinderVolumes-1646852817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:23 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-664a1263-b2ff-4cb2-a3c9-90bd66dc2950 tempest-TestInstancesWithCinderVolumes-1646852817 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:29:23 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-664a1263-b2ff-4cb2-a3c9-90bd66dc2950 tempest-TestInstancesWithCinderVolumes-1646852817 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:29:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-664a1263-b2ff-4cb2-a3c9-90bd66dc2950 tempest-TestInstancesWithCinderVolumes-1646852817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f21ac044-33b9-4741-8eb1-588290f3615e 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:23 devstack sudo[98404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f21ac044-33b9-4741-8eb1-588290f3615e 1073741824 Jul 07 17:29:23 devstack sudo[98404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:23 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-74ebf906-c3b3-46e8-b05a-2cd1dfd8dc46 tempest-TestInstancesWithCinderVolumes-1646852817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a71a941-ac67-4f2f-a4df-96411e3e5392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78f0654b-9a17-414b-accd-e95532854069', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:23 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-74ebf906-c3b3-46e8-b05a-2cd1dfd8dc46 tempest-TestInstancesWithCinderVolumes-1646852817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dac5611-1c24-4d30-a3ca-fb5d62268c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:23 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-74ebf906-c3b3-46e8-b05a-2cd1dfd8dc46 tempest-TestInstancesWithCinderVolumes-1646852817 None] Volume volume-78f0654b-9a17-414b-accd-e95532854069 (78f0654b-9a17-414b-accd-e95532854069): created successfully Jul 07 17:29:23 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-74ebf906-c3b3-46e8-b05a-2cd1dfd8dc46 tempest-TestInstancesWithCinderVolumes-1646852817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dac5611-1c24-4d30-a3ca-fb5d62268c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:23 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-74ebf906-c3b3-46e8-b05a-2cd1dfd8dc46 tempest-TestInstancesWithCinderVolumes-1646852817 None] Flow 'volume_create_manager' (474ae82e-4568-4b80-84fe-6002e7a02e52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:23 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-74ebf906-c3b3-46e8-b05a-2cd1dfd8dc46 tempest-TestInstancesWithCinderVolumes-1646852817 None] Created volume successfully. Jul 07 17:29:24 devstack sudo[98404]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-664a1263-b2ff-4cb2-a3c9-90bd66dc2950 tempest-TestInstancesWithCinderVolumes-1646852817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f21ac044-33b9-4741-8eb1-588290f3615e 1073741824" returned: 0 in 1.664s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-664a1263-b2ff-4cb2-a3c9-90bd66dc2950 tempest-TestInstancesWithCinderVolumes-1646852817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f21ac044-33b9-4741-8eb1-588290f3615e {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:25 devstack sudo[98411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f21ac044-33b9-4741-8eb1-588290f3615e Jul 07 17:29:25 devstack sudo[98411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:26 devstack sudo[98411]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-664a1263-b2ff-4cb2-a3c9-90bd66dc2950 tempest-TestInstancesWithCinderVolumes-1646852817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f21ac044-33b9-4741-8eb1-588290f3615e" returned: 0 in 1.241s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:26 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-664a1263-b2ff-4cb2-a3c9-90bd66dc2950 tempest-TestInstancesWithCinderVolumes-1646852817 None] <== create_volume: return (3012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:29:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-664a1263-b2ff-4cb2-a3c9-90bd66dc2950 tempest-TestInstancesWithCinderVolumes-1646852817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.015s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-664a1263-b2ff-4cb2-a3c9-90bd66dc2950 tempest-TestInstancesWithCinderVolumes-1646852817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5d11154-c5d1-4433-8977-683d14530064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f21ac044-33b9-4741-8eb1-588290f3615e', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-664a1263-b2ff-4cb2-a3c9-90bd66dc2950 tempest-TestInstancesWithCinderVolumes-1646852817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c18576b2-4345-4b8d-8ea2-3bcd6c7dda88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:26 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-664a1263-b2ff-4cb2-a3c9-90bd66dc2950 tempest-TestInstancesWithCinderVolumes-1646852817 None] Volume volume-f21ac044-33b9-4741-8eb1-588290f3615e (f21ac044-33b9-4741-8eb1-588290f3615e): created successfully Jul 07 17:29:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-664a1263-b2ff-4cb2-a3c9-90bd66dc2950 tempest-TestInstancesWithCinderVolumes-1646852817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c18576b2-4345-4b8d-8ea2-3bcd6c7dda88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-664a1263-b2ff-4cb2-a3c9-90bd66dc2950 tempest-TestInstancesWithCinderVolumes-1646852817 None] Flow 'volume_create_manager' (ce8f22e4-bac7-402c-a2b6-d324bb0aedee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:26 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-664a1263-b2ff-4cb2-a3c9-90bd66dc2950 tempest-TestInstancesWithCinderVolumes-1646852817 None] Created volume successfully. Jul 07 17:29:28 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_73638e94-506e-4bd4-9e8c-70c6f8f75e0e_8s2g4jkhdevstack@QuobyteHD, size 20.69 MB, duration 5.97 sec {{(pid=87233) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 17:29:28 devstack cinder-volume[87233]: INFO cinder.image.image_utils [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Image download 20.69 MB at 3.46 MB/s Jul 07 17:29:28 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[670a209d-40c9-4633-ab5f-26b7647cb3c4]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:29:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_73638e94-506e-4bd4-9e8c-70c6f8f75e0e_8s2g4jkhdevstack@QuobyteHD {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:28 devstack sudo[98417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_73638e94-506e-4bd4-9e8c-70c6f8f75e0e_8s2g4jkhdevstack@QuobyteHD Jul 07 17:29:28 devstack sudo[98417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:29 devstack sudo[98417]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_73638e94-506e-4bd4-9e8c-70c6f8f75e0e_8s2g4jkhdevstack@QuobyteHD" returned: 0 in 1.274s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:29 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Temporary image 73638e94-506e-4bd4-9e8c-70c6f8f75e0e is fetched for user c83701e8dc4643929fa1573d4cefdb8d. {{(pid=87233) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 17:29:29 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbd542f-42fb-4fb4-932e-63bc48838e4f]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:29:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_73638e94-506e-4bd4-9e8c-70c6f8f75e0e_8s2g4jkhdevstack@QuobyteHD {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:29 devstack sudo[98422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_73638e94-506e-4bd4-9e8c-70c6f8f75e0e_8s2g4jkhdevstack@QuobyteHD Jul 07 17:29:29 devstack sudo[98422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:31 devstack sudo[98422]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_73638e94-506e-4bd4-9e8c-70c6f8f75e0e_8s2g4jkhdevstack@QuobyteHD" returned: 0 in 1.741s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:31 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1488669582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3dc9c94-4ad2-41b1-a4d0-621baf2611b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7917198829cb4bcf92c5f555fbe1e5e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:21Z,use_quota=True,user_id='c83701e8dc4643929fa1573d4cefdb8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dcde221-4ea8-4715-92b0-2f724552a845),volume_type_id=9dcde221-4ea8-4715-92b0-2f724552a845)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:29:31 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Creating volume c3dc9c94-4ad2-41b1-a4d0-621baf2611b3 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:29:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:31 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:31 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:31 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:29:31 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:29:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c3dc9c94-4ad2-41b1-a4d0-621baf2611b3 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:31 devstack sudo[98471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c3dc9c94-4ad2-41b1-a4d0-621baf2611b3 1073741824 Jul 07 17:29:31 devstack sudo[98471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:32 devstack sudo[98471]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c3dc9c94-4ad2-41b1-a4d0-621baf2611b3 1073741824" returned: 0 in 1.352s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c3dc9c94-4ad2-41b1-a4d0-621baf2611b3 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:32 devstack sudo[98502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c3dc9c94-4ad2-41b1-a4d0-621baf2611b3 Jul 07 17:29:32 devstack sudo[98502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:33 devstack sudo[98502]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c3dc9c94-4ad2-41b1-a4d0-621baf2611b3" returned: 0 in 1.094s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:33 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] <== create_volume: return (2544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:29:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.547s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:33 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:UPDATE=49,cinder:SELECT=39,cinder:INSERT=12,cinder:DELETE=5 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:29:33 devstack cinder-volume[87233]: DEBUG cinder.volume.volume_utils [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Attempting download of 73638e94-506e-4bd4-9e8c-70c6f8f75e0e ((None, [{'url': 'file:///opt/stack/data/glance/images/73638e94-506e-4bd4-9e8c-70c6f8f75e0e', 'metadata': {}}])) to volume c3dc9c94-4ad2-41b1-a4d0-621baf2611b3. {{(pid=87233) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 17:29:34 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ccebd4-e7e6-41af-a634-a1a5bbfbe4aa]: (4, 'raw') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:29:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_73638e94-506e-4bd4-9e8c-70c6f8f75e0e_lmvvrh3p {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:34 devstack sudo[98532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_73638e94-506e-4bd4-9e8c-70c6f8f75e0e_lmvvrh3p Jul 07 17:29:34 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:35 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_73638e94-506e-4bd4-9e8c-70c6f8f75e0e_lmvvrh3p" returned: 0 in 0.984s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_73638e94-506e-4bd4-9e8c-70c6f8f75e0e_lmvvrh3p {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:35 devstack sudo[98536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_73638e94-506e-4bd4-9e8c-70c6f8f75e0e_lmvvrh3p Jul 07 17:29:35 devstack sudo[98536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:35 devstack sudo[98536]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_73638e94-506e-4bd4-9e8c-70c6f8f75e0e_lmvvrh3p" returned: 1 in 0.857s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_73638e94-506e-4bd4-9e8c-70c6f8f75e0e_lmvvrh3p' failed. Not Retrying. {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:29:35 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[57daf02f-8c41-4b40-bdd7-05095b0f68de]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:29:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_73638e94-506e-4bd4-9e8c-70c6f8f75e0e_8s2g4jkhdevstack@QuobyteHD {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:36 devstack sudo[98540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_73638e94-506e-4bd4-9e8c-70c6f8f75e0e_8s2g4jkhdevstack@QuobyteHD Jul 07 17:29:36 devstack sudo[98540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:37 devstack sudo[98540]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_73638e94-506e-4bd4-9e8c-70c6f8f75e0e_8s2g4jkhdevstack@QuobyteHD" returned: 0 in 1.180s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:37 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] 73638e94-506e-4bd4-9e8c-70c6f8f75e0e was qcow2, converting to raw {{(pid=87233) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 17:29:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_73638e94-506e-4bd4-9e8c-70c6f8f75e0e_8s2g4jkhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c3dc9c94-4ad2-41b1-a4d0-621baf2611b3 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:37 devstack sudo[98545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_73638e94-506e-4bd4-9e8c-70c6f8f75e0e_8s2g4jkhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c3dc9c94-4ad2-41b1-a4d0-621baf2611b3 Jul 07 17:29:37 devstack sudo[98545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:39 devstack sudo[98545]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_73638e94-506e-4bd4-9e8c-70c6f8f75e0e_8s2g4jkhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c3dc9c94-4ad2-41b1-a4d0-621baf2611b3" returned: 0 in 2.543s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:39 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_73638e94-506e-4bd4-9e8c-70c6f8f75e0e_8s2g4jkhdevstack@QuobyteHD, size 112.00 MB, duration 2.55 sec, destination /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c3dc9c94-4ad2-41b1-a4d0-621baf2611b3 {{(pid=87233) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:29:39 devstack cinder-volume[87233]: INFO cinder.image.image_utils [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Converted 112.00 MB image at 43.99 MB/s Jul 07 17:29:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c3dc9c94-4ad2-41b1-a4d0-621baf2611b3 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:39 devstack sudo[98577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c3dc9c94-4ad2-41b1-a4d0-621baf2611b3 1G Jul 07 17:29:39 devstack sudo[98577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:40 devstack sudo[98577]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c3dc9c94-4ad2-41b1-a4d0-621baf2611b3 1G" returned: 0 in 0.934s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:40 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b9ae9e-ea96-4684-b9a1-639ee6ac58a0]: (4, 'raw') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:29:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c3dc9c94-4ad2-41b1-a4d0-621baf2611b3 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:40 devstack sudo[98583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c3dc9c94-4ad2-41b1-a4d0-621baf2611b3 Jul 07 17:29:40 devstack sudo[98583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:41 devstack sudo[98583]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c3dc9c94-4ad2-41b1-a4d0-621baf2611b3" returned: 0 in 0.986s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c3dc9c94-4ad2-41b1-a4d0-621baf2611b3 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:41 devstack sudo[98587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c3dc9c94-4ad2-41b1-a4d0-621baf2611b3 Jul 07 17:29:41 devstack sudo[98587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:42 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:SELECT=46,cinder:UPDATE=42,cinder:INSERT=7,cinder:DELETE=3 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:29:42 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-4008e5c8-8b1e-4a57-8d84-b775a387956f tempest-CreateVolumesFromImageTest-1409410945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:29:42 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4008e5c8-8b1e-4a57-8d84-b775a387956f tempest-CreateVolumesFromImageTest-1409410945 None] Flow 'volume_create_manager' (453d226b-81a3-4590-9ff7-a05f26be5079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:42 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4008e5c8-8b1e-4a57-8d84-b775a387956f tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00a078d8-7d06-4b7d-905a-8d48577fa4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:42 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4008e5c8-8b1e-4a57-8d84-b775a387956f tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00a078d8-7d06-4b7d-905a-8d48577fa4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-372001434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cad262e8-1671-4311-b5a6-c14000a2ebd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc1e0c56ce6640ebb013674d14754e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:42Z,use_quota=True,user_id='35d407bb8e2a4ac7b7665574e5dd5a52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:42 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4008e5c8-8b1e-4a57-8d84-b775a387956f tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5645a93-07b1-4a2d-bd5c-a60cfa668283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:42 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4008e5c8-8b1e-4a57-8d84-b775a387956f tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5645a93-07b1-4a2d-bd5c-a60cfa668283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:42 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4008e5c8-8b1e-4a57-8d84-b775a387956f tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bee3dc0-e6e9-4ea8-9448-ff68be594693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:42 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4008e5c8-8b1e-4a57-8d84-b775a387956f tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bee3dc0-e6e9-4ea8-9448-ff68be594693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cad262e8-1671-4311-b5a6-c14000a2ebd3', 'volume_name': 'volume-cad262e8-1671-4311-b5a6-c14000a2ebd3', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:42 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4008e5c8-8b1e-4a57-8d84-b775a387956f tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7dc96a0-66db-4443-9bd1-6ab67b24b3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:42 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4008e5c8-8b1e-4a57-8d84-b775a387956f tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7dc96a0-66db-4443-9bd1-6ab67b24b3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:42 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4008e5c8-8b1e-4a57-8d84-b775a387956f tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6109f180-d451-426b-96a6-f4485ccedc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:42 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-4008e5c8-8b1e-4a57-8d84-b775a387956f tempest-CreateVolumesFromImageTest-1409410945 None] Volume cad262e8-1671-4311-b5a6-c14000a2ebd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cad262e8-1671-4311-b5a6-c14000a2ebd3', 'volume_size': 1} Jul 07 17:29:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4008e5c8-8b1e-4a57-8d84-b775a387956f tempest-CreateVolumesFromImageTest-1409410945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4008e5c8-8b1e-4a57-8d84-b775a387956f tempest-CreateVolumesFromImageTest-1409410945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:42 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-4008e5c8-8b1e-4a57-8d84-b775a387956f tempest-CreateVolumesFromImageTest-1409410945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-372001434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cad262e8-1671-4311-b5a6-c14000a2ebd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc1e0c56ce6640ebb013674d14754e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:42Z,use_quota=True,user_id='35d407bb8e2a4ac7b7665574e5dd5a52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:29:42 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-4008e5c8-8b1e-4a57-8d84-b775a387956f tempest-CreateVolumesFromImageTest-1409410945 None] Creating volume cad262e8-1671-4311-b5a6-c14000a2ebd3 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:29:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4008e5c8-8b1e-4a57-8d84-b775a387956f tempest-CreateVolumesFromImageTest-1409410945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4008e5c8-8b1e-4a57-8d84-b775a387956f tempest-CreateVolumesFromImageTest-1409410945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:42 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-4008e5c8-8b1e-4a57-8d84-b775a387956f tempest-CreateVolumesFromImageTest-1409410945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:42 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-4008e5c8-8b1e-4a57-8d84-b775a387956f tempest-CreateVolumesFromImageTest-1409410945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4008e5c8-8b1e-4a57-8d84-b775a387956f tempest-CreateVolumesFromImageTest-1409410945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:42 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-4008e5c8-8b1e-4a57-8d84-b775a387956f tempest-CreateVolumesFromImageTest-1409410945 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:29:42 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-4008e5c8-8b1e-4a57-8d84-b775a387956f tempest-CreateVolumesFromImageTest-1409410945 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:29:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4008e5c8-8b1e-4a57-8d84-b775a387956f tempest-CreateVolumesFromImageTest-1409410945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cad262e8-1671-4311-b5a6-c14000a2ebd3 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:42 devstack sudo[98589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cad262e8-1671-4311-b5a6-c14000a2ebd3 1073741824 Jul 07 17:29:42 devstack sudo[98589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:42 devstack sudo[98587]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:42 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e4ed32e-992e-44e4-afb0-4512f8155975 tempest-CreateVolumesFromImageTest-1409410945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:29:42 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-5e4ed32e-992e-44e4-afb0-4512f8155975 tempest-CreateVolumesFromImageTest-1409410945 None] Flow 'volume_create_manager' (21b94648-88f9-46f1-b8ec-ee1316623ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:42 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-5e4ed32e-992e-44e4-afb0-4512f8155975 tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e4c4ba1-9e73-4d68-b70a-0e99c4db114a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c3dc9c94-4ad2-41b1-a4d0-621baf2611b3" returned: 1 in 1.073s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c3dc9c94-4ad2-41b1-a4d0-621baf2611b3' failed. Not Retrying. {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:29:42 devstack cinder-volume[87233]: DEBUG cinder.volume.volume_utils [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Downloaded image 73638e94-506e-4bd4-9e8c-70c6f8f75e0e ((None, [{'url': 'file:///opt/stack/data/glance/images/73638e94-506e-4bd4-9e8c-70c6f8f75e0e', 'metadata': {}}])) to volume c3dc9c94-4ad2-41b1-a4d0-621baf2611b3 successfully. {{(pid=87233) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 17:29:42 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Temporary image 73638e94-506e-4bd4-9e8c-70c6f8f75e0e for user c83701e8dc4643929fa1573d4cefdb8d is deleted. {{(pid=87233) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 17:29:42 devstack cinder-volume[87233]: DEBUG cinder.volume.volume_utils [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Marking volume c3dc9c94-4ad2-41b1-a4d0-621baf2611b3 as bootable. {{(pid=87233) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 17:29:42 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-5e4ed32e-992e-44e4-afb0-4512f8155975 tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e4c4ba1-9e73-4d68-b70a-0e99c4db114a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1866668825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af134ccc-7d08-49d1-af95-9c486104ac5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc1e0c56ce6640ebb013674d14754e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:43Z,use_quota=True,user_id='35d407bb8e2a4ac7b7665574e5dd5a52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:42 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-5e4ed32e-992e-44e4-afb0-4512f8155975 tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3d7fbf0-7b30-42cb-9a61-0d87c9d21798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:42 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-5e4ed32e-992e-44e4-afb0-4512f8155975 tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3d7fbf0-7b30-42cb-9a61-0d87c9d21798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:42 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-5e4ed32e-992e-44e4-afb0-4512f8155975 tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8149a54b-f32e-46f7-afea-ccea208bf128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:42 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-5e4ed32e-992e-44e4-afb0-4512f8155975 tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8149a54b-f32e-46f7-afea-ccea208bf128) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af134ccc-7d08-49d1-af95-9c486104ac5a', 'volume_name': 'volume-af134ccc-7d08-49d1-af95-9c486104ac5a', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:42 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-5e4ed32e-992e-44e4-afb0-4512f8155975 tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b63ebd39-4f23-4bcf-be4e-95b943939389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:42 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-5e4ed32e-992e-44e4-afb0-4512f8155975 tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b63ebd39-4f23-4bcf-be4e-95b943939389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:42 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-5e4ed32e-992e-44e4-afb0-4512f8155975 tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da702dd9-072f-42cb-ad22-2bf4d802d276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:42 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-5e4ed32e-992e-44e4-afb0-4512f8155975 tempest-CreateVolumesFromImageTest-1409410945 None] Volume af134ccc-7d08-49d1-af95-9c486104ac5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af134ccc-7d08-49d1-af95-9c486104ac5a', 'volume_size': 1} Jul 07 17:29:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-5e4ed32e-992e-44e4-afb0-4512f8155975 tempest-CreateVolumesFromImageTest-1409410945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:42 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Copying metadata from image 73638e94-506e-4bd4-9e8c-70c6f8f75e0e to c3dc9c94-4ad2-41b1-a4d0-621baf2611b3. {{(pid=87233) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 17:29:42 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Creating volume glance metadata for volume c3dc9c94-4ad2-41b1-a4d0-621baf2611b3 backed by image 73638e94-506e-4bd4-9e8c-70c6f8f75e0e with: {'image_id': '73638e94-506e-4bd4-9e8c-70c6f8f75e0e', 'image_name': 'tempest-scenario-img--2120840487', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87233) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 17:29:42 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7073b6a-f04c-45c6-97eb-f962b0dfd869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3dc9c94-4ad2-41b1-a4d0-621baf2611b3', 'volume_size': 1, 'image_id': '73638e94-506e-4bd4-9e8c-70c6f8f75e0e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/73638e94-506e-4bd4-9e8c-70c6f8f75e0e', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2120840487', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7917198829cb4bcf92c5f555fbe1e5e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '73638e94-506e-4bd4-9e8c-70c6f8f75e0e', 'created_at': datetime.datetime(2026, 7, 7, 15, 29, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 29, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/73638e94-506e-4bd4-9e8c-70c6f8f75e0e/file', 'properties': {}}, 'image_service': }' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:42 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcbc213b-ec1b-4234-a88b-7f0f45ae2ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:42 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Volume volume-c3dc9c94-4ad2-41b1-a4d0-621baf2611b3 (c3dc9c94-4ad2-41b1-a4d0-621baf2611b3): created successfully Jul 07 17:29:42 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcbc213b-ec1b-4234-a88b-7f0f45ae2ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:42 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Flow 'volume_create_manager' (1359517b-a35c-4f52-9c96-2921f87278fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:42 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-23efacdd-4429-4716-b67f-c5ec1555816f tempest-TestInstancesWithCinderVolumes-1646852817 None] Created volume successfully. Jul 07 17:29:43 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe77a322-d04d-4202-b414-3411e4f39b3f tempest-CreateVolumesFromImageTest-1409410945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:29:43 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fe77a322-d04d-4202-b414-3411e4f39b3f tempest-CreateVolumesFromImageTest-1409410945 None] Flow 'volume_create_manager' (41170fdc-de8f-45f4-b654-af652d8e19f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:43 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fe77a322-d04d-4202-b414-3411e4f39b3f tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9513f589-bd75-41ed-b6bc-339730f9bb8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:43 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fe77a322-d04d-4202-b414-3411e4f39b3f tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9513f589-bd75-41ed-b6bc-339730f9bb8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1525056857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43be39f0-b776-4f7c-9e0c-82072c34fbd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc1e0c56ce6640ebb013674d14754e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:43Z,use_quota=True,user_id='35d407bb8e2a4ac7b7665574e5dd5a52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:43 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fe77a322-d04d-4202-b414-3411e4f39b3f tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de0d2632-797b-4490-b0a7-fe86fbac419d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:43 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fe77a322-d04d-4202-b414-3411e4f39b3f tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de0d2632-797b-4490-b0a7-fe86fbac419d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:43 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fe77a322-d04d-4202-b414-3411e4f39b3f tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b501fb8f-5cae-4f6b-9bd6-0cc932478dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:43 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fe77a322-d04d-4202-b414-3411e4f39b3f tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b501fb8f-5cae-4f6b-9bd6-0cc932478dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43be39f0-b776-4f7c-9e0c-82072c34fbd2', 'volume_name': 'volume-43be39f0-b776-4f7c-9e0c-82072c34fbd2', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:43 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fe77a322-d04d-4202-b414-3411e4f39b3f tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7083b3b-9614-45b3-9028-34aeba86e956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:43 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fe77a322-d04d-4202-b414-3411e4f39b3f tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7083b3b-9614-45b3-9028-34aeba86e956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:43 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fe77a322-d04d-4202-b414-3411e4f39b3f tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd45e582-3b29-49a1-9dcc-8568cb88b02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:43 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-fe77a322-d04d-4202-b414-3411e4f39b3f tempest-CreateVolumesFromImageTest-1409410945 None] Volume 43be39f0-b776-4f7c-9e0c-82072c34fbd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43be39f0-b776-4f7c-9e0c-82072c34fbd2', 'volume_size': 1} Jul 07 17:29:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-fe77a322-d04d-4202-b414-3411e4f39b3f tempest-CreateVolumesFromImageTest-1409410945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:43 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:29:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:43 devstack sudo[98589]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4008e5c8-8b1e-4a57-8d84-b775a387956f tempest-CreateVolumesFromImageTest-1409410945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cad262e8-1671-4311-b5a6-c14000a2ebd3 1073741824" returned: 0 in 1.108s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:43 devstack sudo[98598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:29:43 devstack sudo[98598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4008e5c8-8b1e-4a57-8d84-b775a387956f tempest-CreateVolumesFromImageTest-1409410945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cad262e8-1671-4311-b5a6-c14000a2ebd3 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:43 devstack sudo[98600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cad262e8-1671-4311-b5a6-c14000a2ebd3 Jul 07 17:29:43 devstack sudo[98600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:43 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6ae9150-f277-4206-a11a-e26aea677b5a tempest-CreateVolumesFromImageTest-1409410945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:29:43 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e6ae9150-f277-4206-a11a-e26aea677b5a tempest-CreateVolumesFromImageTest-1409410945 None] Flow 'volume_create_manager' (fb7bae83-3817-4dfa-a399-166d0a73120a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:43 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e6ae9150-f277-4206-a11a-e26aea677b5a tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (949b8f7b-df8b-4ac1-a43c-7d675186fcea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:43 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e6ae9150-f277-4206-a11a-e26aea677b5a tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (949b8f7b-df8b-4ac1-a43c-7d675186fcea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-82051800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4826ed0c-38fe-4b54-b774-c706fe81540c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc1e0c56ce6640ebb013674d14754e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:43Z,use_quota=True,user_id='35d407bb8e2a4ac7b7665574e5dd5a52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:43 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e6ae9150-f277-4206-a11a-e26aea677b5a tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38d3c40d-ed3a-4629-86a0-ea6fc1f8d554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:43 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e6ae9150-f277-4206-a11a-e26aea677b5a tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38d3c40d-ed3a-4629-86a0-ea6fc1f8d554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:43 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e6ae9150-f277-4206-a11a-e26aea677b5a tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fdbe9aa-a498-49ae-a261-5c062090feae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:43 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e6ae9150-f277-4206-a11a-e26aea677b5a tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fdbe9aa-a498-49ae-a261-5c062090feae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4826ed0c-38fe-4b54-b774-c706fe81540c', 'volume_name': 'volume-4826ed0c-38fe-4b54-b774-c706fe81540c', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:43 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e6ae9150-f277-4206-a11a-e26aea677b5a tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51815fc8-e7f3-4c63-a571-5cb116dc6ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:43 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e6ae9150-f277-4206-a11a-e26aea677b5a tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51815fc8-e7f3-4c63-a571-5cb116dc6ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:43 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e6ae9150-f277-4206-a11a-e26aea677b5a tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9ef4821-7508-49af-884e-8cd684c4bbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:43 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-e6ae9150-f277-4206-a11a-e26aea677b5a tempest-CreateVolumesFromImageTest-1409410945 None] Volume 4826ed0c-38fe-4b54-b774-c706fe81540c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4826ed0c-38fe-4b54-b774-c706fe81540c', 'volume_size': 1} Jul 07 17:29:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e6ae9150-f277-4206-a11a-e26aea677b5a tempest-CreateVolumesFromImageTest-1409410945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:44 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8ec76aa-ddba-4145-9e0f-5e768b7ce502 tempest-CreateVolumesFromImageTest-1409410945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:29:44 devstack sudo[98598]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f8ec76aa-ddba-4145-9e0f-5e768b7ce502 tempest-CreateVolumesFromImageTest-1409410945 None] Flow 'volume_create_manager' (7e59830a-752f-4e1b-8bf7-d582c7d43d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f8ec76aa-ddba-4145-9e0f-5e768b7ce502 tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3457e6cd-3145-48c6-8436-158b8e28e238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 1.184s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:44 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:29:44 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:29:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread count: 28 {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:29:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread info: [<_MainThread(MainThread, started 126077716062336)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:29:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f8ec76aa-ddba-4145-9e0f-5e768b7ce502 tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3457e6cd-3145-48c6-8436-158b8e28e238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1892116382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=728b39c6-b4b6-4432-b93a-f99a7ac4b95e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc1e0c56ce6640ebb013674d14754e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:44Z,use_quota=True,user_id='35d407bb8e2a4ac7b7665574e5dd5a52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f8ec76aa-ddba-4145-9e0f-5e768b7ce502 tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a58af0b7-d943-45de-bb8b-9884fc02a541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:44 devstack sudo[98600]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f8ec76aa-ddba-4145-9e0f-5e768b7ce502 tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a58af0b7-d943-45de-bb8b-9884fc02a541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f8ec76aa-ddba-4145-9e0f-5e768b7ce502 tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89fa21d8-1ac7-4a5b-ad37-a935205291e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f8ec76aa-ddba-4145-9e0f-5e768b7ce502 tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89fa21d8-1ac7-4a5b-ad37-a935205291e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '728b39c6-b4b6-4432-b93a-f99a7ac4b95e', 'volume_name': 'volume-728b39c6-b4b6-4432-b93a-f99a7ac4b95e', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f8ec76aa-ddba-4145-9e0f-5e768b7ce502 tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f74b4a0-15e3-43cb-97a5-050e53a26cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f8ec76aa-ddba-4145-9e0f-5e768b7ce502 tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f74b4a0-15e3-43cb-97a5-050e53a26cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f8ec76aa-ddba-4145-9e0f-5e768b7ce502 tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8c2faf6-b21c-4aa9-97cb-56da4e0162b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:44 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-f8ec76aa-ddba-4145-9e0f-5e768b7ce502 tempest-CreateVolumesFromImageTest-1409410945 None] Volume 728b39c6-b4b6-4432-b93a-f99a7ac4b95e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-728b39c6-b4b6-4432-b93a-f99a7ac4b95e', 'volume_size': 1} Jul 07 17:29:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f8ec76aa-ddba-4145-9e0f-5e768b7ce502 tempest-CreateVolumesFromImageTest-1409410945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4008e5c8-8b1e-4a57-8d84-b775a387956f tempest-CreateVolumesFromImageTest-1409410945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cad262e8-1671-4311-b5a6-c14000a2ebd3" returned: 0 in 1.133s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:44 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-4008e5c8-8b1e-4a57-8d84-b775a387956f tempest-CreateVolumesFromImageTest-1409410945 None] <== create_volume: return (2326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:29:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4008e5c8-8b1e-4a57-8d84-b775a387956f tempest-CreateVolumesFromImageTest-1409410945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.329s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-5e4ed32e-992e-44e4-afb0-4512f8155975 tempest-CreateVolumesFromImageTest-1409410945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.844s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:44 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-5e4ed32e-992e-44e4-afb0-4512f8155975 tempest-CreateVolumesFromImageTest-1409410945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1866668825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af134ccc-7d08-49d1-af95-9c486104ac5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc1e0c56ce6640ebb013674d14754e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:43Z,use_quota=True,user_id='35d407bb8e2a4ac7b7665574e5dd5a52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:29:44 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-5e4ed32e-992e-44e4-afb0-4512f8155975 tempest-CreateVolumesFromImageTest-1409410945 None] Creating volume af134ccc-7d08-49d1-af95-9c486104ac5a {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:29:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-5e4ed32e-992e-44e4-afb0-4512f8155975 tempest-CreateVolumesFromImageTest-1409410945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-5e4ed32e-992e-44e4-afb0-4512f8155975 tempest-CreateVolumesFromImageTest-1409410945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:44 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-5e4ed32e-992e-44e4-afb0-4512f8155975 tempest-CreateVolumesFromImageTest-1409410945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:44 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-5e4ed32e-992e-44e4-afb0-4512f8155975 tempest-CreateVolumesFromImageTest-1409410945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-5e4ed32e-992e-44e4-afb0-4512f8155975 tempest-CreateVolumesFromImageTest-1409410945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:44 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-5e4ed32e-992e-44e4-afb0-4512f8155975 tempest-CreateVolumesFromImageTest-1409410945 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:29:44 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-5e4ed32e-992e-44e4-afb0-4512f8155975 tempest-CreateVolumesFromImageTest-1409410945 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:29:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5e4ed32e-992e-44e4-afb0-4512f8155975 tempest-CreateVolumesFromImageTest-1409410945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-af134ccc-7d08-49d1-af95-9c486104ac5a 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4008e5c8-8b1e-4a57-8d84-b775a387956f tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6109f180-d451-426b-96a6-f4485ccedc1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cad262e8-1671-4311-b5a6-c14000a2ebd3', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4008e5c8-8b1e-4a57-8d84-b775a387956f tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3b7cfb0-1cf4-46dd-9325-1e9a0559e9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:44 devstack sudo[98604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-af134ccc-7d08-49d1-af95-9c486104ac5a 1073741824 Jul 07 17:29:44 devstack sudo[98604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:44 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-4008e5c8-8b1e-4a57-8d84-b775a387956f tempest-CreateVolumesFromImageTest-1409410945 None] Volume volume-cad262e8-1671-4311-b5a6-c14000a2ebd3 (cad262e8-1671-4311-b5a6-c14000a2ebd3): created successfully Jul 07 17:29:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4008e5c8-8b1e-4a57-8d84-b775a387956f tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3b7cfb0-1cf4-46dd-9325-1e9a0559e9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4008e5c8-8b1e-4a57-8d84-b775a387956f tempest-CreateVolumesFromImageTest-1409410945 None] Flow 'volume_create_manager' (453d226b-81a3-4590-9ff7-a05f26be5079) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:44 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-4008e5c8-8b1e-4a57-8d84-b775a387956f tempest-CreateVolumesFromImageTest-1409410945 None] Created volume successfully. Jul 07 17:29:45 devstack sudo[98604]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5e4ed32e-992e-44e4-afb0-4512f8155975 tempest-CreateVolumesFromImageTest-1409410945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-af134ccc-7d08-49d1-af95-9c486104ac5a 1073741824" returned: 0 in 1.046s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5e4ed32e-992e-44e4-afb0-4512f8155975 tempest-CreateVolumesFromImageTest-1409410945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-af134ccc-7d08-49d1-af95-9c486104ac5a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:45 devstack sudo[98613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-af134ccc-7d08-49d1-af95-9c486104ac5a Jul 07 17:29:45 devstack sudo[98613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:46 devstack sudo[98613]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5e4ed32e-992e-44e4-afb0-4512f8155975 tempest-CreateVolumesFromImageTest-1409410945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-af134ccc-7d08-49d1-af95-9c486104ac5a" returned: 0 in 0.762s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:46 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-5e4ed32e-992e-44e4-afb0-4512f8155975 tempest-CreateVolumesFromImageTest-1409410945 None] <== create_volume: return (1857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:29:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-5e4ed32e-992e-44e4-afb0-4512f8155975 tempest-CreateVolumesFromImageTest-1409410945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.861s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-fe77a322-d04d-4202-b414-3411e4f39b3f tempest-CreateVolumesFromImageTest-1409410945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.283s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:46 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-fe77a322-d04d-4202-b414-3411e4f39b3f tempest-CreateVolumesFromImageTest-1409410945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1525056857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43be39f0-b776-4f7c-9e0c-82072c34fbd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc1e0c56ce6640ebb013674d14754e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:43Z,use_quota=True,user_id='35d407bb8e2a4ac7b7665574e5dd5a52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:29:46 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-fe77a322-d04d-4202-b414-3411e4f39b3f tempest-CreateVolumesFromImageTest-1409410945 None] Creating volume 43be39f0-b776-4f7c-9e0c-82072c34fbd2 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:29:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-fe77a322-d04d-4202-b414-3411e4f39b3f tempest-CreateVolumesFromImageTest-1409410945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-fe77a322-d04d-4202-b414-3411e4f39b3f tempest-CreateVolumesFromImageTest-1409410945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:46 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-fe77a322-d04d-4202-b414-3411e4f39b3f tempest-CreateVolumesFromImageTest-1409410945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:46 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-fe77a322-d04d-4202-b414-3411e4f39b3f tempest-CreateVolumesFromImageTest-1409410945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-fe77a322-d04d-4202-b414-3411e4f39b3f tempest-CreateVolumesFromImageTest-1409410945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:46 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-fe77a322-d04d-4202-b414-3411e4f39b3f tempest-CreateVolumesFromImageTest-1409410945 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:29:46 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-fe77a322-d04d-4202-b414-3411e4f39b3f tempest-CreateVolumesFromImageTest-1409410945 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:29:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fe77a322-d04d-4202-b414-3411e4f39b3f tempest-CreateVolumesFromImageTest-1409410945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-43be39f0-b776-4f7c-9e0c-82072c34fbd2 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:46 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-5e4ed32e-992e-44e4-afb0-4512f8155975 tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da702dd9-072f-42cb-ad22-2bf4d802d276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af134ccc-7d08-49d1-af95-9c486104ac5a', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:46 devstack sudo[98618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-43be39f0-b776-4f7c-9e0c-82072c34fbd2 1073741824 Jul 07 17:29:46 devstack sudo[98618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:46 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-5e4ed32e-992e-44e4-afb0-4512f8155975 tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e5bfd1c-c861-4267-b3f4-e62eb1d36d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:46 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-5e4ed32e-992e-44e4-afb0-4512f8155975 tempest-CreateVolumesFromImageTest-1409410945 None] Volume volume-af134ccc-7d08-49d1-af95-9c486104ac5a (af134ccc-7d08-49d1-af95-9c486104ac5a): created successfully Jul 07 17:29:46 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-5e4ed32e-992e-44e4-afb0-4512f8155975 tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e5bfd1c-c861-4267-b3f4-e62eb1d36d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:46 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-5e4ed32e-992e-44e4-afb0-4512f8155975 tempest-CreateVolumesFromImageTest-1409410945 None] Flow 'volume_create_manager' (21b94648-88f9-46f1-b8ec-ee1316623ffe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:46 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-5e4ed32e-992e-44e4-afb0-4512f8155975 tempest-CreateVolumesFromImageTest-1409410945 None] Created volume successfully. Jul 07 17:29:47 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-6572e740-ca95-4f84-867f-160f64d2307b tempest-AttachVolumeNegativeTest-1224056977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:29:47 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-6572e740-ca95-4f84-867f-160f64d2307b tempest-AttachVolumeNegativeTest-1224056977 None] Flow 'volume_create_manager' (cd53ffe0-3213-4e6d-abff-3fd8449bff73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:47 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-6572e740-ca95-4f84-867f-160f64d2307b tempest-AttachVolumeNegativeTest-1224056977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b24b446f-c83c-4fc1-a0af-65ddc73541c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:47 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-6572e740-ca95-4f84-867f-160f64d2307b tempest-AttachVolumeNegativeTest-1224056977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b24b446f-c83c-4fc1-a0af-65ddc73541c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-344013243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78683c41-bf46-4ed3-be9c-1636352dac4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='796ca6dac1614b198cf7645ae5f214d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:47Z,use_quota=True,user_id='9a53ffa5a72b41cab5f1a6dbcfee9d66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:47 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-6572e740-ca95-4f84-867f-160f64d2307b tempest-AttachVolumeNegativeTest-1224056977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e631794b-09af-4aff-b3ac-a24eff9b29df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:47 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-6572e740-ca95-4f84-867f-160f64d2307b tempest-AttachVolumeNegativeTest-1224056977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e631794b-09af-4aff-b3ac-a24eff9b29df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:47 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-6572e740-ca95-4f84-867f-160f64d2307b tempest-AttachVolumeNegativeTest-1224056977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59329c0b-0959-4093-9de2-056d84a248ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:47 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-6572e740-ca95-4f84-867f-160f64d2307b tempest-AttachVolumeNegativeTest-1224056977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59329c0b-0959-4093-9de2-056d84a248ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78683c41-bf46-4ed3-be9c-1636352dac4e', 'volume_name': 'volume-78683c41-bf46-4ed3-be9c-1636352dac4e', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:47 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-6572e740-ca95-4f84-867f-160f64d2307b tempest-AttachVolumeNegativeTest-1224056977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8df7a2a7-aea2-4c94-b96c-f936b4f6f2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:47 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-6572e740-ca95-4f84-867f-160f64d2307b tempest-AttachVolumeNegativeTest-1224056977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8df7a2a7-aea2-4c94-b96c-f936b4f6f2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:47 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-6572e740-ca95-4f84-867f-160f64d2307b tempest-AttachVolumeNegativeTest-1224056977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9ddf1b1-f9ff-4061-b44a-40167680cfc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:47 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-6572e740-ca95-4f84-867f-160f64d2307b tempest-AttachVolumeNegativeTest-1224056977 None] Volume 78683c41-bf46-4ed3-be9c-1636352dac4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78683c41-bf46-4ed3-be9c-1636352dac4e', 'volume_size': 1} Jul 07 17:29:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-6572e740-ca95-4f84-867f-160f64d2307b tempest-AttachVolumeNegativeTest-1224056977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:47 devstack sudo[98618]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fe77a322-d04d-4202-b414-3411e4f39b3f tempest-CreateVolumesFromImageTest-1409410945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-43be39f0-b776-4f7c-9e0c-82072c34fbd2 1073741824" returned: 0 in 1.073s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fe77a322-d04d-4202-b414-3411e4f39b3f tempest-CreateVolumesFromImageTest-1409410945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-43be39f0-b776-4f7c-9e0c-82072c34fbd2 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:47 devstack sudo[98625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-43be39f0-b776-4f7c-9e0c-82072c34fbd2 Jul 07 17:29:47 devstack sudo[98625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:48 devstack sudo[98625]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fe77a322-d04d-4202-b414-3411e4f39b3f tempest-CreateVolumesFromImageTest-1409410945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-43be39f0-b776-4f7c-9e0c-82072c34fbd2" returned: 0 in 0.717s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:48 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-fe77a322-d04d-4202-b414-3411e4f39b3f tempest-CreateVolumesFromImageTest-1409410945 None] <== create_volume: return (1852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:29:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-fe77a322-d04d-4202-b414-3411e4f39b3f tempest-CreateVolumesFromImageTest-1409410945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.858s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e6ae9150-f277-4206-a11a-e26aea677b5a tempest-CreateVolumesFromImageTest-1409410945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.644s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:48 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-e6ae9150-f277-4206-a11a-e26aea677b5a tempest-CreateVolumesFromImageTest-1409410945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-82051800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4826ed0c-38fe-4b54-b774-c706fe81540c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc1e0c56ce6640ebb013674d14754e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:43Z,use_quota=True,user_id='35d407bb8e2a4ac7b7665574e5dd5a52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:29:48 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-e6ae9150-f277-4206-a11a-e26aea677b5a tempest-CreateVolumesFromImageTest-1409410945 None] Creating volume 4826ed0c-38fe-4b54-b774-c706fe81540c {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:29:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e6ae9150-f277-4206-a11a-e26aea677b5a tempest-CreateVolumesFromImageTest-1409410945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e6ae9150-f277-4206-a11a-e26aea677b5a tempest-CreateVolumesFromImageTest-1409410945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:48 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-e6ae9150-f277-4206-a11a-e26aea677b5a tempest-CreateVolumesFromImageTest-1409410945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:48 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-e6ae9150-f277-4206-a11a-e26aea677b5a tempest-CreateVolumesFromImageTest-1409410945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e6ae9150-f277-4206-a11a-e26aea677b5a tempest-CreateVolumesFromImageTest-1409410945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:48 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-e6ae9150-f277-4206-a11a-e26aea677b5a tempest-CreateVolumesFromImageTest-1409410945 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:29:48 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-e6ae9150-f277-4206-a11a-e26aea677b5a tempest-CreateVolumesFromImageTest-1409410945 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:29:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e6ae9150-f277-4206-a11a-e26aea677b5a tempest-CreateVolumesFromImageTest-1409410945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4826ed0c-38fe-4b54-b774-c706fe81540c 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:48 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fe77a322-d04d-4202-b414-3411e4f39b3f tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd45e582-3b29-49a1-9dcc-8568cb88b02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43be39f0-b776-4f7c-9e0c-82072c34fbd2', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:48 devstack sudo[98628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4826ed0c-38fe-4b54-b774-c706fe81540c 1073741824 Jul 07 17:29:48 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fe77a322-d04d-4202-b414-3411e4f39b3f tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (732be1df-1bcf-41dd-9b84-370d39eadcda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:48 devstack sudo[98628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:48 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-fe77a322-d04d-4202-b414-3411e4f39b3f tempest-CreateVolumesFromImageTest-1409410945 None] Volume volume-43be39f0-b776-4f7c-9e0c-82072c34fbd2 (43be39f0-b776-4f7c-9e0c-82072c34fbd2): created successfully Jul 07 17:29:48 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fe77a322-d04d-4202-b414-3411e4f39b3f tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (732be1df-1bcf-41dd-9b84-370d39eadcda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:48 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fe77a322-d04d-4202-b414-3411e4f39b3f tempest-CreateVolumesFromImageTest-1409410945 None] Flow 'volume_create_manager' (41170fdc-de8f-45f4-b654-af652d8e19f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:48 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-fe77a322-d04d-4202-b414-3411e4f39b3f tempest-CreateVolumesFromImageTest-1409410945 None] Created volume successfully. Jul 07 17:29:49 devstack sudo[98628]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e6ae9150-f277-4206-a11a-e26aea677b5a tempest-CreateVolumesFromImageTest-1409410945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4826ed0c-38fe-4b54-b774-c706fe81540c 1073741824" returned: 0 in 0.996s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e6ae9150-f277-4206-a11a-e26aea677b5a tempest-CreateVolumesFromImageTest-1409410945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4826ed0c-38fe-4b54-b774-c706fe81540c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:49 devstack sudo[98634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4826ed0c-38fe-4b54-b774-c706fe81540c Jul 07 17:29:49 devstack sudo[98634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:50 devstack sudo[98634]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e6ae9150-f277-4206-a11a-e26aea677b5a tempest-CreateVolumesFromImageTest-1409410945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4826ed0c-38fe-4b54-b774-c706fe81540c" returned: 0 in 0.723s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:50 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-e6ae9150-f277-4206-a11a-e26aea677b5a tempest-CreateVolumesFromImageTest-1409410945 None] <== create_volume: return (1780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:29:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e6ae9150-f277-4206-a11a-e26aea677b5a tempest-CreateVolumesFromImageTest-1409410945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.782s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f8ec76aa-ddba-4145-9e0f-5e768b7ce502 tempest-CreateVolumesFromImageTest-1409410945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.522s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:50 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-f8ec76aa-ddba-4145-9e0f-5e768b7ce502 tempest-CreateVolumesFromImageTest-1409410945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1892116382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=728b39c6-b4b6-4432-b93a-f99a7ac4b95e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc1e0c56ce6640ebb013674d14754e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:44Z,use_quota=True,user_id='35d407bb8e2a4ac7b7665574e5dd5a52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:29:50 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-f8ec76aa-ddba-4145-9e0f-5e768b7ce502 tempest-CreateVolumesFromImageTest-1409410945 None] Creating volume 728b39c6-b4b6-4432-b93a-f99a7ac4b95e {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:29:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f8ec76aa-ddba-4145-9e0f-5e768b7ce502 tempest-CreateVolumesFromImageTest-1409410945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f8ec76aa-ddba-4145-9e0f-5e768b7ce502 tempest-CreateVolumesFromImageTest-1409410945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:50 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-f8ec76aa-ddba-4145-9e0f-5e768b7ce502 tempest-CreateVolumesFromImageTest-1409410945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:50 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-f8ec76aa-ddba-4145-9e0f-5e768b7ce502 tempest-CreateVolumesFromImageTest-1409410945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f8ec76aa-ddba-4145-9e0f-5e768b7ce502 tempest-CreateVolumesFromImageTest-1409410945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:50 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-f8ec76aa-ddba-4145-9e0f-5e768b7ce502 tempest-CreateVolumesFromImageTest-1409410945 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:29:50 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-f8ec76aa-ddba-4145-9e0f-5e768b7ce502 tempest-CreateVolumesFromImageTest-1409410945 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:29:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f8ec76aa-ddba-4145-9e0f-5e768b7ce502 tempest-CreateVolumesFromImageTest-1409410945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-728b39c6-b4b6-4432-b93a-f99a7ac4b95e 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:50 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e6ae9150-f277-4206-a11a-e26aea677b5a tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9ef4821-7508-49af-884e-8cd684c4bbc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4826ed0c-38fe-4b54-b774-c706fe81540c', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:50 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e6ae9150-f277-4206-a11a-e26aea677b5a tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31a606b6-9460-4177-b289-fe0d98f3e95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:50 devstack sudo[98639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-728b39c6-b4b6-4432-b93a-f99a7ac4b95e 1073741824 Jul 07 17:29:50 devstack sudo[98639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:50 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-e6ae9150-f277-4206-a11a-e26aea677b5a tempest-CreateVolumesFromImageTest-1409410945 None] Volume volume-4826ed0c-38fe-4b54-b774-c706fe81540c (4826ed0c-38fe-4b54-b774-c706fe81540c): created successfully Jul 07 17:29:50 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e6ae9150-f277-4206-a11a-e26aea677b5a tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31a606b6-9460-4177-b289-fe0d98f3e95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:50 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e6ae9150-f277-4206-a11a-e26aea677b5a tempest-CreateVolumesFromImageTest-1409410945 None] Flow 'volume_create_manager' (fb7bae83-3817-4dfa-a399-166d0a73120a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:50 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-e6ae9150-f277-4206-a11a-e26aea677b5a tempest-CreateVolumesFromImageTest-1409410945 None] Created volume successfully. Jul 07 17:29:51 devstack sudo[98639]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f8ec76aa-ddba-4145-9e0f-5e768b7ce502 tempest-CreateVolumesFromImageTest-1409410945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-728b39c6-b4b6-4432-b93a-f99a7ac4b95e 1073741824" returned: 0 in 1.294s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f8ec76aa-ddba-4145-9e0f-5e768b7ce502 tempest-CreateVolumesFromImageTest-1409410945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-728b39c6-b4b6-4432-b93a-f99a7ac4b95e {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:51 devstack sudo[98653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-728b39c6-b4b6-4432-b93a-f99a7ac4b95e Jul 07 17:29:51 devstack sudo[98653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:51 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-19ac4bbc-c66f-4e10-b510-1bc1a4ea8f18 tempest-VolumesNegativeTest-1114531016 None] Acquiring lock "cinder-f3e10253-3e28-40ee-9e56-3c169f9e0b30-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-d07b1dd0-8b39-4766-8ed4-bda20b7b4d42 req-7ef6b8f9-5656-4266-a8b7-19e9d6037454 tempest-TestInstancesWithCinderVolumes-1646852817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:51 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-19ac4bbc-c66f-4e10-b510-1bc1a4ea8f18 tempest-VolumesNegativeTest-1114531016 None] Lock "cinder-f3e10253-3e28-40ee-9e56-3c169f9e0b30-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:52 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-19ac4bbc-c66f-4e10-b510-1bc1a4ea8f18 tempest-VolumesNegativeTest-1114531016 None] Acquiring lock "cinder-quobyte-f3e10253-3e28-40ee-9e56-3c169f9e0b30" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:52 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-19ac4bbc-c66f-4e10-b510-1bc1a4ea8f18 tempest-VolumesNegativeTest-1114531016 None] Lock "cinder-quobyte-f3e10253-3e28-40ee-9e56-3c169f9e0b30" acquired by "delete_volume" :: waited 0.022s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:52 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa65e95-b074-48ce-9022-f3ed83472c4e]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:29:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-19ac4bbc-c66f-4e10-b510-1bc1a4ea8f18 tempest-VolumesNegativeTest-1114531016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f3e10253-3e28-40ee-9e56-3c169f9e0b30 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:52 devstack sudo[98667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f3e10253-3e28-40ee-9e56-3c169f9e0b30 Jul 07 17:29:52 devstack sudo[98667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:52 devstack sudo[98653]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f8ec76aa-ddba-4145-9e0f-5e768b7ce502 tempest-CreateVolumesFromImageTest-1409410945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-728b39c6-b4b6-4432-b93a-f99a7ac4b95e" returned: 0 in 0.905s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:52 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-f8ec76aa-ddba-4145-9e0f-5e768b7ce502 tempest-CreateVolumesFromImageTest-1409410945 None] <== create_volume: return (2312ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:29:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f8ec76aa-ddba-4145-9e0f-5e768b7ce502 tempest-CreateVolumesFromImageTest-1409410945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.314s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-6572e740-ca95-4f84-867f-160f64d2307b tempest-AttachVolumeNegativeTest-1224056977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.289s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:52 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-6572e740-ca95-4f84-867f-160f64d2307b tempest-AttachVolumeNegativeTest-1224056977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-344013243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78683c41-bf46-4ed3-be9c-1636352dac4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='796ca6dac1614b198cf7645ae5f214d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:47Z,use_quota=True,user_id='9a53ffa5a72b41cab5f1a6dbcfee9d66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:29:52 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-6572e740-ca95-4f84-867f-160f64d2307b tempest-AttachVolumeNegativeTest-1224056977 None] Creating volume 78683c41-bf46-4ed3-be9c-1636352dac4e {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:29:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-6572e740-ca95-4f84-867f-160f64d2307b tempest-AttachVolumeNegativeTest-1224056977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-6572e740-ca95-4f84-867f-160f64d2307b tempest-AttachVolumeNegativeTest-1224056977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:52 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-6572e740-ca95-4f84-867f-160f64d2307b tempest-AttachVolumeNegativeTest-1224056977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:52 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-6572e740-ca95-4f84-867f-160f64d2307b tempest-AttachVolumeNegativeTest-1224056977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-6572e740-ca95-4f84-867f-160f64d2307b tempest-AttachVolumeNegativeTest-1224056977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:52 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-6572e740-ca95-4f84-867f-160f64d2307b tempest-AttachVolumeNegativeTest-1224056977 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:29:52 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-6572e740-ca95-4f84-867f-160f64d2307b tempest-AttachVolumeNegativeTest-1224056977 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:29:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6572e740-ca95-4f84-867f-160f64d2307b tempest-AttachVolumeNegativeTest-1224056977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-78683c41-bf46-4ed3-be9c-1636352dac4e 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:52 devstack sudo[98670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-78683c41-bf46-4ed3-be9c-1636352dac4e 1073741824 Jul 07 17:29:52 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f8ec76aa-ddba-4145-9e0f-5e768b7ce502 tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8c2faf6-b21c-4aa9-97cb-56da4e0162b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-728b39c6-b4b6-4432-b93a-f99a7ac4b95e', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:52 devstack sudo[98670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:52 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f8ec76aa-ddba-4145-9e0f-5e768b7ce502 tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce785f70-ca2b-4217-aaf4-183e12dd9292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:52 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-f8ec76aa-ddba-4145-9e0f-5e768b7ce502 tempest-CreateVolumesFromImageTest-1409410945 None] Volume volume-728b39c6-b4b6-4432-b93a-f99a7ac4b95e (728b39c6-b4b6-4432-b93a-f99a7ac4b95e): created successfully Jul 07 17:29:52 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f8ec76aa-ddba-4145-9e0f-5e768b7ce502 tempest-CreateVolumesFromImageTest-1409410945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce785f70-ca2b-4217-aaf4-183e12dd9292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:52 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f8ec76aa-ddba-4145-9e0f-5e768b7ce502 tempest-CreateVolumesFromImageTest-1409410945 None] Flow 'volume_create_manager' (7e59830a-752f-4e1b-8bf7-d582c7d43d88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:52 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-f8ec76aa-ddba-4145-9e0f-5e768b7ce502 tempest-CreateVolumesFromImageTest-1409410945 None] Created volume successfully. Jul 07 17:29:53 devstack sudo[98667]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-19ac4bbc-c66f-4e10-b510-1bc1a4ea8f18 tempest-VolumesNegativeTest-1114531016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f3e10253-3e28-40ee-9e56-3c169f9e0b30" returned: 0 in 1.044s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-19ac4bbc-c66f-4e10-b510-1bc1a4ea8f18 tempest-VolumesNegativeTest-1114531016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f3e10253-3e28-40ee-9e56-3c169f9e0b30 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:53 devstack sudo[98678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f3e10253-3e28-40ee-9e56-3c169f9e0b30 Jul 07 17:29:53 devstack sudo[98678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:53 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-76a7ce67-df6a-4639-84d0-bffaaad36e7a tempest-CreateVolumesFromImageTest-1409410945 None] Acquiring lock "cinder-728b39c6-b4b6-4432-b93a-f99a7ac4b95e-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:53 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-76a7ce67-df6a-4639-84d0-bffaaad36e7a tempest-CreateVolumesFromImageTest-1409410945 None] Lock "cinder-728b39c6-b4b6-4432-b93a-f99a7ac4b95e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:53 devstack sudo[98670]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6572e740-ca95-4f84-867f-160f64d2307b tempest-AttachVolumeNegativeTest-1224056977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-78683c41-bf46-4ed3-be9c-1636352dac4e 1073741824" returned: 0 in 1.024s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:53 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-76a7ce67-df6a-4639-84d0-bffaaad36e7a tempest-CreateVolumesFromImageTest-1409410945 None] Acquiring lock "cinder-quobyte-728b39c6-b4b6-4432-b93a-f99a7ac4b95e" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6572e740-ca95-4f84-867f-160f64d2307b tempest-AttachVolumeNegativeTest-1224056977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-78683c41-bf46-4ed3-be9c-1636352dac4e {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:53 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-76a7ce67-df6a-4639-84d0-bffaaad36e7a tempest-CreateVolumesFromImageTest-1409410945 None] Lock "cinder-quobyte-728b39c6-b4b6-4432-b93a-f99a7ac4b95e" acquired by "delete_volume" :: waited 0.030s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:53 devstack sudo[98682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-78683c41-bf46-4ed3-be9c-1636352dac4e Jul 07 17:29:53 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:53 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc7191a-ae06-4b81-9a67-617b2d87b931]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:29:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-76a7ce67-df6a-4639-84d0-bffaaad36e7a tempest-CreateVolumesFromImageTest-1409410945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-728b39c6-b4b6-4432-b93a-f99a7ac4b95e {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:53 devstack sudo[98684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-728b39c6-b4b6-4432-b93a-f99a7ac4b95e Jul 07 17:29:53 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:53 devstack sudo[98678]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-19ac4bbc-c66f-4e10-b510-1bc1a4ea8f18 tempest-VolumesNegativeTest-1114531016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f3e10253-3e28-40ee-9e56-3c169f9e0b30" returned: 0 in 0.753s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:53 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-19ac4bbc-c66f-4e10-b510-1bc1a4ea8f18 tempest-VolumesNegativeTest-1114531016 None] Lock "cinder-quobyte-f3e10253-3e28-40ee-9e56-3c169f9e0b30" released by "delete_volume" :: held 1.878s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:53 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-19ac4bbc-c66f-4e10-b510-1bc1a4ea8f18 tempest-VolumesNegativeTest-1114531016 None] Created reservations ['3c91410b-1d08-4a82-a405-72c45a1bdc8c', '3cfeb666-01e5-48b9-b224-ec8123ca8365', 'f1744b13-58ff-4292-8f1d-e2b52fa73bc3', '29848645-f8ef-4503-b1b5-f274328196a9'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:29:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-19ac4bbc-c66f-4e10-b510-1bc1a4ea8f18 tempest-VolumesNegativeTest-1114531016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-19ac4bbc-c66f-4e10-b510-1bc1a4ea8f18 tempest-VolumesNegativeTest-1114531016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:54 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-19ac4bbc-c66f-4e10-b510-1bc1a4ea8f18 tempest-VolumesNegativeTest-1114531016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:54 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-19ac4bbc-c66f-4e10-b510-1bc1a4ea8f18 tempest-VolumesNegativeTest-1114531016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-19ac4bbc-c66f-4e10-b510-1bc1a4ea8f18 tempest-VolumesNegativeTest-1114531016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-19ac4bbc-c66f-4e10-b510-1bc1a4ea8f18 tempest-VolumesNegativeTest-1114531016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:54 devstack sudo[98687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:29:54 devstack sudo[98687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:54 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6572e740-ca95-4f84-867f-160f64d2307b tempest-AttachVolumeNegativeTest-1224056977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-78683c41-bf46-4ed3-be9c-1636352dac4e" returned: 0 in 0.849s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:54 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-6572e740-ca95-4f84-867f-160f64d2307b tempest-AttachVolumeNegativeTest-1224056977 None] <== create_volume: return (1936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:29:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-6572e740-ca95-4f84-867f-160f64d2307b tempest-AttachVolumeNegativeTest-1224056977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.944s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-d07b1dd0-8b39-4766-8ed4-bda20b7b4d42 req-7ef6b8f9-5656-4266-a8b7-19e9d6037454 tempest-TestInstancesWithCinderVolumes-1646852817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.500s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-6572e740-ca95-4f84-867f-160f64d2307b tempest-AttachVolumeNegativeTest-1224056977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9ddf1b1-f9ff-4061-b44a-40167680cfc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78683c41-bf46-4ed3-be9c-1636352dac4e', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-6572e740-ca95-4f84-867f-160f64d2307b tempest-AttachVolumeNegativeTest-1224056977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f72e660-6c6d-49c2-a1e7-b12985a82463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:54 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[edec0a29-08b9-4397-9588-4b2fdd788662]: (4, 'raw') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:29:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-d07b1dd0-8b39-4766-8ed4-bda20b7b4d42 req-7ef6b8f9-5656-4266-a8b7-19e9d6037454 tempest-TestInstancesWithCinderVolumes-1646852817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c3dc9c94-4ad2-41b1-a4d0-621baf2611b3 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:54 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-6572e740-ca95-4f84-867f-160f64d2307b tempest-AttachVolumeNegativeTest-1224056977 None] Volume volume-78683c41-bf46-4ed3-be9c-1636352dac4e (78683c41-bf46-4ed3-be9c-1636352dac4e): created successfully Jul 07 17:29:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-6572e740-ca95-4f84-867f-160f64d2307b tempest-AttachVolumeNegativeTest-1224056977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f72e660-6c6d-49c2-a1e7-b12985a82463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-6572e740-ca95-4f84-867f-160f64d2307b tempest-AttachVolumeNegativeTest-1224056977 None] Flow 'volume_create_manager' (cd53ffe0-3213-4e6d-abff-3fd8449bff73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:54 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-6572e740-ca95-4f84-867f-160f64d2307b tempest-AttachVolumeNegativeTest-1224056977 None] Created volume successfully. Jul 07 17:29:54 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-76a7ce67-df6a-4639-84d0-bffaaad36e7a tempest-CreateVolumesFromImageTest-1409410945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-728b39c6-b4b6-4432-b93a-f99a7ac4b95e" returned: 0 in 1.019s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:54 devstack sudo[98693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c3dc9c94-4ad2-41b1-a4d0-621baf2611b3 Jul 07 17:29:54 devstack sudo[98693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-76a7ce67-df6a-4639-84d0-bffaaad36e7a tempest-CreateVolumesFromImageTest-1409410945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-728b39c6-b4b6-4432-b93a-f99a7ac4b95e {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:54 devstack sudo[98695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-728b39c6-b4b6-4432-b93a-f99a7ac4b95e Jul 07 17:29:54 devstack sudo[98695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:55 devstack sudo[98687]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-19ac4bbc-c66f-4e10-b510-1bc1a4ea8f18 tempest-VolumesNegativeTest-1114531016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.943s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:55 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-19ac4bbc-c66f-4e10-b510-1bc1a4ea8f18 tempest-VolumesNegativeTest-1114531016 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:29:55 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-19ac4bbc-c66f-4e10-b510-1bc1a4ea8f18 tempest-VolumesNegativeTest-1114531016 None] Deleted volume successfully. Jul 07 17:29:55 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-19ac4bbc-c66f-4e10-b510-1bc1a4ea8f18 tempest-VolumesNegativeTest-1114531016 None] Lock "cinder-f3e10253-3e28-40ee-9e56-3c169f9e0b30-delete_volume" released by "delete_volume" :: held 3.123s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:55 devstack sudo[98693]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-d07b1dd0-8b39-4766-8ed4-bda20b7b4d42 req-7ef6b8f9-5656-4266-a8b7-19e9d6037454 tempest-TestInstancesWithCinderVolumes-1646852817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c3dc9c94-4ad2-41b1-a4d0-621baf2611b3" returned: 0 in 1.013s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-d07b1dd0-8b39-4766-8ed4-bda20b7b4d42 req-7ef6b8f9-5656-4266-a8b7-19e9d6037454 tempest-TestInstancesWithCinderVolumes-1646852817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c3dc9c94-4ad2-41b1-a4d0-621baf2611b3 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:55 devstack sudo[98695]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-76a7ce67-df6a-4639-84d0-bffaaad36e7a tempest-CreateVolumesFromImageTest-1409410945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-728b39c6-b4b6-4432-b93a-f99a7ac4b95e" returned: 0 in 0.854s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:55 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-76a7ce67-df6a-4639-84d0-bffaaad36e7a tempest-CreateVolumesFromImageTest-1409410945 None] Lock "cinder-quobyte-728b39c6-b4b6-4432-b93a-f99a7ac4b95e" released by "delete_volume" :: held 1.952s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:55 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-76a7ce67-df6a-4639-84d0-bffaaad36e7a tempest-CreateVolumesFromImageTest-1409410945 None] Created reservations ['168bd8f4-6735-49d2-a436-1fd41ab5482d', '7e5f685a-c8a0-418e-a711-b0a9f187ae80', '2ed95fa8-9360-46f1-945e-87328ced4621', '9c1ff26c-0e71-44f3-9c1b-7e8aa35746ad'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:29:55 devstack sudo[98704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c3dc9c94-4ad2-41b1-a4d0-621baf2611b3 Jul 07 17:29:55 devstack sudo[98704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-76a7ce67-df6a-4639-84d0-bffaaad36e7a tempest-CreateVolumesFromImageTest-1409410945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-76a7ce67-df6a-4639-84d0-bffaaad36e7a tempest-CreateVolumesFromImageTest-1409410945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:55 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-76a7ce67-df6a-4639-84d0-bffaaad36e7a tempest-CreateVolumesFromImageTest-1409410945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:55 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-76a7ce67-df6a-4639-84d0-bffaaad36e7a tempest-CreateVolumesFromImageTest-1409410945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-76a7ce67-df6a-4639-84d0-bffaaad36e7a tempest-CreateVolumesFromImageTest-1409410945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-76a7ce67-df6a-4639-84d0-bffaaad36e7a tempest-CreateVolumesFromImageTest-1409410945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:55 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-92d08d44-40d9-4b7c-91c6-e8d6fdac020f tempest-CreateVolumesFromImageTest-1409410945 None] Acquiring lock "cinder-4826ed0c-38fe-4b54-b774-c706fe81540c-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:55 devstack sudo[98706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:29:55 devstack sudo[98706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:55 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-92d08d44-40d9-4b7c-91c6-e8d6fdac020f tempest-CreateVolumesFromImageTest-1409410945 None] Lock "cinder-4826ed0c-38fe-4b54-b774-c706fe81540c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:55 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-92d08d44-40d9-4b7c-91c6-e8d6fdac020f tempest-CreateVolumesFromImageTest-1409410945 None] Acquiring lock "cinder-quobyte-4826ed0c-38fe-4b54-b774-c706fe81540c" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:55 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-92d08d44-40d9-4b7c-91c6-e8d6fdac020f tempest-CreateVolumesFromImageTest-1409410945 None] Lock "cinder-quobyte-4826ed0c-38fe-4b54-b774-c706fe81540c" acquired by "delete_volume" :: waited 0.035s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:55 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[833469db-04ba-4a33-a4f0-3f20299cb251]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:29:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-92d08d44-40d9-4b7c-91c6-e8d6fdac020f tempest-CreateVolumesFromImageTest-1409410945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4826ed0c-38fe-4b54-b774-c706fe81540c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:56 devstack sudo[98708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4826ed0c-38fe-4b54-b774-c706fe81540c Jul 07 17:29:56 devstack sudo[98708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:56 devstack sudo[98704]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-d07b1dd0-8b39-4766-8ed4-bda20b7b4d42 req-7ef6b8f9-5656-4266-a8b7-19e9d6037454 tempest-TestInstancesWithCinderVolumes-1646852817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c3dc9c94-4ad2-41b1-a4d0-621baf2611b3" returned: 1 in 1.131s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-d07b1dd0-8b39-4766-8ed4-bda20b7b4d42 req-7ef6b8f9-5656-4266-a8b7-19e9d6037454 tempest-TestInstancesWithCinderVolumes-1646852817 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c3dc9c94-4ad2-41b1-a4d0-621baf2611b3' failed. Not Retrying. {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:29:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-d07b1dd0-8b39-4766-8ed4-bda20b7b4d42 req-7ef6b8f9-5656-4266-a8b7-19e9d6037454 tempest-TestInstancesWithCinderVolumes-1646852817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.191s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:56 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-d07b1dd0-8b39-4766-8ed4-bda20b7b4d42 req-7ef6b8f9-5656-4266-a8b7-19e9d6037454 tempest-TestInstancesWithCinderVolumes-1646852817 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7', 'name': 'volume-c3dc9c94-4ad2-41b1-a4d0-621baf2611b3', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b15948b9-36dc-40e9-a516-71b45ed8034a', 'enforce_multipath': True} {{(pid=87233) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:29:56 devstack sudo[98706]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-76a7ce67-df6a-4639-84d0-bffaaad36e7a tempest-CreateVolumesFromImageTest-1409410945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.979s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:56 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-76a7ce67-df6a-4639-84d0-bffaaad36e7a tempest-CreateVolumesFromImageTest-1409410945 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:29:56 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-76a7ce67-df6a-4639-84d0-bffaaad36e7a tempest-CreateVolumesFromImageTest-1409410945 None] Deleted volume successfully. Jul 07 17:29:56 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-d07b1dd0-8b39-4766-8ed4-bda20b7b4d42 req-7ef6b8f9-5656-4266-a8b7-19e9d6037454 tempest-TestInstancesWithCinderVolumes-1646852817 None] attachment_update completed successfully. Jul 07 17:29:56 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-76a7ce67-df6a-4639-84d0-bffaaad36e7a tempest-CreateVolumesFromImageTest-1409410945 None] Lock "cinder-728b39c6-b4b6-4432-b93a-f99a7ac4b95e-delete_volume" released by "delete_volume" :: held 3.246s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:56 devstack sudo[98708]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-92d08d44-40d9-4b7c-91c6-e8d6fdac020f tempest-CreateVolumesFromImageTest-1409410945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4826ed0c-38fe-4b54-b774-c706fe81540c" returned: 0 in 0.949s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-92d08d44-40d9-4b7c-91c6-e8d6fdac020f tempest-CreateVolumesFromImageTest-1409410945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4826ed0c-38fe-4b54-b774-c706fe81540c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:56 devstack sudo[98717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4826ed0c-38fe-4b54-b774-c706fe81540c Jul 07 17:29:56 devstack sudo[98717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:57 devstack sudo[98717]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-92d08d44-40d9-4b7c-91c6-e8d6fdac020f tempest-CreateVolumesFromImageTest-1409410945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4826ed0c-38fe-4b54-b774-c706fe81540c" returned: 0 in 0.818s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:57 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-92d08d44-40d9-4b7c-91c6-e8d6fdac020f tempest-CreateVolumesFromImageTest-1409410945 None] Lock "cinder-quobyte-4826ed0c-38fe-4b54-b774-c706fe81540c" released by "delete_volume" :: held 1.830s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:57 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-92d08d44-40d9-4b7c-91c6-e8d6fdac020f tempest-CreateVolumesFromImageTest-1409410945 None] Created reservations ['5a46e04a-fd97-455d-8f5a-7f6ffa3981ef', 'db2c2766-91b1-49b2-aee8-9bce468b45e7', '0f1fe367-3a58-41e8-9921-b96571472f5b', '0325d8f0-660e-449c-ae04-c6c3f5b300c8'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:29:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-86699fbf-9221-43bf-b764-7ed25e56e30f req-5a7e7813-5a10-478f-b126-7c60ecb85b28 tempest-AttachVolumeNegativeTest-1224056977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-86699fbf-9221-43bf-b764-7ed25e56e30f req-5a7e7813-5a10-478f-b126-7c60ecb85b28 tempest-AttachVolumeNegativeTest-1224056977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:58 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-8b77d81e-00fe-4ddb-a3e8-65f099e7150b tempest-CreateVolumesFromImageTest-1409410945 None] Acquiring lock "cinder-43be39f0-b776-4f7c-9e0c-82072c34fbd2-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:58 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8c8dc1-cc8a-4cbf-b472-4a374fece384]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:29:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-86699fbf-9221-43bf-b764-7ed25e56e30f req-5a7e7813-5a10-478f-b126-7c60ecb85b28 tempest-AttachVolumeNegativeTest-1224056977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-78683c41-bf46-4ed3-be9c-1636352dac4e {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-92d08d44-40d9-4b7c-91c6-e8d6fdac020f tempest-CreateVolumesFromImageTest-1409410945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-92d08d44-40d9-4b7c-91c6-e8d6fdac020f tempest-CreateVolumesFromImageTest-1409410945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:58 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-92d08d44-40d9-4b7c-91c6-e8d6fdac020f tempest-CreateVolumesFromImageTest-1409410945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:58 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-92d08d44-40d9-4b7c-91c6-e8d6fdac020f tempest-CreateVolumesFromImageTest-1409410945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-92d08d44-40d9-4b7c-91c6-e8d6fdac020f tempest-CreateVolumesFromImageTest-1409410945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-92d08d44-40d9-4b7c-91c6-e8d6fdac020f tempest-CreateVolumesFromImageTest-1409410945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:58 devstack sudo[98729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:29:58 devstack sudo[98729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:58 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-8b77d81e-00fe-4ddb-a3e8-65f099e7150b tempest-CreateVolumesFromImageTest-1409410945 None] Lock "cinder-43be39f0-b776-4f7c-9e0c-82072c34fbd2-delete_volume" acquired by "delete_volume" :: waited 0.119s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:58 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-8b77d81e-00fe-4ddb-a3e8-65f099e7150b tempest-CreateVolumesFromImageTest-1409410945 None] Acquiring lock "cinder-quobyte-43be39f0-b776-4f7c-9e0c-82072c34fbd2" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:58 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-8b77d81e-00fe-4ddb-a3e8-65f099e7150b tempest-CreateVolumesFromImageTest-1409410945 None] Lock "cinder-quobyte-43be39f0-b776-4f7c-9e0c-82072c34fbd2" acquired by "delete_volume" :: waited 0.024s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:58 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9fd0ebd-741e-46d1-b4ce-2b33b4f5fab9]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:29:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8b77d81e-00fe-4ddb-a3e8-65f099e7150b tempest-CreateVolumesFromImageTest-1409410945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-43be39f0-b776-4f7c-9e0c-82072c34fbd2 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:58 devstack sudo[98728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-78683c41-bf46-4ed3-be9c-1636352dac4e Jul 07 17:29:58 devstack sudo[98728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:58 devstack sudo[98731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-43be39f0-b776-4f7c-9e0c-82072c34fbd2 Jul 07 17:29:58 devstack sudo[98731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:59 devstack sudo[98729]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-92d08d44-40d9-4b7c-91c6-e8d6fdac020f tempest-CreateVolumesFromImageTest-1409410945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 1.252s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:59 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-92d08d44-40d9-4b7c-91c6-e8d6fdac020f tempest-CreateVolumesFromImageTest-1409410945 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:29:59 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-92d08d44-40d9-4b7c-91c6-e8d6fdac020f tempest-CreateVolumesFromImageTest-1409410945 None] Deleted volume successfully. Jul 07 17:29:59 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-92d08d44-40d9-4b7c-91c6-e8d6fdac020f tempest-CreateVolumesFromImageTest-1409410945 None] Lock "cinder-4826ed0c-38fe-4b54-b774-c706fe81540c-delete_volume" released by "delete_volume" :: held 3.659s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:59 devstack sudo[98728]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-86699fbf-9221-43bf-b764-7ed25e56e30f req-5a7e7813-5a10-478f-b126-7c60ecb85b28 tempest-AttachVolumeNegativeTest-1224056977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-78683c41-bf46-4ed3-be9c-1636352dac4e" returned: 0 in 1.447s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-86699fbf-9221-43bf-b764-7ed25e56e30f req-5a7e7813-5a10-478f-b126-7c60ecb85b28 tempest-AttachVolumeNegativeTest-1224056977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.508s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-86699fbf-9221-43bf-b764-7ed25e56e30f req-5a7e7813-5a10-478f-b126-7c60ecb85b28 tempest-AttachVolumeNegativeTest-1224056977 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7', 'name': 'volume-78683c41-bf46-4ed3-be9c-1636352dac4e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1723d9cb-5afa-495f-a69d-7b345e90b179', 'enforce_multipath': True} {{(pid=87233) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:29:59 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-86699fbf-9221-43bf-b764-7ed25e56e30f req-5a7e7813-5a10-478f-b126-7c60ecb85b28 tempest-AttachVolumeNegativeTest-1224056977 None] attachment_update completed successfully. Jul 07 17:29:59 devstack sudo[98731]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8b77d81e-00fe-4ddb-a3e8-65f099e7150b tempest-CreateVolumesFromImageTest-1409410945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-43be39f0-b776-4f7c-9e0c-82072c34fbd2" returned: 0 in 1.384s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8b77d81e-00fe-4ddb-a3e8-65f099e7150b tempest-CreateVolumesFromImageTest-1409410945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-43be39f0-b776-4f7c-9e0c-82072c34fbd2 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:59 devstack sudo[98811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-43be39f0-b776-4f7c-9e0c-82072c34fbd2 Jul 07 17:29:59 devstack sudo[98811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:00 devstack sudo[98811]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8b77d81e-00fe-4ddb-a3e8-65f099e7150b tempest-CreateVolumesFromImageTest-1409410945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-43be39f0-b776-4f7c-9e0c-82072c34fbd2" returned: 0 in 0.924s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:00 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-8b77d81e-00fe-4ddb-a3e8-65f099e7150b tempest-CreateVolumesFromImageTest-1409410945 None] Lock "cinder-quobyte-43be39f0-b776-4f7c-9e0c-82072c34fbd2" released by "delete_volume" :: held 2.390s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:00 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-8b77d81e-00fe-4ddb-a3e8-65f099e7150b tempest-CreateVolumesFromImageTest-1409410945 None] Created reservations ['b47a54d9-5b4c-4adf-b11e-9175964f84b3', '4a8c5985-3513-4703-ad83-3091c50a9e05', 'de8aadd4-cb10-4afb-abbd-de750bc57402', '9308f8fd-5fd6-41ba-9f30-fb0cd19c8541'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:30:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-8b77d81e-00fe-4ddb-a3e8-65f099e7150b tempest-CreateVolumesFromImageTest-1409410945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-8b77d81e-00fe-4ddb-a3e8-65f099e7150b tempest-CreateVolumesFromImageTest-1409410945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:00 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-8b77d81e-00fe-4ddb-a3e8-65f099e7150b tempest-CreateVolumesFromImageTest-1409410945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:00 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-8b77d81e-00fe-4ddb-a3e8-65f099e7150b tempest-CreateVolumesFromImageTest-1409410945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-8b77d81e-00fe-4ddb-a3e8-65f099e7150b tempest-CreateVolumesFromImageTest-1409410945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8b77d81e-00fe-4ddb-a3e8-65f099e7150b tempest-CreateVolumesFromImageTest-1409410945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:01 devstack sudo[99171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:30:01 devstack sudo[99171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:01 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6f0cd631-0ea9-4af7-a2e0-0d352654f8ed tempest-CreateVolumesFromImageTest-1409410945 None] Acquiring lock "cinder-af134ccc-7d08-49d1-af95-9c486104ac5a-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:01 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6f0cd631-0ea9-4af7-a2e0-0d352654f8ed tempest-CreateVolumesFromImageTest-1409410945 None] Lock "cinder-af134ccc-7d08-49d1-af95-9c486104ac5a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:01 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6f0cd631-0ea9-4af7-a2e0-0d352654f8ed tempest-CreateVolumesFromImageTest-1409410945 None] Acquiring lock "cinder-quobyte-af134ccc-7d08-49d1-af95-9c486104ac5a" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:01 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6f0cd631-0ea9-4af7-a2e0-0d352654f8ed tempest-CreateVolumesFromImageTest-1409410945 None] Lock "cinder-quobyte-af134ccc-7d08-49d1-af95-9c486104ac5a" acquired by "delete_volume" :: waited 0.021s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:01 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c004694-b48a-4014-a20a-f767f168e573]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6f0cd631-0ea9-4af7-a2e0-0d352654f8ed tempest-CreateVolumesFromImageTest-1409410945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-af134ccc-7d08-49d1-af95-9c486104ac5a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:01 devstack sudo[99171]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8b77d81e-00fe-4ddb-a3e8-65f099e7150b tempest-CreateVolumesFromImageTest-1409410945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.793s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:01 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-8b77d81e-00fe-4ddb-a3e8-65f099e7150b tempest-CreateVolumesFromImageTest-1409410945 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:30:01 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-8b77d81e-00fe-4ddb-a3e8-65f099e7150b tempest-CreateVolumesFromImageTest-1409410945 None] Deleted volume successfully. Jul 07 17:30:01 devstack sudo[99180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-af134ccc-7d08-49d1-af95-9c486104ac5a Jul 07 17:30:01 devstack sudo[99180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:01 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-8b77d81e-00fe-4ddb-a3e8-65f099e7150b tempest-CreateVolumesFromImageTest-1409410945 None] Lock "cinder-43be39f0-b776-4f7c-9e0c-82072c34fbd2-delete_volume" released by "delete_volume" :: held 3.587s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:02 devstack sudo[99180]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6f0cd631-0ea9-4af7-a2e0-0d352654f8ed tempest-CreateVolumesFromImageTest-1409410945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-af134ccc-7d08-49d1-af95-9c486104ac5a" returned: 0 in 0.932s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6f0cd631-0ea9-4af7-a2e0-0d352654f8ed tempest-CreateVolumesFromImageTest-1409410945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-af134ccc-7d08-49d1-af95-9c486104ac5a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:02 devstack sudo[99203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-af134ccc-7d08-49d1-af95-9c486104ac5a Jul 07 17:30:02 devstack sudo[99203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:03 devstack sudo[99203]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6f0cd631-0ea9-4af7-a2e0-0d352654f8ed tempest-CreateVolumesFromImageTest-1409410945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-af134ccc-7d08-49d1-af95-9c486104ac5a" returned: 0 in 0.820s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:03 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6f0cd631-0ea9-4af7-a2e0-0d352654f8ed tempest-CreateVolumesFromImageTest-1409410945 None] Lock "cinder-quobyte-af134ccc-7d08-49d1-af95-9c486104ac5a" released by "delete_volume" :: held 1.807s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:03 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-6f0cd631-0ea9-4af7-a2e0-0d352654f8ed tempest-CreateVolumesFromImageTest-1409410945 None] Created reservations ['89ed8fbd-592f-4586-b5ed-8d279f8f2bc5', '673e4aff-a708-4e28-b2c9-117ea59c5a80', '123929f9-17bf-48e9-9903-29e24c22a349', '45b683d6-556b-47c2-8806-862852b728ca'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:30:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-6f0cd631-0ea9-4af7-a2e0-0d352654f8ed tempest-CreateVolumesFromImageTest-1409410945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-6f0cd631-0ea9-4af7-a2e0-0d352654f8ed tempest-CreateVolumesFromImageTest-1409410945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:03 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-6f0cd631-0ea9-4af7-a2e0-0d352654f8ed tempest-CreateVolumesFromImageTest-1409410945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:03 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-6f0cd631-0ea9-4af7-a2e0-0d352654f8ed tempest-CreateVolumesFromImageTest-1409410945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-6f0cd631-0ea9-4af7-a2e0-0d352654f8ed tempest-CreateVolumesFromImageTest-1409410945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6f0cd631-0ea9-4af7-a2e0-0d352654f8ed tempest-CreateVolumesFromImageTest-1409410945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:03 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-7598dc32-20ee-4787-88b1-9f0c3331b14a tempest-CreateVolumesFromImageTest-1409410945 None] Acquiring lock "cinder-cad262e8-1671-4311-b5a6-c14000a2ebd3-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:04 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-7598dc32-20ee-4787-88b1-9f0c3331b14a tempest-CreateVolumesFromImageTest-1409410945 None] Lock "cinder-cad262e8-1671-4311-b5a6-c14000a2ebd3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:04 devstack sudo[99209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:30:04 devstack sudo[99209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:04 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-7598dc32-20ee-4787-88b1-9f0c3331b14a tempest-CreateVolumesFromImageTest-1409410945 None] Acquiring lock "cinder-quobyte-cad262e8-1671-4311-b5a6-c14000a2ebd3" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:04 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-7598dc32-20ee-4787-88b1-9f0c3331b14a tempest-CreateVolumesFromImageTest-1409410945 None] Lock "cinder-quobyte-cad262e8-1671-4311-b5a6-c14000a2ebd3" acquired by "delete_volume" :: waited 0.034s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:04 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e78c067-61a8-4375-96da-d07018e823cf]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7598dc32-20ee-4787-88b1-9f0c3331b14a tempest-CreateVolumesFromImageTest-1409410945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cad262e8-1671-4311-b5a6-c14000a2ebd3 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:04 devstack sudo[99211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cad262e8-1671-4311-b5a6-c14000a2ebd3 Jul 07 17:30:04 devstack sudo[99211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:05 devstack sudo[99209]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6f0cd631-0ea9-4af7-a2e0-0d352654f8ed tempest-CreateVolumesFromImageTest-1409410945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 1.240s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:05 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-6f0cd631-0ea9-4af7-a2e0-0d352654f8ed tempest-CreateVolumesFromImageTest-1409410945 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:30:05 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-6f0cd631-0ea9-4af7-a2e0-0d352654f8ed tempest-CreateVolumesFromImageTest-1409410945 None] Deleted volume successfully. Jul 07 17:30:05 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6f0cd631-0ea9-4af7-a2e0-0d352654f8ed tempest-CreateVolumesFromImageTest-1409410945 None] Lock "cinder-af134ccc-7d08-49d1-af95-9c486104ac5a-delete_volume" released by "delete_volume" :: held 3.707s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:05 devstack sudo[99211]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7598dc32-20ee-4787-88b1-9f0c3331b14a tempest-CreateVolumesFromImageTest-1409410945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cad262e8-1671-4311-b5a6-c14000a2ebd3" returned: 0 in 1.715s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7598dc32-20ee-4787-88b1-9f0c3331b14a tempest-CreateVolumesFromImageTest-1409410945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cad262e8-1671-4311-b5a6-c14000a2ebd3 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:05 devstack sudo[99217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cad262e8-1671-4311-b5a6-c14000a2ebd3 Jul 07 17:30:05 devstack sudo[99217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:07 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-876bdcd7-c86d-48b1-972e-ddb1b92e1adc req-da18c212-8579-4ce7-ba6b-304eefd2c4da tempest-AttachVolumeNegativeTest-1224056977 None] Terminate volume connection completed successfully. Jul 07 17:30:07 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-876bdcd7-c86d-48b1-972e-ddb1b92e1adc req-da18c212-8579-4ce7-ba6b-304eefd2c4da tempest-AttachVolumeNegativeTest-1224056977 None] Deleting attachment 1723d9cb-5afa-495f-a69d-7b345e90b179. {{(pid=87233) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:30:07 devstack sudo[99217]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7598dc32-20ee-4787-88b1-9f0c3331b14a tempest-CreateVolumesFromImageTest-1409410945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cad262e8-1671-4311-b5a6-c14000a2ebd3" returned: 0 in 1.267s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:07 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-7598dc32-20ee-4787-88b1-9f0c3331b14a tempest-CreateVolumesFromImageTest-1409410945 None] Lock "cinder-quobyte-cad262e8-1671-4311-b5a6-c14000a2ebd3" released by "delete_volume" :: held 3.065s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:07 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-7598dc32-20ee-4787-88b1-9f0c3331b14a tempest-CreateVolumesFromImageTest-1409410945 None] Created reservations ['dd8b8f14-3e18-4a55-92a3-5ce8d2a20d59', 'dfe290de-78c0-4c20-bc91-eb6adf3d87c6', '67a51c9f-c40d-4a1a-8ce9-5ecc3bf50018', '1d83e625-45e7-4145-ad98-f2b57074e456'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:30:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-7598dc32-20ee-4787-88b1-9f0c3331b14a tempest-CreateVolumesFromImageTest-1409410945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-7598dc32-20ee-4787-88b1-9f0c3331b14a tempest-CreateVolumesFromImageTest-1409410945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:07 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-7598dc32-20ee-4787-88b1-9f0c3331b14a tempest-CreateVolumesFromImageTest-1409410945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:07 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-7598dc32-20ee-4787-88b1-9f0c3331b14a tempest-CreateVolumesFromImageTest-1409410945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-7598dc32-20ee-4787-88b1-9f0c3331b14a tempest-CreateVolumesFromImageTest-1409410945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7598dc32-20ee-4787-88b1-9f0c3331b14a tempest-CreateVolumesFromImageTest-1409410945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:07 devstack sudo[99222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:30:07 devstack sudo[99222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:09 devstack sudo[99222]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7598dc32-20ee-4787-88b1-9f0c3331b14a tempest-CreateVolumesFromImageTest-1409410945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 1.675s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:09 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-7598dc32-20ee-4787-88b1-9f0c3331b14a tempest-CreateVolumesFromImageTest-1409410945 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:30:09 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-7598dc32-20ee-4787-88b1-9f0c3331b14a tempest-CreateVolumesFromImageTest-1409410945 None] Deleted volume successfully. Jul 07 17:30:09 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-7598dc32-20ee-4787-88b1-9f0c3331b14a tempest-CreateVolumesFromImageTest-1409410945 None] Lock "cinder-cad262e8-1671-4311-b5a6-c14000a2ebd3-delete_volume" released by "delete_volume" :: held 5.247s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:12 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-352d0aec-5665-46ce-a04b-30ed71565bf7 tempest-VolumesSnapshotTestJSON-1060003704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:30:12 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-352d0aec-5665-46ce-a04b-30ed71565bf7 tempest-VolumesSnapshotTestJSON-1060003704 None] Flow 'volume_create_manager' (58fc5e37-2238-4f08-b937-861d2779f88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:12 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-352d0aec-5665-46ce-a04b-30ed71565bf7 tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17bdcf88-8279-4ca9-90d9-e01d9ef08be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-352d0aec-5665-46ce-a04b-30ed71565bf7 tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17bdcf88-8279-4ca9-90d9-e01d9ef08be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1011537367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2558d64-6e60-4c64-a4f1-bb591428a95d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7189f681c2474250884e895d36964163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:13Z,use_quota=True,user_id='3a40585286124ecd838d56d41d077832',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-352d0aec-5665-46ce-a04b-30ed71565bf7 tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61246fd2-2dd9-405f-a0fd-f266cd5dd4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-352d0aec-5665-46ce-a04b-30ed71565bf7 tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61246fd2-2dd9-405f-a0fd-f266cd5dd4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-352d0aec-5665-46ce-a04b-30ed71565bf7 tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36e33ed2-219e-4517-83a2-291ce88d0416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-352d0aec-5665-46ce-a04b-30ed71565bf7 tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36e33ed2-219e-4517-83a2-291ce88d0416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2558d64-6e60-4c64-a4f1-bb591428a95d', 'volume_name': 'volume-b2558d64-6e60-4c64-a4f1-bb591428a95d', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-352d0aec-5665-46ce-a04b-30ed71565bf7 tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (261d911a-5678-4786-97f4-9b1c2a983726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-352d0aec-5665-46ce-a04b-30ed71565bf7 tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (261d911a-5678-4786-97f4-9b1c2a983726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-352d0aec-5665-46ce-a04b-30ed71565bf7 tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeba21f2-6ad6-4f59-8506-903380c6ab11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:13 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-352d0aec-5665-46ce-a04b-30ed71565bf7 tempest-VolumesSnapshotTestJSON-1060003704 None] Volume b2558d64-6e60-4c64-a4f1-bb591428a95d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2558d64-6e60-4c64-a4f1-bb591428a95d', 'volume_size': 1} Jul 07 17:30:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-352d0aec-5665-46ce-a04b-30ed71565bf7 tempest-VolumesSnapshotTestJSON-1060003704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-352d0aec-5665-46ce-a04b-30ed71565bf7 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:13 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-352d0aec-5665-46ce-a04b-30ed71565bf7 tempest-VolumesSnapshotTestJSON-1060003704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1011537367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2558d64-6e60-4c64-a4f1-bb591428a95d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7189f681c2474250884e895d36964163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:13Z,use_quota=True,user_id='3a40585286124ecd838d56d41d077832',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:30:13 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-352d0aec-5665-46ce-a04b-30ed71565bf7 tempest-VolumesSnapshotTestJSON-1060003704 None] Creating volume b2558d64-6e60-4c64-a4f1-bb591428a95d {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:30:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-352d0aec-5665-46ce-a04b-30ed71565bf7 tempest-VolumesSnapshotTestJSON-1060003704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-352d0aec-5665-46ce-a04b-30ed71565bf7 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:13 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-352d0aec-5665-46ce-a04b-30ed71565bf7 tempest-VolumesSnapshotTestJSON-1060003704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:13 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-352d0aec-5665-46ce-a04b-30ed71565bf7 tempest-VolumesSnapshotTestJSON-1060003704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-352d0aec-5665-46ce-a04b-30ed71565bf7 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:13 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-352d0aec-5665-46ce-a04b-30ed71565bf7 tempest-VolumesSnapshotTestJSON-1060003704 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:30:13 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-352d0aec-5665-46ce-a04b-30ed71565bf7 tempest-VolumesSnapshotTestJSON-1060003704 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:30:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-352d0aec-5665-46ce-a04b-30ed71565bf7 tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b2558d64-6e60-4c64-a4f1-bb591428a95d 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:13 devstack sudo[99247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b2558d64-6e60-4c64-a4f1-bb591428a95d 1073741824 Jul 07 17:30:13 devstack sudo[99247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:14 devstack sudo[99247]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-352d0aec-5665-46ce-a04b-30ed71565bf7 tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b2558d64-6e60-4c64-a4f1-bb591428a95d 1073741824" returned: 0 in 1.814s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-352d0aec-5665-46ce-a04b-30ed71565bf7 tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b2558d64-6e60-4c64-a4f1-bb591428a95d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:15 devstack sudo[99289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b2558d64-6e60-4c64-a4f1-bb591428a95d Jul 07 17:30:15 devstack sudo[99289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:16 devstack sudo[99289]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-352d0aec-5665-46ce-a04b-30ed71565bf7 tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b2558d64-6e60-4c64-a4f1-bb591428a95d" returned: 0 in 1.130s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:16 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-352d0aec-5665-46ce-a04b-30ed71565bf7 tempest-VolumesSnapshotTestJSON-1060003704 None] <== create_volume: return (3058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:30:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-352d0aec-5665-46ce-a04b-30ed71565bf7 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.063s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:16 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-352d0aec-5665-46ce-a04b-30ed71565bf7 tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeba21f2-6ad6-4f59-8506-903380c6ab11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2558d64-6e60-4c64-a4f1-bb591428a95d', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:16 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-352d0aec-5665-46ce-a04b-30ed71565bf7 tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d7251ed-a28a-4f5c-b205-7d3333527027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:16 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-352d0aec-5665-46ce-a04b-30ed71565bf7 tempest-VolumesSnapshotTestJSON-1060003704 None] Volume volume-b2558d64-6e60-4c64-a4f1-bb591428a95d (b2558d64-6e60-4c64-a4f1-bb591428a95d): created successfully Jul 07 17:30:16 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-352d0aec-5665-46ce-a04b-30ed71565bf7 tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d7251ed-a28a-4f5c-b205-7d3333527027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:16 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-352d0aec-5665-46ce-a04b-30ed71565bf7 tempest-VolumesSnapshotTestJSON-1060003704 None] Flow 'volume_create_manager' (58fc5e37-2238-4f08-b937-861d2779f88a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:16 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-352d0aec-5665-46ce-a04b-30ed71565bf7 tempest-VolumesSnapshotTestJSON-1060003704 None] Created volume successfully. Jul 07 17:30:17 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-05599551-91dc-4b4b-9150-51e99099efea tempest-ProjectReaderTests-849566068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:30:17 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-05599551-91dc-4b4b-9150-51e99099efea tempest-ProjectReaderTests-849566068 None] Flow 'volume_create_manager' (5869342b-5de2-4f64-aca2-8c06b49b274e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:17 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-05599551-91dc-4b4b-9150-51e99099efea tempest-ProjectReaderTests-849566068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95f6eba3-80f4-4420-a25d-8b210a3a4b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:17 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-05599551-91dc-4b4b-9150-51e99099efea tempest-ProjectReaderTests-849566068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95f6eba3-80f4-4420-a25d-8b210a3a4b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1535334902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0046523-fd62-4b63-9bbb-0f258db99a55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9d32ff90a79449095dc5453cef17814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:17Z,use_quota=True,user_id='633387f1942d4baeb612875b2d1b2506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:17 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-05599551-91dc-4b4b-9150-51e99099efea tempest-ProjectReaderTests-849566068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17a7e886-32d2-4b72-8d50-e7dc5d3e44cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:17 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-05599551-91dc-4b4b-9150-51e99099efea tempest-ProjectReaderTests-849566068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17a7e886-32d2-4b72-8d50-e7dc5d3e44cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:17 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-05599551-91dc-4b4b-9150-51e99099efea tempest-ProjectReaderTests-849566068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (136fad9b-52d5-4e19-97b3-d183ff8fe254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:17 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-05599551-91dc-4b4b-9150-51e99099efea tempest-ProjectReaderTests-849566068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (136fad9b-52d5-4e19-97b3-d183ff8fe254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0046523-fd62-4b63-9bbb-0f258db99a55', 'volume_name': 'volume-e0046523-fd62-4b63-9bbb-0f258db99a55', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:17 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-05599551-91dc-4b4b-9150-51e99099efea tempest-ProjectReaderTests-849566068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6d037ce-3b54-40e8-ab95-680e8c689e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:17 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-05599551-91dc-4b4b-9150-51e99099efea tempest-ProjectReaderTests-849566068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6d037ce-3b54-40e8-ab95-680e8c689e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:17 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-05599551-91dc-4b4b-9150-51e99099efea tempest-ProjectReaderTests-849566068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4c16039-1674-464d-b30f-8de5e5ab41ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:17 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-05599551-91dc-4b4b-9150-51e99099efea tempest-ProjectReaderTests-849566068 None] Volume e0046523-fd62-4b63-9bbb-0f258db99a55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0046523-fd62-4b63-9bbb-0f258db99a55', 'volume_size': 1} Jul 07 17:30:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-05599551-91dc-4b4b-9150-51e99099efea tempest-ProjectReaderTests-849566068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-05599551-91dc-4b4b-9150-51e99099efea tempest-ProjectReaderTests-849566068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:17 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-05599551-91dc-4b4b-9150-51e99099efea tempest-ProjectReaderTests-849566068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1535334902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0046523-fd62-4b63-9bbb-0f258db99a55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9d32ff90a79449095dc5453cef17814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:17Z,use_quota=True,user_id='633387f1942d4baeb612875b2d1b2506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:30:17 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-05599551-91dc-4b4b-9150-51e99099efea tempest-ProjectReaderTests-849566068 None] Creating volume e0046523-fd62-4b63-9bbb-0f258db99a55 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:30:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-05599551-91dc-4b4b-9150-51e99099efea tempest-ProjectReaderTests-849566068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-05599551-91dc-4b4b-9150-51e99099efea tempest-ProjectReaderTests-849566068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:17 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-05599551-91dc-4b4b-9150-51e99099efea tempest-ProjectReaderTests-849566068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:17 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-05599551-91dc-4b4b-9150-51e99099efea tempest-ProjectReaderTests-849566068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-05599551-91dc-4b4b-9150-51e99099efea tempest-ProjectReaderTests-849566068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:17 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-05599551-91dc-4b4b-9150-51e99099efea tempest-ProjectReaderTests-849566068 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:30:17 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-05599551-91dc-4b4b-9150-51e99099efea tempest-ProjectReaderTests-849566068 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:30:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-05599551-91dc-4b4b-9150-51e99099efea tempest-ProjectReaderTests-849566068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0046523-fd62-4b63-9bbb-0f258db99a55 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:17 devstack sudo[99294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0046523-fd62-4b63-9bbb-0f258db99a55 1073741824 Jul 07 17:30:17 devstack sudo[99294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a6e9f12e-def1-4334-a183-6329c4ef5f64 tempest-VolumesSnapshotTestJSON-1060003704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:18 devstack sudo[99294]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-05599551-91dc-4b4b-9150-51e99099efea tempest-ProjectReaderTests-849566068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0046523-fd62-4b63-9bbb-0f258db99a55 1073741824" returned: 0 in 1.150s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-05599551-91dc-4b4b-9150-51e99099efea tempest-ProjectReaderTests-849566068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0046523-fd62-4b63-9bbb-0f258db99a55 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:18 devstack sudo[99300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0046523-fd62-4b63-9bbb-0f258db99a55 Jul 07 17:30:18 devstack sudo[99300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:19 devstack sudo[99300]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-05599551-91dc-4b4b-9150-51e99099efea tempest-ProjectReaderTests-849566068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0046523-fd62-4b63-9bbb-0f258db99a55" returned: 0 in 0.952s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:19 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-05599551-91dc-4b4b-9150-51e99099efea tempest-ProjectReaderTests-849566068 None] <== create_volume: return (2168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:30:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-05599551-91dc-4b4b-9150-51e99099efea tempest-ProjectReaderTests-849566068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.171s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a6e9f12e-def1-4334-a183-6329c4ef5f64 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.684s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:19 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-05599551-91dc-4b4b-9150-51e99099efea tempest-ProjectReaderTests-849566068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4c16039-1674-464d-b30f-8de5e5ab41ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0046523-fd62-4b63-9bbb-0f258db99a55', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:19 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-05599551-91dc-4b4b-9150-51e99099efea tempest-ProjectReaderTests-849566068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fca8c647-c67b-4d00-aa6d-845192ced88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:19 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-a6e9f12e-def1-4334-a183-6329c4ef5f64 tempest-VolumesSnapshotTestJSON-1060003704 None] Creating offline snapshot c8f72488-805d-49eb-9409-3a5e0a56b9d6 of volume b2558d64-6e60-4c64-a4f1-bb591428a95d {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:30:19 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-05599551-91dc-4b4b-9150-51e99099efea tempest-ProjectReaderTests-849566068 None] Volume volume-e0046523-fd62-4b63-9bbb-0f258db99a55 (e0046523-fd62-4b63-9bbb-0f258db99a55): created successfully Jul 07 17:30:19 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-05599551-91dc-4b4b-9150-51e99099efea tempest-ProjectReaderTests-849566068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fca8c647-c67b-4d00-aa6d-845192ced88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:19 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-05599551-91dc-4b4b-9150-51e99099efea tempest-ProjectReaderTests-849566068 None] Flow 'volume_create_manager' (5869342b-5de2-4f64-aca2-8c06b49b274e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:19 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fdf2527-9f0d-4df0-aa5c-dac22606e2c7]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a6e9f12e-def1-4334-a183-6329c4ef5f64 tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b2558d64-6e60-4c64-a4f1-bb591428a95d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:19 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-05599551-91dc-4b4b-9150-51e99099efea tempest-ProjectReaderTests-849566068 None] Created volume successfully. Jul 07 17:30:19 devstack sudo[99399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b2558d64-6e60-4c64-a4f1-bb591428a95d Jul 07 17:30:19 devstack sudo[99399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:20 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-240f9149-c67a-4bf8-8bb2-0393559b59b7 tempest-AttachVolumeNegativeTest-1224056977 None] Acquiring lock "cinder-78683c41-bf46-4ed3-be9c-1636352dac4e-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:20 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-240f9149-c67a-4bf8-8bb2-0393559b59b7 tempest-AttachVolumeNegativeTest-1224056977 None] Lock "cinder-78683c41-bf46-4ed3-be9c-1636352dac4e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:20 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-240f9149-c67a-4bf8-8bb2-0393559b59b7 tempest-AttachVolumeNegativeTest-1224056977 None] Acquiring lock "cinder-quobyte-78683c41-bf46-4ed3-be9c-1636352dac4e" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:20 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-240f9149-c67a-4bf8-8bb2-0393559b59b7 tempest-AttachVolumeNegativeTest-1224056977 None] Lock "cinder-quobyte-78683c41-bf46-4ed3-be9c-1636352dac4e" acquired by "delete_volume" :: waited 0.021s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:20 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[35aa4afe-c6d1-4e68-b09f-516f914d6ff5]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-240f9149-c67a-4bf8-8bb2-0393559b59b7 tempest-AttachVolumeNegativeTest-1224056977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-78683c41-bf46-4ed3-be9c-1636352dac4e {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:20 devstack sudo[99402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-78683c41-bf46-4ed3-be9c-1636352dac4e Jul 07 17:30:20 devstack sudo[99402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:20 devstack sudo[99399]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a6e9f12e-def1-4334-a183-6329c4ef5f64 tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b2558d64-6e60-4c64-a4f1-bb591428a95d" returned: 0 in 0.983s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a6e9f12e-def1-4334-a183-6329c4ef5f64 tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b2558d64-6e60-4c64-a4f1-bb591428a95d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b2558d64-6e60-4c64-a4f1-bb591428a95d.c8f72488-805d-49eb-9409-3a5e0a56b9d6 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:20 devstack sudo[99407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b2558d64-6e60-4c64-a4f1-bb591428a95d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b2558d64-6e60-4c64-a4f1-bb591428a95d.c8f72488-805d-49eb-9409-3a5e0a56b9d6 1G Jul 07 17:30:20 devstack sudo[99407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:20 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-32c45e29-b599-484f-ab09-c953d494cf8e tempest-ProjectReaderTests-849566068 None] Acquiring lock "cinder-e0046523-fd62-4b63-9bbb-0f258db99a55-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:20 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-32c45e29-b599-484f-ab09-c953d494cf8e tempest-ProjectReaderTests-849566068 None] Lock "cinder-e0046523-fd62-4b63-9bbb-0f258db99a55-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:20 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-32c45e29-b599-484f-ab09-c953d494cf8e tempest-ProjectReaderTests-849566068 None] Acquiring lock "cinder-quobyte-e0046523-fd62-4b63-9bbb-0f258db99a55" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:20 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-32c45e29-b599-484f-ab09-c953d494cf8e tempest-ProjectReaderTests-849566068 None] Lock "cinder-quobyte-e0046523-fd62-4b63-9bbb-0f258db99a55" acquired by "delete_volume" :: waited 0.020s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:20 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd90e21-67c2-418c-b959-fe59f3b5c207]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-32c45e29-b599-484f-ab09-c953d494cf8e tempest-ProjectReaderTests-849566068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0046523-fd62-4b63-9bbb-0f258db99a55 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:21 devstack sudo[99409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0046523-fd62-4b63-9bbb-0f258db99a55 Jul 07 17:30:21 devstack sudo[99409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:21 devstack sudo[99402]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-240f9149-c67a-4bf8-8bb2-0393559b59b7 tempest-AttachVolumeNegativeTest-1224056977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-78683c41-bf46-4ed3-be9c-1636352dac4e" returned: 0 in 0.990s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-240f9149-c67a-4bf8-8bb2-0393559b59b7 tempest-AttachVolumeNegativeTest-1224056977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-78683c41-bf46-4ed3-be9c-1636352dac4e {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:21 devstack sudo[99421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-78683c41-bf46-4ed3-be9c-1636352dac4e Jul 07 17:30:21 devstack sudo[99421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:21 devstack sudo[99407]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a6e9f12e-def1-4334-a183-6329c4ef5f64 tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b2558d64-6e60-4c64-a4f1-bb591428a95d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b2558d64-6e60-4c64-a4f1-bb591428a95d.c8f72488-805d-49eb-9409-3a5e0a56b9d6 1G" returned: 0 in 1.025s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a6e9f12e-def1-4334-a183-6329c4ef5f64 tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2558d64-6e60-4c64-a4f1-bb591428a95d -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b2558d64-6e60-4c64-a4f1-bb591428a95d.c8f72488-805d-49eb-9409-3a5e0a56b9d6 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:21 devstack sudo[99409]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-32c45e29-b599-484f-ab09-c953d494cf8e tempest-ProjectReaderTests-849566068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0046523-fd62-4b63-9bbb-0f258db99a55" returned: 0 in 0.869s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-32c45e29-b599-484f-ab09-c953d494cf8e tempest-ProjectReaderTests-849566068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0046523-fd62-4b63-9bbb-0f258db99a55 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:21 devstack sudo[99429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2558d64-6e60-4c64-a4f1-bb591428a95d -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b2558d64-6e60-4c64-a4f1-bb591428a95d.c8f72488-805d-49eb-9409-3a5e0a56b9d6 Jul 07 17:30:21 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:21 devstack sudo[99430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0046523-fd62-4b63-9bbb-0f258db99a55 Jul 07 17:30:21 devstack sudo[99430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:22 devstack sudo[99421]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-240f9149-c67a-4bf8-8bb2-0393559b59b7 tempest-AttachVolumeNegativeTest-1224056977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-78683c41-bf46-4ed3-be9c-1636352dac4e" returned: 0 in 0.785s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:22 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-240f9149-c67a-4bf8-8bb2-0393559b59b7 tempest-AttachVolumeNegativeTest-1224056977 None] Lock "cinder-quobyte-78683c41-bf46-4ed3-be9c-1636352dac4e" released by "delete_volume" :: held 1.835s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:22 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-240f9149-c67a-4bf8-8bb2-0393559b59b7 tempest-AttachVolumeNegativeTest-1224056977 None] Created reservations ['cea8696b-24ec-4260-aa82-29c096018229', '92ad9ee8-395e-489a-a803-e5da2d928bf3', 'fc1d5ad2-4c36-4c22-a903-75717b9d0926', '40bddb4c-873c-4ef2-817b-b10838aecced'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:30:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-240f9149-c67a-4bf8-8bb2-0393559b59b7 tempest-AttachVolumeNegativeTest-1224056977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-240f9149-c67a-4bf8-8bb2-0393559b59b7 tempest-AttachVolumeNegativeTest-1224056977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:22 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-240f9149-c67a-4bf8-8bb2-0393559b59b7 tempest-AttachVolumeNegativeTest-1224056977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:22 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-240f9149-c67a-4bf8-8bb2-0393559b59b7 tempest-AttachVolumeNegativeTest-1224056977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-240f9149-c67a-4bf8-8bb2-0393559b59b7 tempest-AttachVolumeNegativeTest-1224056977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-240f9149-c67a-4bf8-8bb2-0393559b59b7 tempest-AttachVolumeNegativeTest-1224056977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:22 devstack sudo[99435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:30:22 devstack sudo[99435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:22 devstack sudo[99430]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-32c45e29-b599-484f-ab09-c953d494cf8e tempest-ProjectReaderTests-849566068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e0046523-fd62-4b63-9bbb-0f258db99a55" returned: 0 in 0.678s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:22 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-32c45e29-b599-484f-ab09-c953d494cf8e tempest-ProjectReaderTests-849566068 None] Lock "cinder-quobyte-e0046523-fd62-4b63-9bbb-0f258db99a55" released by "delete_volume" :: held 1.616s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:22 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a6e9f12e-def1-4334-a183-6329c4ef5f64 tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2558d64-6e60-4c64-a4f1-bb591428a95d -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b2558d64-6e60-4c64-a4f1-bb591428a95d.c8f72488-805d-49eb-9409-3a5e0a56b9d6" returned: 0 in 0.783s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:22 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-a6e9f12e-def1-4334-a183-6329c4ef5f64 tempest-VolumesSnapshotTestJSON-1060003704 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b2558d64-6e60-4c64-a4f1-bb591428a95d.c8f72488-805d-49eb-9409-3a5e0a56b9d6 is being set with open permissions: ugo+rw Jul 07 17:30:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a6e9f12e-def1-4334-a183-6329c4ef5f64 tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b2558d64-6e60-4c64-a4f1-bb591428a95d.c8f72488-805d-49eb-9409-3a5e0a56b9d6 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:22 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-32c45e29-b599-484f-ab09-c953d494cf8e tempest-ProjectReaderTests-849566068 None] Created reservations ['3ca83b88-386e-4b65-be8a-5b9a7c8f7b6f', 'e63c0e01-6748-44a1-bc1e-34008feaf193', 'ef59a928-5a9c-4321-8126-152bcae4a7e9', '7456c146-8e2c-44d3-9091-65d6adbd0857'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:30:22 devstack sudo[99440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b2558d64-6e60-4c64-a4f1-bb591428a95d.c8f72488-805d-49eb-9409-3a5e0a56b9d6 Jul 07 17:30:22 devstack sudo[99440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-32c45e29-b599-484f-ab09-c953d494cf8e tempest-ProjectReaderTests-849566068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-32c45e29-b599-484f-ab09-c953d494cf8e tempest-ProjectReaderTests-849566068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:22 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-32c45e29-b599-484f-ab09-c953d494cf8e tempest-ProjectReaderTests-849566068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:22 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-32c45e29-b599-484f-ab09-c953d494cf8e tempest-ProjectReaderTests-849566068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-32c45e29-b599-484f-ab09-c953d494cf8e tempest-ProjectReaderTests-849566068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-32c45e29-b599-484f-ab09-c953d494cf8e tempest-ProjectReaderTests-849566068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:22 devstack sudo[99442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:30:22 devstack sudo[99442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:22 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-17041d9e-0a5f-4902-bd9e-51e51f17f5c3 tempest-AttachVolumeNegativeTest-1224056977 None] Acquiring lock "cinder-4282389f-9295-4497-aea7-3d663dc461eb-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:22 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-17041d9e-0a5f-4902-bd9e-51e51f17f5c3 tempest-AttachVolumeNegativeTest-1224056977 None] Lock "cinder-4282389f-9295-4497-aea7-3d663dc461eb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:22 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-17041d9e-0a5f-4902-bd9e-51e51f17f5c3 tempest-AttachVolumeNegativeTest-1224056977 None] Acquiring lock "cinder-quobyte-4282389f-9295-4497-aea7-3d663dc461eb" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:22 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-17041d9e-0a5f-4902-bd9e-51e51f17f5c3 tempest-AttachVolumeNegativeTest-1224056977 None] Lock "cinder-quobyte-4282389f-9295-4497-aea7-3d663dc461eb" acquired by "delete_volume" :: waited 0.030s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:22 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d207e2ad-61db-4f8a-95fd-44a8dba7e8c7]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-17041d9e-0a5f-4902-bd9e-51e51f17f5c3 tempest-AttachVolumeNegativeTest-1224056977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4282389f-9295-4497-aea7-3d663dc461eb {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:23 devstack sudo[99444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4282389f-9295-4497-aea7-3d663dc461eb Jul 07 17:30:23 devstack sudo[99444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:23 devstack sudo[99435]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-240f9149-c67a-4bf8-8bb2-0393559b59b7 tempest-AttachVolumeNegativeTest-1224056977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 1.059s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:23 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-240f9149-c67a-4bf8-8bb2-0393559b59b7 tempest-AttachVolumeNegativeTest-1224056977 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:30:23 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-240f9149-c67a-4bf8-8bb2-0393559b59b7 tempest-AttachVolumeNegativeTest-1224056977 None] Deleted volume successfully. Jul 07 17:30:23 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-240f9149-c67a-4bf8-8bb2-0393559b59b7 tempest-AttachVolumeNegativeTest-1224056977 None] Lock "cinder-78683c41-bf46-4ed3-be9c-1636352dac4e-delete_volume" released by "delete_volume" :: held 3.153s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:23 devstack sudo[99440]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a6e9f12e-def1-4334-a183-6329c4ef5f64 tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b2558d64-6e60-4c64-a4f1-bb591428a95d.c8f72488-805d-49eb-9409-3a5e0a56b9d6" returned: 0 in 1.081s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a6e9f12e-def1-4334-a183-6329c4ef5f64 tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b2558d64-6e60-4c64-a4f1-bb591428a95d.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:23 devstack sudo[99451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b2558d64-6e60-4c64-a4f1-bb591428a95d.info Jul 07 17:30:23 devstack sudo[99451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:23 devstack sudo[99442]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-32c45e29-b599-484f-ab09-c953d494cf8e tempest-ProjectReaderTests-849566068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 1.028s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:23 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-32c45e29-b599-484f-ab09-c953d494cf8e tempest-ProjectReaderTests-849566068 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:30:23 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-32c45e29-b599-484f-ab09-c953d494cf8e tempest-ProjectReaderTests-849566068 None] Deleted volume successfully. Jul 07 17:30:23 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-32c45e29-b599-484f-ab09-c953d494cf8e tempest-ProjectReaderTests-849566068 None] Lock "cinder-e0046523-fd62-4b63-9bbb-0f258db99a55-delete_volume" released by "delete_volume" :: held 2.940s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:23 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-951b898a-feba-407e-800f-c2ddb90fe85f tempest-ProjectReaderTests-849566068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:30:23 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-951b898a-feba-407e-800f-c2ddb90fe85f tempest-ProjectReaderTests-849566068 None] Flow 'volume_create_manager' (7f486884-2f37-4a81-a4df-7fd30449b484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:23 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-951b898a-feba-407e-800f-c2ddb90fe85f tempest-ProjectReaderTests-849566068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63924a5c-c1d0-493a-914b-d941fd201550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:23 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-951b898a-feba-407e-800f-c2ddb90fe85f tempest-ProjectReaderTests-849566068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63924a5c-c1d0-493a-914b-d941fd201550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2011678059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65a59a31-4381-4ce7-9cc2-590a7eeaa774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9d32ff90a79449095dc5453cef17814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:24Z,use_quota=True,user_id='633387f1942d4baeb612875b2d1b2506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:23 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-951b898a-feba-407e-800f-c2ddb90fe85f tempest-ProjectReaderTests-849566068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25215095-bbd3-47c5-9dd5-972155fc1906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:23 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-951b898a-feba-407e-800f-c2ddb90fe85f tempest-ProjectReaderTests-849566068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25215095-bbd3-47c5-9dd5-972155fc1906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:23 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-951b898a-feba-407e-800f-c2ddb90fe85f tempest-ProjectReaderTests-849566068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95757915-2ef5-44a6-a0c7-9c17eafd8dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:23 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-951b898a-feba-407e-800f-c2ddb90fe85f tempest-ProjectReaderTests-849566068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95757915-2ef5-44a6-a0c7-9c17eafd8dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65a59a31-4381-4ce7-9cc2-590a7eeaa774', 'volume_name': 'volume-65a59a31-4381-4ce7-9cc2-590a7eeaa774', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:23 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-951b898a-feba-407e-800f-c2ddb90fe85f tempest-ProjectReaderTests-849566068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (227e404d-97bd-4756-9df5-1b351902e20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:23 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-951b898a-feba-407e-800f-c2ddb90fe85f tempest-ProjectReaderTests-849566068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (227e404d-97bd-4756-9df5-1b351902e20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:23 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-951b898a-feba-407e-800f-c2ddb90fe85f tempest-ProjectReaderTests-849566068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8d2dcab-2153-41d5-9935-b5f41678a591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:23 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-951b898a-feba-407e-800f-c2ddb90fe85f tempest-ProjectReaderTests-849566068 None] Volume 65a59a31-4381-4ce7-9cc2-590a7eeaa774: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65a59a31-4381-4ce7-9cc2-590a7eeaa774', 'volume_size': 1} Jul 07 17:30:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-951b898a-feba-407e-800f-c2ddb90fe85f tempest-ProjectReaderTests-849566068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:23 devstack sudo[99444]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-17041d9e-0a5f-4902-bd9e-51e51f17f5c3 tempest-AttachVolumeNegativeTest-1224056977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4282389f-9295-4497-aea7-3d663dc461eb" returned: 0 in 1.066s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-17041d9e-0a5f-4902-bd9e-51e51f17f5c3 tempest-AttachVolumeNegativeTest-1224056977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4282389f-9295-4497-aea7-3d663dc461eb {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:23 devstack sudo[99456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4282389f-9295-4497-aea7-3d663dc461eb Jul 07 17:30:23 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:24 devstack sudo[99451]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a6e9f12e-def1-4334-a183-6329c4ef5f64 tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b2558d64-6e60-4c64-a4f1-bb591428a95d.info" returned: 0 in 0.705s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:24 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-a6e9f12e-def1-4334-a183-6329c4ef5f64 tempest-VolumesSnapshotTestJSON-1060003704 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b2558d64-6e60-4c64-a4f1-bb591428a95d.info is being set with open permissions: ugo+rw Jul 07 17:30:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a6e9f12e-def1-4334-a183-6329c4ef5f64 tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b2558d64-6e60-4c64-a4f1-bb591428a95d.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:24 devstack sudo[99459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b2558d64-6e60-4c64-a4f1-bb591428a95d.info Jul 07 17:30:24 devstack sudo[99459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:24 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-17041d9e-0a5f-4902-bd9e-51e51f17f5c3 tempest-AttachVolumeNegativeTest-1224056977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4282389f-9295-4497-aea7-3d663dc461eb" returned: 0 in 0.654s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:24 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-17041d9e-0a5f-4902-bd9e-51e51f17f5c3 tempest-AttachVolumeNegativeTest-1224056977 None] Lock "cinder-quobyte-4282389f-9295-4497-aea7-3d663dc461eb" released by "delete_volume" :: held 1.783s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:24 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-17041d9e-0a5f-4902-bd9e-51e51f17f5c3 tempest-AttachVolumeNegativeTest-1224056977 None] Created reservations ['452343de-0cb1-4455-8089-84bb44c47447', 'f2db6c13-9a6a-4ecf-a789-cab9c0f289e3', 'af00b874-5d8e-4d59-8f69-2dc7834429c2', '085f5947-1702-49a4-b433-abf49e32ff5b'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:30:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-17041d9e-0a5f-4902-bd9e-51e51f17f5c3 tempest-AttachVolumeNegativeTest-1224056977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-17041d9e-0a5f-4902-bd9e-51e51f17f5c3 tempest-AttachVolumeNegativeTest-1224056977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:24 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-17041d9e-0a5f-4902-bd9e-51e51f17f5c3 tempest-AttachVolumeNegativeTest-1224056977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:24 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-17041d9e-0a5f-4902-bd9e-51e51f17f5c3 tempest-AttachVolumeNegativeTest-1224056977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-17041d9e-0a5f-4902-bd9e-51e51f17f5c3 tempest-AttachVolumeNegativeTest-1224056977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-17041d9e-0a5f-4902-bd9e-51e51f17f5c3 tempest-AttachVolumeNegativeTest-1224056977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:24 devstack sudo[99462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:30:24 devstack sudo[99462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:25 devstack sudo[99459]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a6e9f12e-def1-4334-a183-6329c4ef5f64 tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b2558d64-6e60-4c64-a4f1-bb591428a95d.info" returned: 0 in 0.787s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a6e9f12e-def1-4334-a183-6329c4ef5f64 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.572s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-951b898a-feba-407e-800f-c2ddb90fe85f tempest-ProjectReaderTests-849566068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.264s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:25 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-951b898a-feba-407e-800f-c2ddb90fe85f tempest-ProjectReaderTests-849566068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2011678059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65a59a31-4381-4ce7-9cc2-590a7eeaa774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9d32ff90a79449095dc5453cef17814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:24Z,use_quota=True,user_id='633387f1942d4baeb612875b2d1b2506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:30:25 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-951b898a-feba-407e-800f-c2ddb90fe85f tempest-ProjectReaderTests-849566068 None] Creating volume 65a59a31-4381-4ce7-9cc2-590a7eeaa774 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:30:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-951b898a-feba-407e-800f-c2ddb90fe85f tempest-ProjectReaderTests-849566068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-951b898a-feba-407e-800f-c2ddb90fe85f tempest-ProjectReaderTests-849566068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:25 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-951b898a-feba-407e-800f-c2ddb90fe85f tempest-ProjectReaderTests-849566068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:25 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-951b898a-feba-407e-800f-c2ddb90fe85f tempest-ProjectReaderTests-849566068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-951b898a-feba-407e-800f-c2ddb90fe85f tempest-ProjectReaderTests-849566068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:25 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-951b898a-feba-407e-800f-c2ddb90fe85f tempest-ProjectReaderTests-849566068 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:30:25 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-951b898a-feba-407e-800f-c2ddb90fe85f tempest-ProjectReaderTests-849566068 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:30:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-951b898a-feba-407e-800f-c2ddb90fe85f tempest-ProjectReaderTests-849566068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-65a59a31-4381-4ce7-9cc2-590a7eeaa774 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:25 devstack sudo[99465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-65a59a31-4381-4ce7-9cc2-590a7eeaa774 1073741824 Jul 07 17:30:25 devstack sudo[99465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:25 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-706a69fe-0c12-41e6-8cda-402592882656 tempest-AttachVolumeNegativeTest-1224056977 None] Acquiring lock "cinder-2767b127-68ae-4b91-954c-71e572c23c78-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:25 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-a6e9f12e-def1-4334-a183-6329c4ef5f64 tempest-VolumesSnapshotTestJSON-1060003704 None] Create snapshot completed successfully Jul 07 17:30:25 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-706a69fe-0c12-41e6-8cda-402592882656 tempest-AttachVolumeNegativeTest-1224056977 None] Lock "cinder-2767b127-68ae-4b91-954c-71e572c23c78-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:25 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-706a69fe-0c12-41e6-8cda-402592882656 tempest-AttachVolumeNegativeTest-1224056977 None] Acquiring lock "cinder-quobyte-2767b127-68ae-4b91-954c-71e572c23c78" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:25 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-706a69fe-0c12-41e6-8cda-402592882656 tempest-AttachVolumeNegativeTest-1224056977 None] Lock "cinder-quobyte-2767b127-68ae-4b91-954c-71e572c23c78" acquired by "delete_volume" :: waited 0.016s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:25 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b8be04-7b70-4b49-be1c-944582258f21]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-706a69fe-0c12-41e6-8cda-402592882656 tempest-AttachVolumeNegativeTest-1224056977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2767b127-68ae-4b91-954c-71e572c23c78 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:25 devstack sudo[99462]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:25 devstack sudo[99468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2767b127-68ae-4b91-954c-71e572c23c78 Jul 07 17:30:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-17041d9e-0a5f-4902-bd9e-51e51f17f5c3 tempest-AttachVolumeNegativeTest-1224056977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.746s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:25 devstack sudo[99468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:25 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-17041d9e-0a5f-4902-bd9e-51e51f17f5c3 tempest-AttachVolumeNegativeTest-1224056977 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:30:25 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-17041d9e-0a5f-4902-bd9e-51e51f17f5c3 tempest-AttachVolumeNegativeTest-1224056977 None] Deleted volume successfully. Jul 07 17:30:25 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-17041d9e-0a5f-4902-bd9e-51e51f17f5c3 tempest-AttachVolumeNegativeTest-1224056977 None] Lock "cinder-4282389f-9295-4497-aea7-3d663dc461eb-delete_volume" released by "delete_volume" :: held 2.775s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:26 devstack sudo[99465]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-951b898a-feba-407e-800f-c2ddb90fe85f tempest-ProjectReaderTests-849566068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-65a59a31-4381-4ce7-9cc2-590a7eeaa774 1073741824" returned: 0 in 0.941s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-951b898a-feba-407e-800f-c2ddb90fe85f tempest-ProjectReaderTests-849566068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-65a59a31-4381-4ce7-9cc2-590a7eeaa774 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:26 devstack sudo[99476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-65a59a31-4381-4ce7-9cc2-590a7eeaa774 Jul 07 17:30:26 devstack sudo[99476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:26 devstack sudo[99468]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-706a69fe-0c12-41e6-8cda-402592882656 tempest-AttachVolumeNegativeTest-1224056977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2767b127-68ae-4b91-954c-71e572c23c78" returned: 0 in 0.812s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-706a69fe-0c12-41e6-8cda-402592882656 tempest-AttachVolumeNegativeTest-1224056977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2767b127-68ae-4b91-954c-71e572c23c78 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:26 devstack sudo[99478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2767b127-68ae-4b91-954c-71e572c23c78 Jul 07 17:30:26 devstack sudo[99478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:26 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-71c34990-e65c-4f63-b90b-a6f1ab739a28 tempest-VolumesSnapshotTestJSON-1060003704 None] Acquiring lock "cinder-c8f72488-805d-49eb-9409-3a5e0a56b9d6-delete_snapshot" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:26 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-71c34990-e65c-4f63-b90b-a6f1ab739a28 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "cinder-c8f72488-805d-49eb-9409-3a5e0a56b9d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:26 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-71c34990-e65c-4f63-b90b-a6f1ab739a28 tempest-VolumesSnapshotTestJSON-1060003704 None] Acquiring lock "cinder-quobyte-b2558d64-6e60-4c64-a4f1-bb591428a95d" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:26 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-71c34990-e65c-4f63-b90b-a6f1ab739a28 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "cinder-quobyte-b2558d64-6e60-4c64-a4f1-bb591428a95d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:26 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-71c34990-e65c-4f63-b90b-a6f1ab739a28 tempest-VolumesSnapshotTestJSON-1060003704 None] Acquiring lock "cinder-quobyte-c8f72488-805d-49eb-9409-3a5e0a56b9d6" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:26 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-71c34990-e65c-4f63-b90b-a6f1ab739a28 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "cinder-quobyte-c8f72488-805d-49eb-9409-3a5e0a56b9d6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:26 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-71c34990-e65c-4f63-b90b-a6f1ab739a28 tempest-VolumesSnapshotTestJSON-1060003704 None] Deleting offline snapshot c8f72488-805d-49eb-9409-3a5e0a56b9d6 of volume b2558d64-6e60-4c64-a4f1-bb591428a95d {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:30:26 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-71c34990-e65c-4f63-b90b-a6f1ab739a28 tempest-VolumesSnapshotTestJSON-1060003704 None] snapshot_file for this snap is: volume-b2558d64-6e60-4c64-a4f1-bb591428a95d.c8f72488-805d-49eb-9409-3a5e0a56b9d6 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:30:26 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[406adf88-c849-440b-832e-31507efb709e]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-71c34990-e65c-4f63-b90b-a6f1ab739a28 tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b2558d64-6e60-4c64-a4f1-bb591428a95d.c8f72488-805d-49eb-9409-3a5e0a56b9d6 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:26 devstack sudo[99476]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-951b898a-feba-407e-800f-c2ddb90fe85f tempest-ProjectReaderTests-849566068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-65a59a31-4381-4ce7-9cc2-590a7eeaa774" returned: 0 in 0.749s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:26 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-951b898a-feba-407e-800f-c2ddb90fe85f tempest-ProjectReaderTests-849566068 None] <== create_volume: return (1745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:30:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-951b898a-feba-407e-800f-c2ddb90fe85f tempest-ProjectReaderTests-849566068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.749s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:26 devstack sudo[99481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b2558d64-6e60-4c64-a4f1-bb591428a95d.c8f72488-805d-49eb-9409-3a5e0a56b9d6 Jul 07 17:30:26 devstack sudo[99481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-951b898a-feba-407e-800f-c2ddb90fe85f tempest-ProjectReaderTests-849566068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8d2dcab-2153-41d5-9935-b5f41678a591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65a59a31-4381-4ce7-9cc2-590a7eeaa774', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-951b898a-feba-407e-800f-c2ddb90fe85f tempest-ProjectReaderTests-849566068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ca5c1c7-0998-49c2-bf92-5bcaf35e4cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:26 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-951b898a-feba-407e-800f-c2ddb90fe85f tempest-ProjectReaderTests-849566068 None] Volume volume-65a59a31-4381-4ce7-9cc2-590a7eeaa774 (65a59a31-4381-4ce7-9cc2-590a7eeaa774): created successfully Jul 07 17:30:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-951b898a-feba-407e-800f-c2ddb90fe85f tempest-ProjectReaderTests-849566068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ca5c1c7-0998-49c2-bf92-5bcaf35e4cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-951b898a-feba-407e-800f-c2ddb90fe85f tempest-ProjectReaderTests-849566068 None] Flow 'volume_create_manager' (7f486884-2f37-4a81-a4df-7fd30449b484) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:27 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-951b898a-feba-407e-800f-c2ddb90fe85f tempest-ProjectReaderTests-849566068 None] Created volume successfully. Jul 07 17:30:27 devstack sudo[99478]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-706a69fe-0c12-41e6-8cda-402592882656 tempest-AttachVolumeNegativeTest-1224056977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2767b127-68ae-4b91-954c-71e572c23c78" returned: 0 in 0.821s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:27 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-706a69fe-0c12-41e6-8cda-402592882656 tempest-AttachVolumeNegativeTest-1224056977 None] Lock "cinder-quobyte-2767b127-68ae-4b91-954c-71e572c23c78" released by "delete_volume" :: held 1.695s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:27 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-706a69fe-0c12-41e6-8cda-402592882656 tempest-AttachVolumeNegativeTest-1224056977 None] Created reservations ['ff94f611-79de-41c3-b6c4-9e4273762f56', 'faf34a55-47ed-440f-ae1e-d65387fbca34', 'c66784e0-d79f-466b-a442-48826c7fae68', '4b67d64f-e4ac-491a-8e46-0472e1af9190'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:30:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-706a69fe-0c12-41e6-8cda-402592882656 tempest-AttachVolumeNegativeTest-1224056977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-706a69fe-0c12-41e6-8cda-402592882656 tempest-AttachVolumeNegativeTest-1224056977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:27 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-706a69fe-0c12-41e6-8cda-402592882656 tempest-AttachVolumeNegativeTest-1224056977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:27 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-706a69fe-0c12-41e6-8cda-402592882656 tempest-AttachVolumeNegativeTest-1224056977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-706a69fe-0c12-41e6-8cda-402592882656 tempest-AttachVolumeNegativeTest-1224056977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-706a69fe-0c12-41e6-8cda-402592882656 tempest-AttachVolumeNegativeTest-1224056977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:27 devstack sudo[99484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:30:27 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:27 devstack sudo[99481]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-71c34990-e65c-4f63-b90b-a6f1ab739a28 tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b2558d64-6e60-4c64-a4f1-bb591428a95d.c8f72488-805d-49eb-9409-3a5e0a56b9d6" returned: 0 in 0.916s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:27 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-71c34990-e65c-4f63-b90b-a6f1ab739a28 tempest-VolumesSnapshotTestJSON-1060003704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2558d64-6e60-4c64-a4f1-bb591428a95d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:30:27 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4be777-055d-4638-85e7-2ac51e3d71b8]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-71c34990-e65c-4f63-b90b-a6f1ab739a28 tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b2558d64-6e60-4c64-a4f1-bb591428a95d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:27 devstack sudo[99489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b2558d64-6e60-4c64-a4f1-bb591428a95d Jul 07 17:30:27 devstack sudo[99489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:27 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-706a69fe-0c12-41e6-8cda-402592882656 tempest-AttachVolumeNegativeTest-1224056977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.741s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:27 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-706a69fe-0c12-41e6-8cda-402592882656 tempest-AttachVolumeNegativeTest-1224056977 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:30:27 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-706a69fe-0c12-41e6-8cda-402592882656 tempest-AttachVolumeNegativeTest-1224056977 None] Deleted volume successfully. Jul 07 17:30:27 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-706a69fe-0c12-41e6-8cda-402592882656 tempest-AttachVolumeNegativeTest-1224056977 None] Lock "cinder-2767b127-68ae-4b91-954c-71e572c23c78-delete_volume" released by "delete_volume" :: held 2.694s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:28 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9d629ebd-eada-418d-834d-f7e137ad5f6c tempest-ProjectReaderTests-849566068 None] Acquiring lock "cinder-65a59a31-4381-4ce7-9cc2-590a7eeaa774-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:28 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9d629ebd-eada-418d-834d-f7e137ad5f6c tempest-ProjectReaderTests-849566068 None] Lock "cinder-65a59a31-4381-4ce7-9cc2-590a7eeaa774-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:28 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9d629ebd-eada-418d-834d-f7e137ad5f6c tempest-ProjectReaderTests-849566068 None] Acquiring lock "cinder-quobyte-65a59a31-4381-4ce7-9cc2-590a7eeaa774" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:28 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9d629ebd-eada-418d-834d-f7e137ad5f6c tempest-ProjectReaderTests-849566068 None] Lock "cinder-quobyte-65a59a31-4381-4ce7-9cc2-590a7eeaa774" acquired by "delete_volume" :: waited 0.022s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:28 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8704e5d4-ddca-4397-92f4-e74fbdb156dc]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9d629ebd-eada-418d-834d-f7e137ad5f6c tempest-ProjectReaderTests-849566068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-65a59a31-4381-4ce7-9cc2-590a7eeaa774 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:28 devstack sudo[99492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-65a59a31-4381-4ce7-9cc2-590a7eeaa774 Jul 07 17:30:28 devstack sudo[99492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:28 devstack sudo[99489]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-71c34990-e65c-4f63-b90b-a6f1ab739a28 tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b2558d64-6e60-4c64-a4f1-bb591428a95d" returned: 0 in 0.924s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-71c34990-e65c-4f63-b90b-a6f1ab739a28 tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b2558d64-6e60-4c64-a4f1-bb591428a95d.c8f72488-805d-49eb-9409-3a5e0a56b9d6 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:28 devstack sudo[99498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b2558d64-6e60-4c64-a4f1-bb591428a95d.c8f72488-805d-49eb-9409-3a5e0a56b9d6 Jul 07 17:30:28 devstack sudo[99498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:29 devstack sudo[99492]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9d629ebd-eada-418d-834d-f7e137ad5f6c tempest-ProjectReaderTests-849566068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-65a59a31-4381-4ce7-9cc2-590a7eeaa774" returned: 0 in 1.096s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9d629ebd-eada-418d-834d-f7e137ad5f6c tempest-ProjectReaderTests-849566068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-65a59a31-4381-4ce7-9cc2-590a7eeaa774 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:29 devstack sudo[99505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-65a59a31-4381-4ce7-9cc2-590a7eeaa774 Jul 07 17:30:29 devstack sudo[99505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:29 devstack sudo[99498]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-71c34990-e65c-4f63-b90b-a6f1ab739a28 tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b2558d64-6e60-4c64-a4f1-bb591428a95d.c8f72488-805d-49eb-9409-3a5e0a56b9d6" returned: 0 in 0.978s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-71c34990-e65c-4f63-b90b-a6f1ab739a28 tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b2558d64-6e60-4c64-a4f1-bb591428a95d.c8f72488-805d-49eb-9409-3a5e0a56b9d6 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:29 devstack sudo[99508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b2558d64-6e60-4c64-a4f1-bb591428a95d.c8f72488-805d-49eb-9409-3a5e0a56b9d6 Jul 07 17:30:29 devstack sudo[99508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:30 devstack sudo[99505]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9d629ebd-eada-418d-834d-f7e137ad5f6c tempest-ProjectReaderTests-849566068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-65a59a31-4381-4ce7-9cc2-590a7eeaa774" returned: 0 in 0.807s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:30 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9d629ebd-eada-418d-834d-f7e137ad5f6c tempest-ProjectReaderTests-849566068 None] Lock "cinder-quobyte-65a59a31-4381-4ce7-9cc2-590a7eeaa774" released by "delete_volume" :: held 1.967s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:30 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-9d629ebd-eada-418d-834d-f7e137ad5f6c tempest-ProjectReaderTests-849566068 None] Created reservations ['ea377817-d669-4375-95a6-ab13bdb0fa09', '3458cefd-1990-41b1-89e2-d3abc3d2ff9d', 'ae52b95a-56ef-4896-8ff2-1f7e1da00852', 'b191ec30-08cf-4995-b47e-46336c7e41ae'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:30:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9d629ebd-eada-418d-834d-f7e137ad5f6c tempest-ProjectReaderTests-849566068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9d629ebd-eada-418d-834d-f7e137ad5f6c tempest-ProjectReaderTests-849566068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:30 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-9d629ebd-eada-418d-834d-f7e137ad5f6c tempest-ProjectReaderTests-849566068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:30 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-9d629ebd-eada-418d-834d-f7e137ad5f6c tempest-ProjectReaderTests-849566068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9d629ebd-eada-418d-834d-f7e137ad5f6c tempest-ProjectReaderTests-849566068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9d629ebd-eada-418d-834d-f7e137ad5f6c tempest-ProjectReaderTests-849566068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:30 devstack sudo[99508]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-71c34990-e65c-4f63-b90b-a6f1ab739a28 tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b2558d64-6e60-4c64-a4f1-bb591428a95d.c8f72488-805d-49eb-9409-3a5e0a56b9d6" returned: 0 in 0.776s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:30 devstack sudo[99514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:30:30 devstack sudo[99514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:30 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-71c34990-e65c-4f63-b90b-a6f1ab739a28 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "cinder-quobyte-c8f72488-805d-49eb-9409-3a5e0a56b9d6" released by "_delete_snapshot" :: held 3.805s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:30 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-71c34990-e65c-4f63-b90b-a6f1ab739a28 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "cinder-quobyte-b2558d64-6e60-4c64-a4f1-bb591428a95d" released by "delete_snapshot" :: held 3.833s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:30 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-71c34990-e65c-4f63-b90b-a6f1ab739a28 tempest-VolumesSnapshotTestJSON-1060003704 None] Created reservations ['541ecfd8-49cc-43a3-ad68-f49a83bbb640', '9a0afc48-350e-4a3f-be38-b55f5d8bb069', '06b29230-4447-4ae3-9d9d-356b2850dfa7', '29a79d46-cfa3-4bfe-9734-b433e8a9780d'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:30:30 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-71c34990-e65c-4f63-b90b-a6f1ab739a28 tempest-VolumesSnapshotTestJSON-1060003704 None] Delete snapshot completed successfully. Jul 07 17:30:30 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-71c34990-e65c-4f63-b90b-a6f1ab739a28 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "cinder-c8f72488-805d-49eb-9409-3a5e0a56b9d6-delete_snapshot" released by "delete_snapshot" :: held 4.123s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:31 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9aae73c-6175-4f29-8580-284ff773c10e tempest-ProjectReaderTests-849566068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:30:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b9aae73c-6175-4f29-8580-284ff773c10e tempest-ProjectReaderTests-849566068 None] Flow 'volume_create_manager' (942850b0-9660-4a6b-b986-a0a3fe49e8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b9aae73c-6175-4f29-8580-284ff773c10e tempest-ProjectReaderTests-849566068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a4bdfe9-4094-4b58-8a18-d944a76f534b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b9aae73c-6175-4f29-8580-284ff773c10e tempest-ProjectReaderTests-849566068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a4bdfe9-4094-4b58-8a18-d944a76f534b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1304441583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4235e21b-76cf-4ebe-a701-f33ca93b435f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9d32ff90a79449095dc5453cef17814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:31Z,use_quota=True,user_id='633387f1942d4baeb612875b2d1b2506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:31 devstack sudo[99514]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b9aae73c-6175-4f29-8580-284ff773c10e tempest-ProjectReaderTests-849566068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3fa87b1-fc45-47e3-99a6-613cc79a7b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b9aae73c-6175-4f29-8580-284ff773c10e tempest-ProjectReaderTests-849566068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3fa87b1-fc45-47e3-99a6-613cc79a7b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b9aae73c-6175-4f29-8580-284ff773c10e tempest-ProjectReaderTests-849566068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c765777f-12a3-4051-b26f-9f6734e8ec51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b9aae73c-6175-4f29-8580-284ff773c10e tempest-ProjectReaderTests-849566068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c765777f-12a3-4051-b26f-9f6734e8ec51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4235e21b-76cf-4ebe-a701-f33ca93b435f', 'volume_name': 'volume-4235e21b-76cf-4ebe-a701-f33ca93b435f', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b9aae73c-6175-4f29-8580-284ff773c10e tempest-ProjectReaderTests-849566068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (783d0c79-7f60-4d68-a408-f7ea49985fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b9aae73c-6175-4f29-8580-284ff773c10e tempest-ProjectReaderTests-849566068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (783d0c79-7f60-4d68-a408-f7ea49985fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b9aae73c-6175-4f29-8580-284ff773c10e tempest-ProjectReaderTests-849566068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7bf2ca6-76f5-4bb2-ab8c-7f75e3cb9e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:31 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-b9aae73c-6175-4f29-8580-284ff773c10e tempest-ProjectReaderTests-849566068 None] Volume 4235e21b-76cf-4ebe-a701-f33ca93b435f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4235e21b-76cf-4ebe-a701-f33ca93b435f', 'volume_size': 1} Jul 07 17:30:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b9aae73c-6175-4f29-8580-284ff773c10e tempest-ProjectReaderTests-849566068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b9aae73c-6175-4f29-8580-284ff773c10e tempest-ProjectReaderTests-849566068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:31 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b9aae73c-6175-4f29-8580-284ff773c10e tempest-ProjectReaderTests-849566068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1304441583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4235e21b-76cf-4ebe-a701-f33ca93b435f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9d32ff90a79449095dc5453cef17814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:31Z,use_quota=True,user_id='633387f1942d4baeb612875b2d1b2506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:30:31 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-b9aae73c-6175-4f29-8580-284ff773c10e tempest-ProjectReaderTests-849566068 None] Creating volume 4235e21b-76cf-4ebe-a701-f33ca93b435f {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:30:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b9aae73c-6175-4f29-8580-284ff773c10e tempest-ProjectReaderTests-849566068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b9aae73c-6175-4f29-8580-284ff773c10e tempest-ProjectReaderTests-849566068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:31 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b9aae73c-6175-4f29-8580-284ff773c10e tempest-ProjectReaderTests-849566068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:31 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b9aae73c-6175-4f29-8580-284ff773c10e tempest-ProjectReaderTests-849566068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b9aae73c-6175-4f29-8580-284ff773c10e tempest-ProjectReaderTests-849566068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:31 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b9aae73c-6175-4f29-8580-284ff773c10e tempest-ProjectReaderTests-849566068 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:30:31 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-b9aae73c-6175-4f29-8580-284ff773c10e tempest-ProjectReaderTests-849566068 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:30:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b9aae73c-6175-4f29-8580-284ff773c10e tempest-ProjectReaderTests-849566068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4235e21b-76cf-4ebe-a701-f33ca93b435f 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9d629ebd-eada-418d-834d-f7e137ad5f6c tempest-ProjectReaderTests-849566068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.981s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:31 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-9d629ebd-eada-418d-834d-f7e137ad5f6c tempest-ProjectReaderTests-849566068 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:30:31 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-9d629ebd-eada-418d-834d-f7e137ad5f6c tempest-ProjectReaderTests-849566068 None] Deleted volume successfully. Jul 07 17:30:31 devstack sudo[99524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4235e21b-76cf-4ebe-a701-f33ca93b435f 1073741824 Jul 07 17:30:31 devstack sudo[99524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:31 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9d629ebd-eada-418d-834d-f7e137ad5f6c tempest-ProjectReaderTests-849566068 None] Lock "cinder-65a59a31-4381-4ce7-9cc2-590a7eeaa774-delete_volume" released by "delete_volume" :: held 3.229s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:31 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-272b60b5-fc25-45e3-8c53-ee9b8e15761e tempest-VolumesSnapshotTestJSON-1060003704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:30:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-272b60b5-fc25-45e3-8c53-ee9b8e15761e tempest-VolumesSnapshotTestJSON-1060003704 None] Flow 'volume_create_manager' (b363486f-5da0-4fbd-b2e7-c16eeb2ddbc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-272b60b5-fc25-45e3-8c53-ee9b8e15761e tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9034017-ff0b-4f2d-9516-cb0b66d16477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-272b60b5-fc25-45e3-8c53-ee9b8e15761e tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9034017-ff0b-4f2d-9516-cb0b66d16477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-511258313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc87797b-8856-4668-a4df-4b36ef7e451a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7189f681c2474250884e895d36964163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:32Z,use_quota=True,user_id='3a40585286124ecd838d56d41d077832',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-272b60b5-fc25-45e3-8c53-ee9b8e15761e tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (094da740-0daf-4a07-bd6b-9907957ec39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-272b60b5-fc25-45e3-8c53-ee9b8e15761e tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (094da740-0daf-4a07-bd6b-9907957ec39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-272b60b5-fc25-45e3-8c53-ee9b8e15761e tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d271a788-d9cd-4113-8b73-eb7491351102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-272b60b5-fc25-45e3-8c53-ee9b8e15761e tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d271a788-d9cd-4113-8b73-eb7491351102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc87797b-8856-4668-a4df-4b36ef7e451a', 'volume_name': 'volume-cc87797b-8856-4668-a4df-4b36ef7e451a', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-272b60b5-fc25-45e3-8c53-ee9b8e15761e tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db062ca5-e11d-4657-8a88-a77d4e5dbe64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-272b60b5-fc25-45e3-8c53-ee9b8e15761e tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db062ca5-e11d-4657-8a88-a77d4e5dbe64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-272b60b5-fc25-45e3-8c53-ee9b8e15761e tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b037338-c1ed-41e0-a44a-665e93f54ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:31 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-272b60b5-fc25-45e3-8c53-ee9b8e15761e tempest-VolumesSnapshotTestJSON-1060003704 None] Volume cc87797b-8856-4668-a4df-4b36ef7e451a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc87797b-8856-4668-a4df-4b36ef7e451a', 'volume_size': 1} Jul 07 17:30:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-272b60b5-fc25-45e3-8c53-ee9b8e15761e tempest-VolumesSnapshotTestJSON-1060003704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:32 devstack sudo[99524]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b9aae73c-6175-4f29-8580-284ff773c10e tempest-ProjectReaderTests-849566068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4235e21b-76cf-4ebe-a701-f33ca93b435f 1073741824" returned: 0 in 1.015s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b9aae73c-6175-4f29-8580-284ff773c10e tempest-ProjectReaderTests-849566068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4235e21b-76cf-4ebe-a701-f33ca93b435f {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:32 devstack sudo[99531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4235e21b-76cf-4ebe-a701-f33ca93b435f Jul 07 17:30:32 devstack sudo[99531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:33 devstack sudo[99531]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b9aae73c-6175-4f29-8580-284ff773c10e tempest-ProjectReaderTests-849566068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4235e21b-76cf-4ebe-a701-f33ca93b435f" returned: 0 in 0.690s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:33 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b9aae73c-6175-4f29-8580-284ff773c10e tempest-ProjectReaderTests-849566068 None] <== create_volume: return (1764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:30:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b9aae73c-6175-4f29-8580-284ff773c10e tempest-ProjectReaderTests-849566068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.767s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-272b60b5-fc25-45e3-8c53-ee9b8e15761e tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.158s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:33 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-272b60b5-fc25-45e3-8c53-ee9b8e15761e tempest-VolumesSnapshotTestJSON-1060003704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-511258313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc87797b-8856-4668-a4df-4b36ef7e451a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7189f681c2474250884e895d36964163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:32Z,use_quota=True,user_id='3a40585286124ecd838d56d41d077832',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:30:33 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-272b60b5-fc25-45e3-8c53-ee9b8e15761e tempest-VolumesSnapshotTestJSON-1060003704 None] Creating volume cc87797b-8856-4668-a4df-4b36ef7e451a {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:30:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-272b60b5-fc25-45e3-8c53-ee9b8e15761e tempest-VolumesSnapshotTestJSON-1060003704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-272b60b5-fc25-45e3-8c53-ee9b8e15761e tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:33 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-272b60b5-fc25-45e3-8c53-ee9b8e15761e tempest-VolumesSnapshotTestJSON-1060003704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:33 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-272b60b5-fc25-45e3-8c53-ee9b8e15761e tempest-VolumesSnapshotTestJSON-1060003704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-272b60b5-fc25-45e3-8c53-ee9b8e15761e tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:33 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-272b60b5-fc25-45e3-8c53-ee9b8e15761e tempest-VolumesSnapshotTestJSON-1060003704 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:30:33 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-272b60b5-fc25-45e3-8c53-ee9b8e15761e tempest-VolumesSnapshotTestJSON-1060003704 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:30:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-272b60b5-fc25-45e3-8c53-ee9b8e15761e tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:33 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b9aae73c-6175-4f29-8580-284ff773c10e tempest-ProjectReaderTests-849566068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7bf2ca6-76f5-4bb2-ab8c-7f75e3cb9e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4235e21b-76cf-4ebe-a701-f33ca93b435f', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:33 devstack sudo[99534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a 1073741824 Jul 07 17:30:33 devstack sudo[99534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:33 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b9aae73c-6175-4f29-8580-284ff773c10e tempest-ProjectReaderTests-849566068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70f03604-6111-441b-b7ea-636b59b03ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:33 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-b9aae73c-6175-4f29-8580-284ff773c10e tempest-ProjectReaderTests-849566068 None] Volume volume-4235e21b-76cf-4ebe-a701-f33ca93b435f (4235e21b-76cf-4ebe-a701-f33ca93b435f): created successfully Jul 07 17:30:33 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b9aae73c-6175-4f29-8580-284ff773c10e tempest-ProjectReaderTests-849566068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70f03604-6111-441b-b7ea-636b59b03ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:33 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b9aae73c-6175-4f29-8580-284ff773c10e tempest-ProjectReaderTests-849566068 None] Flow 'volume_create_manager' (942850b0-9660-4a6b-b986-a0a3fe49e8a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:33 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-b9aae73c-6175-4f29-8580-284ff773c10e tempest-ProjectReaderTests-849566068 None] Created volume successfully. Jul 07 17:30:33 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-699bc457-82e3-4074-9e6b-eb86ed809459 tempest-ProjectReaderTests-849566068 None] Acquiring lock "cinder-4235e21b-76cf-4ebe-a701-f33ca93b435f-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:33 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-699bc457-82e3-4074-9e6b-eb86ed809459 tempest-ProjectReaderTests-849566068 None] Lock "cinder-4235e21b-76cf-4ebe-a701-f33ca93b435f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:33 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-699bc457-82e3-4074-9e6b-eb86ed809459 tempest-ProjectReaderTests-849566068 None] Acquiring lock "cinder-quobyte-4235e21b-76cf-4ebe-a701-f33ca93b435f" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:33 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-699bc457-82e3-4074-9e6b-eb86ed809459 tempest-ProjectReaderTests-849566068 None] Lock "cinder-quobyte-4235e21b-76cf-4ebe-a701-f33ca93b435f" acquired by "delete_volume" :: waited 0.017s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:33 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b99bb6-d6a8-4303-a64e-6f8c6e1b6505]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-699bc457-82e3-4074-9e6b-eb86ed809459 tempest-ProjectReaderTests-849566068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4235e21b-76cf-4ebe-a701-f33ca93b435f {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:33 devstack sudo[99536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4235e21b-76cf-4ebe-a701-f33ca93b435f Jul 07 17:30:33 devstack sudo[99536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:34 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:UPDATE=133,cinder:SELECT=112,cinder:INSERT=35,cinder:DELETE=13 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:30:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-96c27f4d-8af7-4638-b1dd-111b9b42e538 req-1af08b92-c117-4514-b8b7-580802126e4d tempest-TestInstancesWithCinderVolumes-1646852817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:34 devstack sudo[99534]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-272b60b5-fc25-45e3-8c53-ee9b8e15761e tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a 1073741824" returned: 0 in 1.191s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-272b60b5-fc25-45e3-8c53-ee9b8e15761e tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:34 devstack sudo[99552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a Jul 07 17:30:34 devstack sudo[99552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:34 devstack sudo[99536]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-699bc457-82e3-4074-9e6b-eb86ed809459 tempest-ProjectReaderTests-849566068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4235e21b-76cf-4ebe-a701-f33ca93b435f" returned: 0 in 0.901s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-699bc457-82e3-4074-9e6b-eb86ed809459 tempest-ProjectReaderTests-849566068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4235e21b-76cf-4ebe-a701-f33ca93b435f {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:34 devstack sudo[99555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4235e21b-76cf-4ebe-a701-f33ca93b435f Jul 07 17:30:34 devstack sudo[99555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:35 devstack sudo[99552]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-272b60b5-fc25-45e3-8c53-ee9b8e15761e tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a" returned: 0 in 0.748s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:35 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-272b60b5-fc25-45e3-8c53-ee9b8e15761e tempest-VolumesSnapshotTestJSON-1060003704 None] <== create_volume: return (2000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:30:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-272b60b5-fc25-45e3-8c53-ee9b8e15761e tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.003s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-96c27f4d-8af7-4638-b1dd-111b9b42e538 req-1af08b92-c117-4514-b8b7-580802126e4d tempest-TestInstancesWithCinderVolumes-1646852817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.061s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:35 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-272b60b5-fc25-45e3-8c53-ee9b8e15761e tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b037338-c1ed-41e0-a44a-665e93f54ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc87797b-8856-4668-a4df-4b36ef7e451a', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:35 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-272b60b5-fc25-45e3-8c53-ee9b8e15761e tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f0f7ac1-d986-4dd8-9ea1-8d42e01cc761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:35 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec7b1f5-134f-4012-96b8-b3b2689f314e]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-96c27f4d-8af7-4638-b1dd-111b9b42e538 req-1af08b92-c117-4514-b8b7-580802126e4d tempest-TestInstancesWithCinderVolumes-1646852817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-78f0654b-9a17-414b-accd-e95532854069 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:35 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-272b60b5-fc25-45e3-8c53-ee9b8e15761e tempest-VolumesSnapshotTestJSON-1060003704 None] Volume volume-cc87797b-8856-4668-a4df-4b36ef7e451a (cc87797b-8856-4668-a4df-4b36ef7e451a): created successfully Jul 07 17:30:35 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-272b60b5-fc25-45e3-8c53-ee9b8e15761e tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f0f7ac1-d986-4dd8-9ea1-8d42e01cc761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:35 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-272b60b5-fc25-45e3-8c53-ee9b8e15761e tempest-VolumesSnapshotTestJSON-1060003704 None] Flow 'volume_create_manager' (b363486f-5da0-4fbd-b2e7-c16eeb2ddbc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:35 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-272b60b5-fc25-45e3-8c53-ee9b8e15761e tempest-VolumesSnapshotTestJSON-1060003704 None] Created volume successfully. Jul 07 17:30:35 devstack sudo[99555]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-699bc457-82e3-4074-9e6b-eb86ed809459 tempest-ProjectReaderTests-849566068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4235e21b-76cf-4ebe-a701-f33ca93b435f" returned: 0 in 0.724s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:35 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-699bc457-82e3-4074-9e6b-eb86ed809459 tempest-ProjectReaderTests-849566068 None] Lock "cinder-quobyte-4235e21b-76cf-4ebe-a701-f33ca93b435f" released by "delete_volume" :: held 1.691s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:35 devstack sudo[99559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-78f0654b-9a17-414b-accd-e95532854069 Jul 07 17:30:35 devstack sudo[99559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:35 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-699bc457-82e3-4074-9e6b-eb86ed809459 tempest-ProjectReaderTests-849566068 None] Created reservations ['8aa533e4-72db-418d-9f36-78272b1a85e7', '94c08a7a-20e8-4195-92ab-b7d66daf0771', 'b5dc8074-902e-4ab2-a72a-6d2973f59887', '60032c15-8e09-4f7e-8830-9a53500e5d88'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:30:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-699bc457-82e3-4074-9e6b-eb86ed809459 tempest-ProjectReaderTests-849566068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-699bc457-82e3-4074-9e6b-eb86ed809459 tempest-ProjectReaderTests-849566068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:35 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-699bc457-82e3-4074-9e6b-eb86ed809459 tempest-ProjectReaderTests-849566068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:35 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-699bc457-82e3-4074-9e6b-eb86ed809459 tempest-ProjectReaderTests-849566068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-699bc457-82e3-4074-9e6b-eb86ed809459 tempest-ProjectReaderTests-849566068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-699bc457-82e3-4074-9e6b-eb86ed809459 tempest-ProjectReaderTests-849566068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:35 devstack sudo[99561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:30:35 devstack sudo[99561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:36 devstack sudo[99559]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-96c27f4d-8af7-4638-b1dd-111b9b42e538 req-1af08b92-c117-4514-b8b7-580802126e4d tempest-TestInstancesWithCinderVolumes-1646852817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-78f0654b-9a17-414b-accd-e95532854069" returned: 0 in 0.847s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-96c27f4d-8af7-4638-b1dd-111b9b42e538 req-1af08b92-c117-4514-b8b7-580802126e4d tempest-TestInstancesWithCinderVolumes-1646852817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.877s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-96c27f4d-8af7-4638-b1dd-111b9b42e538 req-1af08b92-c117-4514-b8b7-580802126e4d tempest-TestInstancesWithCinderVolumes-1646852817 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7', 'name': 'volume-78f0654b-9a17-414b-accd-e95532854069', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '27839761-b858-4aec-b63f-ccbb9faa2dc1', 'enforce_multipath': True} {{(pid=87233) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:30:36 devstack sudo[99561]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-699bc457-82e3-4074-9e6b-eb86ed809459 tempest-ProjectReaderTests-849566068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.717s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:36 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-699bc457-82e3-4074-9e6b-eb86ed809459 tempest-ProjectReaderTests-849566068 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:30:36 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-699bc457-82e3-4074-9e6b-eb86ed809459 tempest-ProjectReaderTests-849566068 None] Deleted volume successfully. Jul 07 17:30:36 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-699bc457-82e3-4074-9e6b-eb86ed809459 tempest-ProjectReaderTests-849566068 None] Lock "cinder-4235e21b-76cf-4ebe-a701-f33ca93b435f-delete_volume" released by "delete_volume" :: held 2.663s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:36 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-96c27f4d-8af7-4638-b1dd-111b9b42e538 req-1af08b92-c117-4514-b8b7-580802126e4d tempest-TestInstancesWithCinderVolumes-1646852817 None] attachment_update completed successfully. Jul 07 17:30:36 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed5bebe7-37b1-4d9f-82e8-359b04caf49c tempest-ProjectReaderTests-849566068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:30:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ed5bebe7-37b1-4d9f-82e8-359b04caf49c tempest-ProjectReaderTests-849566068 None] Flow 'volume_create_manager' (8f16a9d7-1e27-44ec-9765-c5d1a443df10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ed5bebe7-37b1-4d9f-82e8-359b04caf49c tempest-ProjectReaderTests-849566068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27dd5656-afd9-4637-980d-fe257ab7a636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ed5bebe7-37b1-4d9f-82e8-359b04caf49c tempest-ProjectReaderTests-849566068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27dd5656-afd9-4637-980d-fe257ab7a636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1677033075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a63678e-5e31-4886-831a-2a18a837ca15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9d32ff90a79449095dc5453cef17814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:36Z,use_quota=True,user_id='633387f1942d4baeb612875b2d1b2506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ed5bebe7-37b1-4d9f-82e8-359b04caf49c tempest-ProjectReaderTests-849566068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9c22c6b-f32f-4490-afeb-45e165849e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ed5bebe7-37b1-4d9f-82e8-359b04caf49c tempest-ProjectReaderTests-849566068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9c22c6b-f32f-4490-afeb-45e165849e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ed5bebe7-37b1-4d9f-82e8-359b04caf49c tempest-ProjectReaderTests-849566068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb1500ad-9695-48e2-9aac-f67115ad7551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ed5bebe7-37b1-4d9f-82e8-359b04caf49c tempest-ProjectReaderTests-849566068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb1500ad-9695-48e2-9aac-f67115ad7551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a63678e-5e31-4886-831a-2a18a837ca15', 'volume_name': 'volume-8a63678e-5e31-4886-831a-2a18a837ca15', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ed5bebe7-37b1-4d9f-82e8-359b04caf49c tempest-ProjectReaderTests-849566068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b11a697d-f4b6-4d0f-a76d-09d9ebcfee7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ed5bebe7-37b1-4d9f-82e8-359b04caf49c tempest-ProjectReaderTests-849566068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b11a697d-f4b6-4d0f-a76d-09d9ebcfee7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ed5bebe7-37b1-4d9f-82e8-359b04caf49c tempest-ProjectReaderTests-849566068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7347918-75e8-48e3-8b41-449946ea7806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:36 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-ed5bebe7-37b1-4d9f-82e8-359b04caf49c tempest-ProjectReaderTests-849566068 None] Volume 8a63678e-5e31-4886-831a-2a18a837ca15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a63678e-5e31-4886-831a-2a18a837ca15', 'volume_size': 1} Jul 07 17:30:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ed5bebe7-37b1-4d9f-82e8-359b04caf49c tempest-ProjectReaderTests-849566068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ed5bebe7-37b1-4d9f-82e8-359b04caf49c tempest-ProjectReaderTests-849566068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:36 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ed5bebe7-37b1-4d9f-82e8-359b04caf49c tempest-ProjectReaderTests-849566068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1677033075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a63678e-5e31-4886-831a-2a18a837ca15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9d32ff90a79449095dc5453cef17814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:36Z,use_quota=True,user_id='633387f1942d4baeb612875b2d1b2506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:30:36 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-ed5bebe7-37b1-4d9f-82e8-359b04caf49c tempest-ProjectReaderTests-849566068 None] Creating volume 8a63678e-5e31-4886-831a-2a18a837ca15 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:30:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ed5bebe7-37b1-4d9f-82e8-359b04caf49c tempest-ProjectReaderTests-849566068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ed5bebe7-37b1-4d9f-82e8-359b04caf49c tempest-ProjectReaderTests-849566068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:36 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ed5bebe7-37b1-4d9f-82e8-359b04caf49c tempest-ProjectReaderTests-849566068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:36 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ed5bebe7-37b1-4d9f-82e8-359b04caf49c tempest-ProjectReaderTests-849566068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ed5bebe7-37b1-4d9f-82e8-359b04caf49c tempest-ProjectReaderTests-849566068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:36 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ed5bebe7-37b1-4d9f-82e8-359b04caf49c tempest-ProjectReaderTests-849566068 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:30:36 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-ed5bebe7-37b1-4d9f-82e8-359b04caf49c tempest-ProjectReaderTests-849566068 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:30:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ed5bebe7-37b1-4d9f-82e8-359b04caf49c tempest-ProjectReaderTests-849566068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8a63678e-5e31-4886-831a-2a18a837ca15 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:36 devstack sudo[99568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8a63678e-5e31-4886-831a-2a18a837ca15 1073741824 Jul 07 17:30:36 devstack sudo[99568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-00456855-d720-42b3-9c5e-e4f21f2db1b5 tempest-VolumesSnapshotTestJSON-1060003704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:37 devstack sudo[99568]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ed5bebe7-37b1-4d9f-82e8-359b04caf49c tempest-ProjectReaderTests-849566068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8a63678e-5e31-4886-831a-2a18a837ca15 1073741824" returned: 0 in 0.995s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ed5bebe7-37b1-4d9f-82e8-359b04caf49c tempest-ProjectReaderTests-849566068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8a63678e-5e31-4886-831a-2a18a837ca15 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:37 devstack sudo[99576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8a63678e-5e31-4886-831a-2a18a837ca15 Jul 07 17:30:37 devstack sudo[99576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:38 devstack sudo[99576]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ed5bebe7-37b1-4d9f-82e8-359b04caf49c tempest-ProjectReaderTests-849566068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8a63678e-5e31-4886-831a-2a18a837ca15" returned: 0 in 0.692s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:38 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ed5bebe7-37b1-4d9f-82e8-359b04caf49c tempest-ProjectReaderTests-849566068 None] <== create_volume: return (1750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:30:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ed5bebe7-37b1-4d9f-82e8-359b04caf49c tempest-ProjectReaderTests-849566068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.754s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-00456855-d720-42b3-9c5e-e4f21f2db1b5 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.658s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:38 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-00456855-d720-42b3-9c5e-e4f21f2db1b5 tempest-VolumesSnapshotTestJSON-1060003704 None] Creating offline snapshot aa65b36f-d46d-4b24-b4ac-81b3a08cac02 of volume cc87797b-8856-4668-a4df-4b36ef7e451a {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:30:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ed5bebe7-37b1-4d9f-82e8-359b04caf49c tempest-ProjectReaderTests-849566068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7347918-75e8-48e3-8b41-449946ea7806) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a63678e-5e31-4886-831a-2a18a837ca15', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ed5bebe7-37b1-4d9f-82e8-359b04caf49c tempest-ProjectReaderTests-849566068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0ea7639-2ed6-45a5-903a-4db5c2099e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:38 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a597e60-0fc2-4f9d-9427-4f9adc0db2b2]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-00456855-d720-42b3-9c5e-e4f21f2db1b5 tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:38 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-ed5bebe7-37b1-4d9f-82e8-359b04caf49c tempest-ProjectReaderTests-849566068 None] Volume volume-8a63678e-5e31-4886-831a-2a18a837ca15 (8a63678e-5e31-4886-831a-2a18a837ca15): created successfully Jul 07 17:30:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ed5bebe7-37b1-4d9f-82e8-359b04caf49c tempest-ProjectReaderTests-849566068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0ea7639-2ed6-45a5-903a-4db5c2099e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ed5bebe7-37b1-4d9f-82e8-359b04caf49c tempest-ProjectReaderTests-849566068 None] Flow 'volume_create_manager' (8f16a9d7-1e27-44ec-9765-c5d1a443df10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:38 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-ed5bebe7-37b1-4d9f-82e8-359b04caf49c tempest-ProjectReaderTests-849566068 None] Created volume successfully. Jul 07 17:30:38 devstack sudo[99579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a Jul 07 17:30:38 devstack sudo[99579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:38 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-4127c011-a248-445e-941c-d8ee1b29a304 tempest-ProjectReaderTests-849566068 None] Acquiring lock "cinder-8a63678e-5e31-4886-831a-2a18a837ca15-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:38 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-4127c011-a248-445e-941c-d8ee1b29a304 tempest-ProjectReaderTests-849566068 None] Lock "cinder-8a63678e-5e31-4886-831a-2a18a837ca15-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:38 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-4127c011-a248-445e-941c-d8ee1b29a304 tempest-ProjectReaderTests-849566068 None] Acquiring lock "cinder-quobyte-8a63678e-5e31-4886-831a-2a18a837ca15" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:38 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-4127c011-a248-445e-941c-d8ee1b29a304 tempest-ProjectReaderTests-849566068 None] Lock "cinder-quobyte-8a63678e-5e31-4886-831a-2a18a837ca15" acquired by "delete_volume" :: waited 0.019s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:38 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[79322f41-ed85-4e05-9670-3158312d814b]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4127c011-a248-445e-941c-d8ee1b29a304 tempest-ProjectReaderTests-849566068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8a63678e-5e31-4886-831a-2a18a837ca15 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:38 devstack sudo[99581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8a63678e-5e31-4886-831a-2a18a837ca15 Jul 07 17:30:38 devstack sudo[99581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:39 devstack sudo[99579]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-00456855-d720-42b3-9c5e-e4f21f2db1b5 tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a" returned: 0 in 0.847s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-00456855-d720-42b3-9c5e-e4f21f2db1b5 tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a.aa65b36f-d46d-4b24-b4ac-81b3a08cac02 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:39 devstack sudo[99586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a.aa65b36f-d46d-4b24-b4ac-81b3a08cac02 1G Jul 07 17:30:39 devstack sudo[99586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:39 devstack sudo[99581]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4127c011-a248-445e-941c-d8ee1b29a304 tempest-ProjectReaderTests-849566068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8a63678e-5e31-4886-831a-2a18a837ca15" returned: 0 in 0.867s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4127c011-a248-445e-941c-d8ee1b29a304 tempest-ProjectReaderTests-849566068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8a63678e-5e31-4886-831a-2a18a837ca15 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:39 devstack sudo[99592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8a63678e-5e31-4886-831a-2a18a837ca15 Jul 07 17:30:39 devstack sudo[99592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:39 devstack sudo[99586]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-00456855-d720-42b3-9c5e-e4f21f2db1b5 tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a.aa65b36f-d46d-4b24-b4ac-81b3a08cac02 1G" returned: 0 in 0.874s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-00456855-d720-42b3-9c5e-e4f21f2db1b5 tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc87797b-8856-4668-a4df-4b36ef7e451a -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a.aa65b36f-d46d-4b24-b4ac-81b3a08cac02 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:39 devstack sudo[99598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc87797b-8856-4668-a4df-4b36ef7e451a -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a.aa65b36f-d46d-4b24-b4ac-81b3a08cac02 Jul 07 17:30:39 devstack sudo[99598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:40 devstack sudo[99592]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4127c011-a248-445e-941c-d8ee1b29a304 tempest-ProjectReaderTests-849566068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8a63678e-5e31-4886-831a-2a18a837ca15" returned: 0 in 0.738s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:40 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-4127c011-a248-445e-941c-d8ee1b29a304 tempest-ProjectReaderTests-849566068 None] Lock "cinder-quobyte-8a63678e-5e31-4886-831a-2a18a837ca15" released by "delete_volume" :: held 1.665s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:40 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-4127c011-a248-445e-941c-d8ee1b29a304 tempest-ProjectReaderTests-849566068 None] Created reservations ['46bb052c-44d9-4be7-acd0-a0357c11a2b3', '939fe193-9657-42cb-b866-eb1de8bb3943', 'dffc6bd5-3910-44ee-9350-49540f19ec54', '026b7e41-909d-4a50-b94c-299b04be8053'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:30:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4127c011-a248-445e-941c-d8ee1b29a304 tempest-ProjectReaderTests-849566068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4127c011-a248-445e-941c-d8ee1b29a304 tempest-ProjectReaderTests-849566068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:40 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-4127c011-a248-445e-941c-d8ee1b29a304 tempest-ProjectReaderTests-849566068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:40 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-4127c011-a248-445e-941c-d8ee1b29a304 tempest-ProjectReaderTests-849566068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4127c011-a248-445e-941c-d8ee1b29a304 tempest-ProjectReaderTests-849566068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4127c011-a248-445e-941c-d8ee1b29a304 tempest-ProjectReaderTests-849566068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:40 devstack sudo[99602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:30:40 devstack sudo[99602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:40 devstack sudo[99598]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-00456855-d720-42b3-9c5e-e4f21f2db1b5 tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc87797b-8856-4668-a4df-4b36ef7e451a -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a.aa65b36f-d46d-4b24-b4ac-81b3a08cac02" returned: 0 in 0.830s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:40 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-00456855-d720-42b3-9c5e-e4f21f2db1b5 tempest-VolumesSnapshotTestJSON-1060003704 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a.aa65b36f-d46d-4b24-b4ac-81b3a08cac02 is being set with open permissions: ugo+rw Jul 07 17:30:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-00456855-d720-42b3-9c5e-e4f21f2db1b5 tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a.aa65b36f-d46d-4b24-b4ac-81b3a08cac02 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:40 devstack sudo[99614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a.aa65b36f-d46d-4b24-b4ac-81b3a08cac02 Jul 07 17:30:40 devstack sudo[99614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:41 devstack sudo[99602]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4127c011-a248-445e-941c-d8ee1b29a304 tempest-ProjectReaderTests-849566068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.873s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:41 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-4127c011-a248-445e-941c-d8ee1b29a304 tempest-ProjectReaderTests-849566068 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:30:41 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-4127c011-a248-445e-941c-d8ee1b29a304 tempest-ProjectReaderTests-849566068 None] Deleted volume successfully. Jul 07 17:30:41 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-4127c011-a248-445e-941c-d8ee1b29a304 tempest-ProjectReaderTests-849566068 None] Lock "cinder-8a63678e-5e31-4886-831a-2a18a837ca15-delete_volume" released by "delete_volume" :: held 2.821s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:41 devstack sudo[99614]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-00456855-d720-42b3-9c5e-e4f21f2db1b5 tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a.aa65b36f-d46d-4b24-b4ac-81b3a08cac02" returned: 0 in 0.794s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-00456855-d720-42b3-9c5e-e4f21f2db1b5 tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:41 devstack sudo[99621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a.info Jul 07 17:30:41 devstack sudo[99621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:42 devstack sudo[99621]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-00456855-d720-42b3-9c5e-e4f21f2db1b5 tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a.info" returned: 0 in 0.814s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:42 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-00456855-d720-42b3-9c5e-e4f21f2db1b5 tempest-VolumesSnapshotTestJSON-1060003704 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a.info is being set with open permissions: ugo+rw Jul 07 17:30:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-00456855-d720-42b3-9c5e-e4f21f2db1b5 tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:42 devstack sudo[99624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a.info Jul 07 17:30:42 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:43 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-00456855-d720-42b3-9c5e-e4f21f2db1b5 tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a.info" returned: 0 in 0.756s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-00456855-d720-42b3-9c5e-e4f21f2db1b5 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.041s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:43 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:SELECT=127,cinder:INSERT=37,cinder:UPDATE=152,cinder:DELETE=13 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:30:43 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-00456855-d720-42b3-9c5e-e4f21f2db1b5 tempest-VolumesSnapshotTestJSON-1060003704 None] Create snapshot completed successfully Jul 07 17:30:43 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:30:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:43 devstack sudo[99627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:30:43 devstack sudo[99627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:44 devstack sudo[99627]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.734s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:44 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:30:44 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:30:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread count: 28 {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:30:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread info: [<_MainThread(MainThread, started 126077716062336)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:30:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-829169a3-ff8c-40c5-8226-00322394067b req-c185bd57-1026-41ab-b32e-18551d149110 tempest-TestInstancesWithCinderVolumes-1646852817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-829169a3-ff8c-40c5-8226-00322394067b req-c185bd57-1026-41ab-b32e-18551d149110 tempest-TestInstancesWithCinderVolumes-1646852817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:44 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[76290cf0-5ca7-467c-bac5-b10ed4d5543d]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-829169a3-ff8c-40c5-8226-00322394067b req-c185bd57-1026-41ab-b32e-18551d149110 tempest-TestInstancesWithCinderVolumes-1646852817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f21ac044-33b9-4741-8eb1-588290f3615e {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:44 devstack sudo[99638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f21ac044-33b9-4741-8eb1-588290f3615e Jul 07 17:30:44 devstack sudo[99638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:44 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:30:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Flow 'volume_create_manager' (b8ab9127-7cc8-4e08-8428-186512f8e5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a1642a-ae2b-4785-86fc-cdab29f01c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a1642a-ae2b-4785-86fc-cdab29f01c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1649633100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e83ffc27-bf16-46f9-80b1-9463969e1435,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7189f681c2474250884e895d36964163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:44Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=aa65b36f-d46d-4b24-b4ac-81b3a08cac02,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:44Z,use_quota=True,user_id='3a40585286124ecd838d56d41d077832',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c9d007f-789c-452f-975a-98b4814c4b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c9d007f-789c-452f-975a-98b4814c4b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d7c76c2-ec5c-4282-8778-50f36f78fed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d7c76c2-ec5c-4282-8778-50f36f78fed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e83ffc27-bf16-46f9-80b1-9463969e1435', 'volume_name': 'volume-e83ffc27-bf16-46f9-80b1-9463969e1435', 'volume_size': 2, 'snapshot_id': 'aa65b36f-d46d-4b24-b4ac-81b3a08cac02'}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1168c20d-994e-47b2-8d1a-1890106b5aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1168c20d-994e-47b2-8d1a-1890106b5aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6801ac3e-1dbe-4883-89fd-169f3e9f7299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:44 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Volume e83ffc27-bf16-46f9-80b1-9463969e1435: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e83ffc27-bf16-46f9-80b1-9463969e1435', 'volume_size': 2, 'snapshot_id': 'aa65b36f-d46d-4b24-b4ac-81b3a08cac02'} Jul 07 17:30:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:45 devstack sudo[99638]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-829169a3-ff8c-40c5-8226-00322394067b req-c185bd57-1026-41ab-b32e-18551d149110 tempest-TestInstancesWithCinderVolumes-1646852817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f21ac044-33b9-4741-8eb1-588290f3615e" returned: 0 in 0.838s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-829169a3-ff8c-40c5-8226-00322394067b req-c185bd57-1026-41ab-b32e-18551d149110 tempest-TestInstancesWithCinderVolumes-1646852817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.866s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.563s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:45 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Acquiring lock "cinder-quobyte-aa65b36f-d46d-4b24-b4ac-81b3a08cac02-e83ffc27-bf16-46f9-80b1-9463969e1435" by "_create_volume_from_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:45 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "cinder-quobyte-aa65b36f-d46d-4b24-b4ac-81b3a08cac02-e83ffc27-bf16-46f9-80b1-9463969e1435" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:45 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Creating volume e83ffc27-bf16-46f9-80b1-9463969e1435 from snapshot aa65b36f-d46d-4b24-b4ac-81b3a08cac02 {{(pid=87233) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 17:30:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:45 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:45 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:45 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:30:45 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Acquiring lock "cinder-quobyte-e83ffc27-bf16-46f9-80b1-9463969e1435" by "_copy_volume_from_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:45 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "cinder-quobyte-e83ffc27-bf16-46f9-80b1-9463969e1435" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:45 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] snapshot: aa65b36f-d46d-4b24-b4ac-81b3a08cac02, volume: e83ffc27-bf16-46f9-80b1-9463969e1435, {{(pid=87233) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 17:30:45 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-829169a3-ff8c-40c5-8226-00322394067b req-c185bd57-1026-41ab-b32e-18551d149110 tempest-TestInstancesWithCinderVolumes-1646852817 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7', 'name': 'volume-f21ac044-33b9-4741-8eb1-588290f3615e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '172224bd-ab03-4ecc-891f-89140aa88eb5', 'enforce_multipath': True} {{(pid=87233) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:30:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:45 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:45 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:45 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce165d92-897a-41d8-9706-33aa0f77c970]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a.aa65b36f-d46d-4b24-b4ac-81b3a08cac02 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:45 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-829169a3-ff8c-40c5-8226-00322394067b req-c185bd57-1026-41ab-b32e-18551d149110 tempest-TestInstancesWithCinderVolumes-1646852817 None] attachment_update completed successfully. Jul 07 17:30:45 devstack sudo[99643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a.aa65b36f-d46d-4b24-b4ac-81b3a08cac02 Jul 07 17:30:45 devstack sudo[99643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:46 devstack sudo[99643]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a.aa65b36f-d46d-4b24-b4ac-81b3a08cac02" returned: 0 in 0.888s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:46 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc87797b-8856-4668-a4df-4b36ef7e451a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:30:46 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] will copy from snapshot at /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a {{(pid=87233) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 17:30:46 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Creating direct copy from snapshot {{(pid=87233) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 17:30:46 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[663ed732-9050-47e6-866e-146ce97d3fb3]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:46 devstack sudo[99648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a Jul 07 17:30:46 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:47 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a" returned: 0 in 0.901s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:47 devstack cinder-volume[87233]: DEBUG cinder.utils [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Path /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e83ffc27-bf16-46f9-80b1-9463969e1435 not found in is_blk_device check {{(pid=87233) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 17:30:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e83ffc27-bf16-46f9-80b1-9463969e1435 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:47 devstack sudo[99655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e83ffc27-bf16-46f9-80b1-9463969e1435 Jul 07 17:30:47 devstack sudo[99655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:52 devstack sudo[99655]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e83ffc27-bf16-46f9-80b1-9463969e1435" returned: 0 in 5.233s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:52 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c93c10-b1e8-448a-83b4-6e100ecb1e1c]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:52 devstack sudo[99678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a Jul 07 17:30:52 devstack sudo[99678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:53 devstack sudo[99678]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a" returned: 0 in 1.054s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:53 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Image conversion details: src /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a, size 1024.00 MB, duration 5.23 sec, destination /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e83ffc27-bf16-46f9-80b1-9463969e1435 {{(pid=87233) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:30:53 devstack cinder-volume[87233]: INFO cinder.image.image_utils [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Converted 1024.00 MB image at 195.63 MB/s Jul 07 17:30:53 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e83ffc27-bf16-46f9-80b1-9463969e1435 is being set with open permissions: ugo+rw Jul 07 17:30:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e83ffc27-bf16-46f9-80b1-9463969e1435 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:53 devstack sudo[99686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e83ffc27-bf16-46f9-80b1-9463969e1435 Jul 07 17:30:53 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:54 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e83ffc27-bf16-46f9-80b1-9463969e1435" returned: 0 in 0.702s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:54 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "cinder-quobyte-e83ffc27-bf16-46f9-80b1-9463969e1435" released by "_copy_volume_from_snapshot" :: held 8.900s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:54 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "cinder-quobyte-aa65b36f-d46d-4b24-b4ac-81b3a08cac02-e83ffc27-bf16-46f9-80b1-9463969e1435" released by "_create_volume_from_snapshot" :: held 8.934s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.959s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6801ac3e-1dbe-4883-89fd-169f3e9f7299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e83ffc27-bf16-46f9-80b1-9463969e1435', 'volume_size': 2, 'snapshot_id': 'aa65b36f-d46d-4b24-b4ac-81b3a08cac02'}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c63cb16-64d3-4fd7-8914-ee7a460bfe61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:54 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Volume volume-e83ffc27-bf16-46f9-80b1-9463969e1435 (e83ffc27-bf16-46f9-80b1-9463969e1435): created successfully Jul 07 17:30:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c63cb16-64d3-4fd7-8914-ee7a460bfe61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Flow 'volume_create_manager' (b8ab9127-7cc8-4e08-8428-186512f8e5f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:54 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-b649f943-c351-4dc6-b9b5-a4b030128184 tempest-VolumesSnapshotTestJSON-1060003704 None] Created volume successfully. Jul 07 17:30:54 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6058caf0-78ec-45be-b808-b11a1b411004 tempest-VolumesSnapshotTestJSON-1060003704 None] Acquiring lock "cinder-e83ffc27-bf16-46f9-80b1-9463969e1435-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:54 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6058caf0-78ec-45be-b808-b11a1b411004 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "cinder-e83ffc27-bf16-46f9-80b1-9463969e1435-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:54 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6058caf0-78ec-45be-b808-b11a1b411004 tempest-VolumesSnapshotTestJSON-1060003704 None] Acquiring lock "cinder-quobyte-e83ffc27-bf16-46f9-80b1-9463969e1435" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:54 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6058caf0-78ec-45be-b808-b11a1b411004 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "cinder-quobyte-e83ffc27-bf16-46f9-80b1-9463969e1435" acquired by "delete_volume" :: waited 0.025s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:54 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[322cbea7-fd3e-43f5-b673-b49d9ae55b14]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6058caf0-78ec-45be-b808-b11a1b411004 tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e83ffc27-bf16-46f9-80b1-9463969e1435 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:54 devstack sudo[99712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e83ffc27-bf16-46f9-80b1-9463969e1435 Jul 07 17:30:54 devstack sudo[99712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:55 devstack sudo[99712]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6058caf0-78ec-45be-b808-b11a1b411004 tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e83ffc27-bf16-46f9-80b1-9463969e1435" returned: 0 in 0.837s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6058caf0-78ec-45be-b808-b11a1b411004 tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e83ffc27-bf16-46f9-80b1-9463969e1435 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:55 devstack sudo[99717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e83ffc27-bf16-46f9-80b1-9463969e1435 Jul 07 17:30:55 devstack sudo[99717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:56 devstack sudo[99717]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6058caf0-78ec-45be-b808-b11a1b411004 tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e83ffc27-bf16-46f9-80b1-9463969e1435" returned: 0 in 0.762s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:56 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6058caf0-78ec-45be-b808-b11a1b411004 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "cinder-quobyte-e83ffc27-bf16-46f9-80b1-9463969e1435" released by "delete_volume" :: held 1.646s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:56 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-6058caf0-78ec-45be-b808-b11a1b411004 tempest-VolumesSnapshotTestJSON-1060003704 None] Created reservations ['0fc5c0d9-c32e-4add-97e5-0efbb9b3a400', '294aeb89-3998-40e4-9cee-feb977460c65', '8eb816d1-ede5-4ac8-bf3c-5745ddabbc23', 'ff2aca87-1afd-494f-932a-6654cd799152'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:30:56 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-a2a7fec4-08ae-4815-b22f-3f454dd61e7b req-dead8500-5389-44d6-9bf2-3404cc621304 tempest-TestInstancesWithCinderVolumes-1646852817 None] Terminate volume connection completed successfully. Jul 07 17:30:56 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-a2a7fec4-08ae-4815-b22f-3f454dd61e7b req-dead8500-5389-44d6-9bf2-3404cc621304 tempest-TestInstancesWithCinderVolumes-1646852817 None] Deleting attachment 27839761-b858-4aec-b63f-ccbb9faa2dc1. {{(pid=87233) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:30:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-6058caf0-78ec-45be-b808-b11a1b411004 tempest-VolumesSnapshotTestJSON-1060003704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-6058caf0-78ec-45be-b808-b11a1b411004 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:56 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-6058caf0-78ec-45be-b808-b11a1b411004 tempest-VolumesSnapshotTestJSON-1060003704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:56 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-6058caf0-78ec-45be-b808-b11a1b411004 tempest-VolumesSnapshotTestJSON-1060003704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-6058caf0-78ec-45be-b808-b11a1b411004 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6058caf0-78ec-45be-b808-b11a1b411004 tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:56 devstack sudo[99723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:30:56 devstack sudo[99723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:57 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-77560567-e384-423b-97e0-059234b113e9 tempest-VolumesSnapshotTestJSON-1060003704 None] Acquiring lock "cinder-aa65b36f-d46d-4b24-b4ac-81b3a08cac02-delete_snapshot" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:57 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-77560567-e384-423b-97e0-059234b113e9 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "cinder-aa65b36f-d46d-4b24-b4ac-81b3a08cac02-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:57 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-77560567-e384-423b-97e0-059234b113e9 tempest-VolumesSnapshotTestJSON-1060003704 None] Acquiring lock "cinder-quobyte-cc87797b-8856-4668-a4df-4b36ef7e451a" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:57 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-77560567-e384-423b-97e0-059234b113e9 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "cinder-quobyte-cc87797b-8856-4668-a4df-4b36ef7e451a" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:57 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-77560567-e384-423b-97e0-059234b113e9 tempest-VolumesSnapshotTestJSON-1060003704 None] Acquiring lock "cinder-quobyte-aa65b36f-d46d-4b24-b4ac-81b3a08cac02" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:57 devstack sudo[99723]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6058caf0-78ec-45be-b808-b11a1b411004 tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.745s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:57 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-6058caf0-78ec-45be-b808-b11a1b411004 tempest-VolumesSnapshotTestJSON-1060003704 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:30:57 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-77560567-e384-423b-97e0-059234b113e9 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "cinder-quobyte-aa65b36f-d46d-4b24-b4ac-81b3a08cac02" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:57 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-77560567-e384-423b-97e0-059234b113e9 tempest-VolumesSnapshotTestJSON-1060003704 None] Deleting offline snapshot aa65b36f-d46d-4b24-b4ac-81b3a08cac02 of volume cc87797b-8856-4668-a4df-4b36ef7e451a {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:30:57 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-77560567-e384-423b-97e0-059234b113e9 tempest-VolumesSnapshotTestJSON-1060003704 None] snapshot_file for this snap is: volume-cc87797b-8856-4668-a4df-4b36ef7e451a.aa65b36f-d46d-4b24-b4ac-81b3a08cac02 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:30:57 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-6058caf0-78ec-45be-b808-b11a1b411004 tempest-VolumesSnapshotTestJSON-1060003704 None] Deleted volume successfully. Jul 07 17:30:57 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[194fe6e7-0f2c-4dd1-b756-c1a5835e062c]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-77560567-e384-423b-97e0-059234b113e9 tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a.aa65b36f-d46d-4b24-b4ac-81b3a08cac02 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:57 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6058caf0-78ec-45be-b808-b11a1b411004 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "cinder-e83ffc27-bf16-46f9-80b1-9463969e1435-delete_volume" released by "delete_volume" :: held 2.694s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:57 devstack sudo[99726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a.aa65b36f-d46d-4b24-b4ac-81b3a08cac02 Jul 07 17:30:57 devstack sudo[99726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:58 devstack sudo[99726]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-77560567-e384-423b-97e0-059234b113e9 tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a.aa65b36f-d46d-4b24-b4ac-81b3a08cac02" returned: 0 in 0.819s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:58 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-77560567-e384-423b-97e0-059234b113e9 tempest-VolumesSnapshotTestJSON-1060003704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc87797b-8856-4668-a4df-4b36ef7e451a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:30:58 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ea9baf-13bf-4753-bead-5af1590b49a1]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-77560567-e384-423b-97e0-059234b113e9 tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:58 devstack sudo[99731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a Jul 07 17:30:58 devstack sudo[99731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:58 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-f273b4fc-70c8-4cb1-85fc-6fbae7690e2b tempest-VolumeQuotasAdminTestJSON-574558566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:30:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f273b4fc-70c8-4cb1-85fc-6fbae7690e2b tempest-VolumeQuotasAdminTestJSON-574558566 None] Flow 'volume_create_manager' (173d9bc7-27a7-4cbf-80dd-9aa4949ef296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f273b4fc-70c8-4cb1-85fc-6fbae7690e2b tempest-VolumeQuotasAdminTestJSON-574558566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a52bcd0-0e74-4b9d-b4db-41d60605cb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f273b4fc-70c8-4cb1-85fc-6fbae7690e2b tempest-VolumeQuotasAdminTestJSON-574558566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a52bcd0-0e74-4b9d-b4db-41d60605cb28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1346133400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48d5a2ef-2f19-46aa-ad4c-99515c601b69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92258b69cbae4c468e9d2f5786a2d3dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:58Z,use_quota=True,user_id='5182308bbc4449c4bdfdccfa9d689942',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f273b4fc-70c8-4cb1-85fc-6fbae7690e2b tempest-VolumeQuotasAdminTestJSON-574558566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c5ae4d6-fd88-48be-a1a1-7447ecd24976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f273b4fc-70c8-4cb1-85fc-6fbae7690e2b tempest-VolumeQuotasAdminTestJSON-574558566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c5ae4d6-fd88-48be-a1a1-7447ecd24976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f273b4fc-70c8-4cb1-85fc-6fbae7690e2b tempest-VolumeQuotasAdminTestJSON-574558566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a74e2f11-f09b-4f4e-9578-a16f37361a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f273b4fc-70c8-4cb1-85fc-6fbae7690e2b tempest-VolumeQuotasAdminTestJSON-574558566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a74e2f11-f09b-4f4e-9578-a16f37361a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48d5a2ef-2f19-46aa-ad4c-99515c601b69', 'volume_name': 'volume-48d5a2ef-2f19-46aa-ad4c-99515c601b69', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f273b4fc-70c8-4cb1-85fc-6fbae7690e2b tempest-VolumeQuotasAdminTestJSON-574558566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f70ccfd-c90c-49dc-bef2-9acc1a26429a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f273b4fc-70c8-4cb1-85fc-6fbae7690e2b tempest-VolumeQuotasAdminTestJSON-574558566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f70ccfd-c90c-49dc-bef2-9acc1a26429a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f273b4fc-70c8-4cb1-85fc-6fbae7690e2b tempest-VolumeQuotasAdminTestJSON-574558566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ee34677-901c-4716-905a-76dcfd76da08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:58 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-f273b4fc-70c8-4cb1-85fc-6fbae7690e2b tempest-VolumeQuotasAdminTestJSON-574558566 None] Volume 48d5a2ef-2f19-46aa-ad4c-99515c601b69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48d5a2ef-2f19-46aa-ad4c-99515c601b69', 'volume_size': 1} Jul 07 17:30:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f273b4fc-70c8-4cb1-85fc-6fbae7690e2b tempest-VolumeQuotasAdminTestJSON-574558566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f273b4fc-70c8-4cb1-85fc-6fbae7690e2b tempest-VolumeQuotasAdminTestJSON-574558566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:58 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-f273b4fc-70c8-4cb1-85fc-6fbae7690e2b tempest-VolumeQuotasAdminTestJSON-574558566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1346133400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48d5a2ef-2f19-46aa-ad4c-99515c601b69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92258b69cbae4c468e9d2f5786a2d3dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:58Z,use_quota=True,user_id='5182308bbc4449c4bdfdccfa9d689942',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:30:58 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-f273b4fc-70c8-4cb1-85fc-6fbae7690e2b tempest-VolumeQuotasAdminTestJSON-574558566 None] Creating volume 48d5a2ef-2f19-46aa-ad4c-99515c601b69 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:30:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f273b4fc-70c8-4cb1-85fc-6fbae7690e2b tempest-VolumeQuotasAdminTestJSON-574558566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f273b4fc-70c8-4cb1-85fc-6fbae7690e2b tempest-VolumeQuotasAdminTestJSON-574558566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:58 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-f273b4fc-70c8-4cb1-85fc-6fbae7690e2b tempest-VolumeQuotasAdminTestJSON-574558566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:58 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-f273b4fc-70c8-4cb1-85fc-6fbae7690e2b tempest-VolumeQuotasAdminTestJSON-574558566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f273b4fc-70c8-4cb1-85fc-6fbae7690e2b tempest-VolumeQuotasAdminTestJSON-574558566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:58 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-f273b4fc-70c8-4cb1-85fc-6fbae7690e2b tempest-VolumeQuotasAdminTestJSON-574558566 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:30:58 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-f273b4fc-70c8-4cb1-85fc-6fbae7690e2b tempest-VolumeQuotasAdminTestJSON-574558566 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:30:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f273b4fc-70c8-4cb1-85fc-6fbae7690e2b tempest-VolumeQuotasAdminTestJSON-574558566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-48d5a2ef-2f19-46aa-ad4c-99515c601b69 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:58 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-bf8ff26f-717c-4bba-9d1d-ea1db8eb53c5 tempest-TestInstancesWithCinderVolumes-1646852817 None] Acquiring lock "cinder-78f0654b-9a17-414b-accd-e95532854069-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:58 devstack sudo[99735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-48d5a2ef-2f19-46aa-ad4c-99515c601b69 1073741824 Jul 07 17:30:58 devstack sudo[99735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:58 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-bf8ff26f-717c-4bba-9d1d-ea1db8eb53c5 tempest-TestInstancesWithCinderVolumes-1646852817 None] Lock "cinder-78f0654b-9a17-414b-accd-e95532854069-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:58 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-bf8ff26f-717c-4bba-9d1d-ea1db8eb53c5 tempest-TestInstancesWithCinderVolumes-1646852817 None] Acquiring lock "cinder-quobyte-78f0654b-9a17-414b-accd-e95532854069" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:58 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-bf8ff26f-717c-4bba-9d1d-ea1db8eb53c5 tempest-TestInstancesWithCinderVolumes-1646852817 None] Lock "cinder-quobyte-78f0654b-9a17-414b-accd-e95532854069" acquired by "delete_volume" :: waited 0.014s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:58 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5799b184-ee66-4e73-a155-d0ce6d959c4c]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bf8ff26f-717c-4bba-9d1d-ea1db8eb53c5 tempest-TestInstancesWithCinderVolumes-1646852817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-78f0654b-9a17-414b-accd-e95532854069 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:58 devstack sudo[99739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-78f0654b-9a17-414b-accd-e95532854069 Jul 07 17:30:58 devstack sudo[99739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:58 devstack sudo[99731]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-77560567-e384-423b-97e0-059234b113e9 tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a" returned: 0 in 0.857s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-77560567-e384-423b-97e0-059234b113e9 tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a.aa65b36f-d46d-4b24-b4ac-81b3a08cac02 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:59 devstack sudo[99744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a.aa65b36f-d46d-4b24-b4ac-81b3a08cac02 Jul 07 17:30:59 devstack sudo[99744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:59 devstack sudo[99735]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f273b4fc-70c8-4cb1-85fc-6fbae7690e2b tempest-VolumeQuotasAdminTestJSON-574558566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-48d5a2ef-2f19-46aa-ad4c-99515c601b69 1073741824" returned: 0 in 1.037s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f273b4fc-70c8-4cb1-85fc-6fbae7690e2b tempest-VolumeQuotasAdminTestJSON-574558566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-48d5a2ef-2f19-46aa-ad4c-99515c601b69 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:59 devstack sudo[99754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-48d5a2ef-2f19-46aa-ad4c-99515c601b69 Jul 07 17:30:59 devstack sudo[99754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:59 devstack sudo[99739]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bf8ff26f-717c-4bba-9d1d-ea1db8eb53c5 tempest-TestInstancesWithCinderVolumes-1646852817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-78f0654b-9a17-414b-accd-e95532854069" returned: 0 in 1.026s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bf8ff26f-717c-4bba-9d1d-ea1db8eb53c5 tempest-TestInstancesWithCinderVolumes-1646852817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-78f0654b-9a17-414b-accd-e95532854069 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:59 devstack sudo[99760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-78f0654b-9a17-414b-accd-e95532854069 Jul 07 17:30:59 devstack sudo[99760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:59 devstack sudo[99744]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-77560567-e384-423b-97e0-059234b113e9 tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a.aa65b36f-d46d-4b24-b4ac-81b3a08cac02" returned: 0 in 0.834s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-77560567-e384-423b-97e0-059234b113e9 tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a.aa65b36f-d46d-4b24-b4ac-81b3a08cac02 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:59 devstack sudo[99762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a.aa65b36f-d46d-4b24-b4ac-81b3a08cac02 Jul 07 17:30:59 devstack sudo[99762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:00 devstack sudo[99754]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f273b4fc-70c8-4cb1-85fc-6fbae7690e2b tempest-VolumeQuotasAdminTestJSON-574558566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-48d5a2ef-2f19-46aa-ad4c-99515c601b69" returned: 0 in 0.762s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:00 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-f273b4fc-70c8-4cb1-85fc-6fbae7690e2b tempest-VolumeQuotasAdminTestJSON-574558566 None] <== create_volume: return (1856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:31:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f273b4fc-70c8-4cb1-85fc-6fbae7690e2b tempest-VolumeQuotasAdminTestJSON-574558566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.859s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:00 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f273b4fc-70c8-4cb1-85fc-6fbae7690e2b tempest-VolumeQuotasAdminTestJSON-574558566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ee34677-901c-4716-905a-76dcfd76da08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48d5a2ef-2f19-46aa-ad4c-99515c601b69', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:00 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f273b4fc-70c8-4cb1-85fc-6fbae7690e2b tempest-VolumeQuotasAdminTestJSON-574558566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec87acc9-1dc0-4ae0-a9ec-f69dfdbc89cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:00 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-f273b4fc-70c8-4cb1-85fc-6fbae7690e2b tempest-VolumeQuotasAdminTestJSON-574558566 None] Volume volume-48d5a2ef-2f19-46aa-ad4c-99515c601b69 (48d5a2ef-2f19-46aa-ad4c-99515c601b69): created successfully Jul 07 17:31:00 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f273b4fc-70c8-4cb1-85fc-6fbae7690e2b tempest-VolumeQuotasAdminTestJSON-574558566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec87acc9-1dc0-4ae0-a9ec-f69dfdbc89cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:00 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f273b4fc-70c8-4cb1-85fc-6fbae7690e2b tempest-VolumeQuotasAdminTestJSON-574558566 None] Flow 'volume_create_manager' (173d9bc7-27a7-4cbf-80dd-9aa4949ef296) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:31:00 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-f273b4fc-70c8-4cb1-85fc-6fbae7690e2b tempest-VolumeQuotasAdminTestJSON-574558566 None] Created volume successfully. Jul 07 17:31:00 devstack sudo[99760]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bf8ff26f-717c-4bba-9d1d-ea1db8eb53c5 tempest-TestInstancesWithCinderVolumes-1646852817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-78f0654b-9a17-414b-accd-e95532854069" returned: 0 in 0.825s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:00 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-bf8ff26f-717c-4bba-9d1d-ea1db8eb53c5 tempest-TestInstancesWithCinderVolumes-1646852817 None] Lock "cinder-quobyte-78f0654b-9a17-414b-accd-e95532854069" released by "delete_volume" :: held 1.905s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:00 devstack cinder-volume[87233]: WARNING cinder.quota [None req-bf8ff26f-717c-4bba-9d1d-ea1db8eb53c5 tempest-TestInstancesWithCinderVolumes-1646852817 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-919362182-833060590 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-919362182-833060590, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:31:00 devstack cinder-volume[87233]: WARNING cinder.quota [None req-bf8ff26f-717c-4bba-9d1d-ea1db8eb53c5 tempest-TestInstancesWithCinderVolumes-1646852817 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-919362182-833060590 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-919362182-833060590, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:31:00 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-bf8ff26f-717c-4bba-9d1d-ea1db8eb53c5 tempest-TestInstancesWithCinderVolumes-1646852817 None] Created reservations ['834d8cbd-422e-40c2-bee8-b99b82996d5a', '0cc02d2d-a5df-4233-8a44-00584f801023', 'd4ceb140-c884-4dda-83c4-aa6ef935ef5e', 'af913516-0e3b-41bd-9a66-8dc6b189f022'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:31:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bf8ff26f-717c-4bba-9d1d-ea1db8eb53c5 tempest-TestInstancesWithCinderVolumes-1646852817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bf8ff26f-717c-4bba-9d1d-ea1db8eb53c5 tempest-TestInstancesWithCinderVolumes-1646852817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:00 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bf8ff26f-717c-4bba-9d1d-ea1db8eb53c5 tempest-TestInstancesWithCinderVolumes-1646852817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:00 devstack sudo[99762]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:00 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bf8ff26f-717c-4bba-9d1d-ea1db8eb53c5 tempest-TestInstancesWithCinderVolumes-1646852817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bf8ff26f-717c-4bba-9d1d-ea1db8eb53c5 tempest-TestInstancesWithCinderVolumes-1646852817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bf8ff26f-717c-4bba-9d1d-ea1db8eb53c5 tempest-TestInstancesWithCinderVolumes-1646852817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-77560567-e384-423b-97e0-059234b113e9 tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a.aa65b36f-d46d-4b24-b4ac-81b3a08cac02" returned: 0 in 0.869s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:00 devstack sudo[99770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:31:00 devstack sudo[99770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:00 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-77560567-e384-423b-97e0-059234b113e9 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "cinder-quobyte-aa65b36f-d46d-4b24-b4ac-81b3a08cac02" released by "_delete_snapshot" :: held 3.502s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:00 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-77560567-e384-423b-97e0-059234b113e9 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "cinder-quobyte-cc87797b-8856-4668-a4df-4b36ef7e451a" released by "delete_snapshot" :: held 3.537s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:00 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-77560567-e384-423b-97e0-059234b113e9 tempest-VolumesSnapshotTestJSON-1060003704 None] Created reservations ['a12b4dd6-5c33-4099-9aac-5ad37bd9004f', '7317ccd3-3484-4946-8e7e-a764efda44dc', 'ceb78a54-c5c0-462c-8654-2c852bd73388', '4d022e0e-4111-4eec-8c81-5e37c0b76cc6'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:31:00 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-77560567-e384-423b-97e0-059234b113e9 tempest-VolumesSnapshotTestJSON-1060003704 None] Delete snapshot completed successfully. Jul 07 17:31:00 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-77560567-e384-423b-97e0-059234b113e9 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "cinder-aa65b36f-d46d-4b24-b4ac-81b3a08cac02-delete_snapshot" released by "delete_snapshot" :: held 3.724s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:01 devstack sudo[99770]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bf8ff26f-717c-4bba-9d1d-ea1db8eb53c5 tempest-TestInstancesWithCinderVolumes-1646852817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.677s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:01 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-bf8ff26f-717c-4bba-9d1d-ea1db8eb53c5 tempest-TestInstancesWithCinderVolumes-1646852817 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:31:01 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-bf8ff26f-717c-4bba-9d1d-ea1db8eb53c5 tempest-TestInstancesWithCinderVolumes-1646852817 None] Deleted volume successfully. Jul 07 17:31:01 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-bf8ff26f-717c-4bba-9d1d-ea1db8eb53c5 tempest-TestInstancesWithCinderVolumes-1646852817 None] Lock "cinder-78f0654b-9a17-414b-accd-e95532854069-delete_volume" released by "delete_volume" :: held 2.840s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:01 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-866aac4d-68a5-406b-9aa4-34990ff433e6 tempest-VolumesSnapshotTestJSON-1060003704 None] Acquiring lock "cinder-cc87797b-8856-4668-a4df-4b36ef7e451a-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:01 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-866aac4d-68a5-406b-9aa4-34990ff433e6 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "cinder-cc87797b-8856-4668-a4df-4b36ef7e451a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:01 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-866aac4d-68a5-406b-9aa4-34990ff433e6 tempest-VolumesSnapshotTestJSON-1060003704 None] Acquiring lock "cinder-quobyte-cc87797b-8856-4668-a4df-4b36ef7e451a" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:01 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-866aac4d-68a5-406b-9aa4-34990ff433e6 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "cinder-quobyte-cc87797b-8856-4668-a4df-4b36ef7e451a" acquired by "delete_volume" :: waited 0.024s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:01 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3cb04cf-06b5-4cd4-85f2-06797d2e6b12]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-866aac4d-68a5-406b-9aa4-34990ff433e6 tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:01 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c2f334bb-98fb-4572-b37c-391d5adbbb47 tempest-VolumeQuotasAdminTestJSON-574558566 None] Acquiring lock "cinder-48d5a2ef-2f19-46aa-ad4c-99515c601b69-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:01 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c2f334bb-98fb-4572-b37c-391d5adbbb47 tempest-VolumeQuotasAdminTestJSON-574558566 None] Lock "cinder-48d5a2ef-2f19-46aa-ad4c-99515c601b69-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:01 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c2f334bb-98fb-4572-b37c-391d5adbbb47 tempest-VolumeQuotasAdminTestJSON-574558566 None] Acquiring lock "cinder-quobyte-48d5a2ef-2f19-46aa-ad4c-99515c601b69" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:01 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c2f334bb-98fb-4572-b37c-391d5adbbb47 tempest-VolumeQuotasAdminTestJSON-574558566 None] Lock "cinder-quobyte-48d5a2ef-2f19-46aa-ad4c-99515c601b69" acquired by "delete_volume" :: waited 0.015s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:01 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf0bedd-9302-4649-8869-114674ff2253]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c2f334bb-98fb-4572-b37c-391d5adbbb47 tempest-VolumeQuotasAdminTestJSON-574558566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-48d5a2ef-2f19-46aa-ad4c-99515c601b69 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:01 devstack sudo[99785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a Jul 07 17:31:01 devstack sudo[99785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:01 devstack sudo[99789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-48d5a2ef-2f19-46aa-ad4c-99515c601b69 Jul 07 17:31:01 devstack sudo[99789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:02 devstack sudo[99785]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-866aac4d-68a5-406b-9aa4-34990ff433e6 tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a" returned: 0 in 0.835s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-866aac4d-68a5-406b-9aa4-34990ff433e6 tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:02 devstack sudo[99800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a Jul 07 17:31:02 devstack sudo[99800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:02 devstack sudo[99789]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c2f334bb-98fb-4572-b37c-391d5adbbb47 tempest-VolumeQuotasAdminTestJSON-574558566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-48d5a2ef-2f19-46aa-ad4c-99515c601b69" returned: 0 in 0.845s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c2f334bb-98fb-4572-b37c-391d5adbbb47 tempest-VolumeQuotasAdminTestJSON-574558566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-48d5a2ef-2f19-46aa-ad4c-99515c601b69 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:02 devstack sudo[99803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-48d5a2ef-2f19-46aa-ad4c-99515c601b69 Jul 07 17:31:02 devstack sudo[99803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:03 devstack sudo[99800]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-866aac4d-68a5-406b-9aa4-34990ff433e6 tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc87797b-8856-4668-a4df-4b36ef7e451a" returned: 0 in 0.691s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:03 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-866aac4d-68a5-406b-9aa4-34990ff433e6 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "cinder-quobyte-cc87797b-8856-4668-a4df-4b36ef7e451a" released by "delete_volume" :: held 1.613s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:03 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-866aac4d-68a5-406b-9aa4-34990ff433e6 tempest-VolumesSnapshotTestJSON-1060003704 None] Created reservations ['2f9425e4-a4d3-4303-96b8-fe7be91ce14f', '570b6cd2-1361-41ab-a4d7-148ae1a23645', 'e3447273-d6ff-41c7-9fbb-0e3297b92c3e', 'f67cd60e-11de-4425-b5ea-f85ea94dc0d2'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:31:03 devstack sudo[99803]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c2f334bb-98fb-4572-b37c-391d5adbbb47 tempest-VolumeQuotasAdminTestJSON-574558566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-48d5a2ef-2f19-46aa-ad4c-99515c601b69" returned: 0 in 0.694s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:03 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c2f334bb-98fb-4572-b37c-391d5adbbb47 tempest-VolumeQuotasAdminTestJSON-574558566 None] Lock "cinder-quobyte-48d5a2ef-2f19-46aa-ad4c-99515c601b69" released by "delete_volume" :: held 1.594s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-866aac4d-68a5-406b-9aa4-34990ff433e6 tempest-VolumesSnapshotTestJSON-1060003704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-866aac4d-68a5-406b-9aa4-34990ff433e6 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:03 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-866aac4d-68a5-406b-9aa4-34990ff433e6 tempest-VolumesSnapshotTestJSON-1060003704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:03 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-866aac4d-68a5-406b-9aa4-34990ff433e6 tempest-VolumesSnapshotTestJSON-1060003704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-866aac4d-68a5-406b-9aa4-34990ff433e6 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-866aac4d-68a5-406b-9aa4-34990ff433e6 tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:03 devstack sudo[99808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:31:03 devstack sudo[99808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:03 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-c2f334bb-98fb-4572-b37c-391d5adbbb47 tempest-VolumeQuotasAdminTestJSON-574558566 None] Created reservations ['76ce9acc-4cd6-4296-9e31-8f91211fb789', '541d3f0b-6913-4f94-8b09-93453807bdc2', '8375d875-2deb-4c48-ada9-46007d6fe3c6', '985dfbaa-d6ce-4c1a-84ce-671b292c410e'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:31:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c2f334bb-98fb-4572-b37c-391d5adbbb47 tempest-VolumeQuotasAdminTestJSON-574558566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c2f334bb-98fb-4572-b37c-391d5adbbb47 tempest-VolumeQuotasAdminTestJSON-574558566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:03 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c2f334bb-98fb-4572-b37c-391d5adbbb47 tempest-VolumeQuotasAdminTestJSON-574558566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:03 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c2f334bb-98fb-4572-b37c-391d5adbbb47 tempest-VolumeQuotasAdminTestJSON-574558566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c2f334bb-98fb-4572-b37c-391d5adbbb47 tempest-VolumeQuotasAdminTestJSON-574558566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c2f334bb-98fb-4572-b37c-391d5adbbb47 tempest-VolumeQuotasAdminTestJSON-574558566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:03 devstack sudo[99810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:31:03 devstack sudo[99810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:03 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-9b953f79-5ec1-4225-aeb2-0b1695de8248 req-14901996-e0fb-450c-8e21-504a36f10464 tempest-TestInstancesWithCinderVolumes-1646852817 None] Terminate volume connection completed successfully. Jul 07 17:31:03 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-9b953f79-5ec1-4225-aeb2-0b1695de8248 req-14901996-e0fb-450c-8e21-504a36f10464 tempest-TestInstancesWithCinderVolumes-1646852817 None] Deleting attachment 172224bd-ab03-4ecc-891f-89140aa88eb5. {{(pid=87233) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:31:04 devstack sudo[99808]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-866aac4d-68a5-406b-9aa4-34990ff433e6 tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.701s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:04 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-866aac4d-68a5-406b-9aa4-34990ff433e6 tempest-VolumesSnapshotTestJSON-1060003704 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:31:04 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-866aac4d-68a5-406b-9aa4-34990ff433e6 tempest-VolumesSnapshotTestJSON-1060003704 None] Deleted volume successfully. Jul 07 17:31:04 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-866aac4d-68a5-406b-9aa4-34990ff433e6 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "cinder-cc87797b-8856-4668-a4df-4b36ef7e451a-delete_volume" released by "delete_volume" :: held 2.614s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:04 devstack sudo[99810]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c2f334bb-98fb-4572-b37c-391d5adbbb47 tempest-VolumeQuotasAdminTestJSON-574558566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.791s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:04 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-c2f334bb-98fb-4572-b37c-391d5adbbb47 tempest-VolumeQuotasAdminTestJSON-574558566 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:31:04 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-c2f334bb-98fb-4572-b37c-391d5adbbb47 tempest-VolumeQuotasAdminTestJSON-574558566 None] Deleted volume successfully. Jul 07 17:31:04 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c2f334bb-98fb-4572-b37c-391d5adbbb47 tempest-VolumeQuotasAdminTestJSON-574558566 None] Lock "cinder-48d5a2ef-2f19-46aa-ad4c-99515c601b69-delete_volume" released by "delete_volume" :: held 2.677s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:04 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6f1bba7-8773-4e21-818d-836493b8870d tempest-VolumesSnapshotTestJSON-1060003704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:31:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a6f1bba7-8773-4e21-818d-836493b8870d tempest-VolumesSnapshotTestJSON-1060003704 None] Flow 'volume_create_manager' (13674af7-6670-4080-aec8-71e5223603db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:31:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a6f1bba7-8773-4e21-818d-836493b8870d tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c80e4dd7-d9fa-4f40-a689-b85583e4dfe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a6f1bba7-8773-4e21-818d-836493b8870d tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c80e4dd7-d9fa-4f40-a689-b85583e4dfe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1020661291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7189f681c2474250884e895d36964163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:31:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:31:04Z,use_quota=True,user_id='3a40585286124ecd838d56d41d077832',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a6f1bba7-8773-4e21-818d-836493b8870d tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28baca10-aaba-4446-bd96-efe2c5e5c0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a6f1bba7-8773-4e21-818d-836493b8870d tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28baca10-aaba-4446-bd96-efe2c5e5c0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a6f1bba7-8773-4e21-818d-836493b8870d tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61c75219-3a54-4bc9-af2d-7fd453fd5311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a6f1bba7-8773-4e21-818d-836493b8870d tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61c75219-3a54-4bc9-af2d-7fd453fd5311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8', 'volume_name': 'volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a6f1bba7-8773-4e21-818d-836493b8870d tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f5c9c38-7c55-47ba-b921-0a012997e065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a6f1bba7-8773-4e21-818d-836493b8870d tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f5c9c38-7c55-47ba-b921-0a012997e065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a6f1bba7-8773-4e21-818d-836493b8870d tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4949896-2aba-44ea-a23f-db68b7539ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:04 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-a6f1bba7-8773-4e21-818d-836493b8870d tempest-VolumesSnapshotTestJSON-1060003704 None] Volume e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8', 'volume_size': 1} Jul 07 17:31:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a6f1bba7-8773-4e21-818d-836493b8870d tempest-VolumesSnapshotTestJSON-1060003704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a6f1bba7-8773-4e21-818d-836493b8870d tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:04 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-a6f1bba7-8773-4e21-818d-836493b8870d tempest-VolumesSnapshotTestJSON-1060003704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1020661291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7189f681c2474250884e895d36964163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:31:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:31:04Z,use_quota=True,user_id='3a40585286124ecd838d56d41d077832',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:31:04 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-a6f1bba7-8773-4e21-818d-836493b8870d tempest-VolumesSnapshotTestJSON-1060003704 None] Creating volume e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:31:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a6f1bba7-8773-4e21-818d-836493b8870d tempest-VolumesSnapshotTestJSON-1060003704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a6f1bba7-8773-4e21-818d-836493b8870d tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:04 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-a6f1bba7-8773-4e21-818d-836493b8870d tempest-VolumesSnapshotTestJSON-1060003704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:04 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-a6f1bba7-8773-4e21-818d-836493b8870d tempest-VolumesSnapshotTestJSON-1060003704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a6f1bba7-8773-4e21-818d-836493b8870d tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:04 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-a6f1bba7-8773-4e21-818d-836493b8870d tempest-VolumesSnapshotTestJSON-1060003704 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:31:04 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-a6f1bba7-8773-4e21-818d-836493b8870d tempest-VolumesSnapshotTestJSON-1060003704 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:31:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a6f1bba7-8773-4e21-818d-836493b8870d tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:04 devstack sudo[99816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8 1073741824 Jul 07 17:31:04 devstack sudo[99816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:04 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3f59ae4-bc43-48b7-a051-d0330ad3f9c3 tempest-VolumeQuotasAdminTestJSON-574558566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:31:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d3f59ae4-bc43-48b7-a051-d0330ad3f9c3 tempest-VolumeQuotasAdminTestJSON-574558566 None] Flow 'volume_create_manager' (c6740228-f5da-462d-b81e-2392a60e8b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:31:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d3f59ae4-bc43-48b7-a051-d0330ad3f9c3 tempest-VolumeQuotasAdminTestJSON-574558566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff557698-dc6c-4f13-b66f-4f91283564ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d3f59ae4-bc43-48b7-a051-d0330ad3f9c3 tempest-VolumeQuotasAdminTestJSON-574558566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff557698-dc6c-4f13-b66f-4f91283564ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:31:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-640543104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cf84f9c-4e56-4e76-bce9-f5c597758fc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92258b69cbae4c468e9d2f5786a2d3dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:31:05Z,use_quota=True,user_id='5182308bbc4449c4bdfdccfa9d689942',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d3f59ae4-bc43-48b7-a051-d0330ad3f9c3 tempest-VolumeQuotasAdminTestJSON-574558566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1630bab1-1485-431b-a78e-dd60b50764b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d3f59ae4-bc43-48b7-a051-d0330ad3f9c3 tempest-VolumeQuotasAdminTestJSON-574558566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1630bab1-1485-431b-a78e-dd60b50764b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d3f59ae4-bc43-48b7-a051-d0330ad3f9c3 tempest-VolumeQuotasAdminTestJSON-574558566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f24dd935-98e2-46a8-8e86-da19b55b074c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d3f59ae4-bc43-48b7-a051-d0330ad3f9c3 tempest-VolumeQuotasAdminTestJSON-574558566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f24dd935-98e2-46a8-8e86-da19b55b074c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cf84f9c-4e56-4e76-bce9-f5c597758fc2', 'volume_name': 'volume-4cf84f9c-4e56-4e76-bce9-f5c597758fc2', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d3f59ae4-bc43-48b7-a051-d0330ad3f9c3 tempest-VolumeQuotasAdminTestJSON-574558566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e909eb2-6211-418b-86ae-b64c80274a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d3f59ae4-bc43-48b7-a051-d0330ad3f9c3 tempest-VolumeQuotasAdminTestJSON-574558566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e909eb2-6211-418b-86ae-b64c80274a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d3f59ae4-bc43-48b7-a051-d0330ad3f9c3 tempest-VolumeQuotasAdminTestJSON-574558566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92a10cf1-13e6-4388-b42f-eea45b9eb1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:04 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-d3f59ae4-bc43-48b7-a051-d0330ad3f9c3 tempest-VolumeQuotasAdminTestJSON-574558566 None] Volume 4cf84f9c-4e56-4e76-bce9-f5c597758fc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cf84f9c-4e56-4e76-bce9-f5c597758fc2', 'volume_size': 1} Jul 07 17:31:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d3f59ae4-bc43-48b7-a051-d0330ad3f9c3 tempest-VolumeQuotasAdminTestJSON-574558566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:05 devstack sudo[99816]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a6f1bba7-8773-4e21-818d-836493b8870d tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8 1073741824" returned: 0 in 0.885s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a6f1bba7-8773-4e21-818d-836493b8870d tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:05 devstack sudo[99822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8 Jul 07 17:31:05 devstack sudo[99822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:05 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9b96ba41-eae2-4c48-8456-3f863650ba02 tempest-TestInstancesWithCinderVolumes-1646852817 None] Acquiring lock "cinder-f21ac044-33b9-4741-8eb1-588290f3615e-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:05 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9b96ba41-eae2-4c48-8456-3f863650ba02 tempest-TestInstancesWithCinderVolumes-1646852817 None] Lock "cinder-f21ac044-33b9-4741-8eb1-588290f3615e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:05 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9b96ba41-eae2-4c48-8456-3f863650ba02 tempest-TestInstancesWithCinderVolumes-1646852817 None] Acquiring lock "cinder-quobyte-f21ac044-33b9-4741-8eb1-588290f3615e" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:05 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9b96ba41-eae2-4c48-8456-3f863650ba02 tempest-TestInstancesWithCinderVolumes-1646852817 None] Lock "cinder-quobyte-f21ac044-33b9-4741-8eb1-588290f3615e" acquired by "delete_volume" :: waited 0.020s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:05 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[315d87fb-d975-48bc-8b31-b8fa4b378d8c]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9b96ba41-eae2-4c48-8456-3f863650ba02 tempest-TestInstancesWithCinderVolumes-1646852817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f21ac044-33b9-4741-8eb1-588290f3615e {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:05 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f21ac044-33b9-4741-8eb1-588290f3615e Jul 07 17:31:05 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:06 devstack sudo[99822]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a6f1bba7-8773-4e21-818d-836493b8870d tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8" returned: 0 in 0.711s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:06 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-a6f1bba7-8773-4e21-818d-836493b8870d tempest-VolumesSnapshotTestJSON-1060003704 None] <== create_volume: return (1634ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:31:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a6f1bba7-8773-4e21-818d-836493b8870d tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d3f59ae4-bc43-48b7-a051-d0330ad3f9c3 tempest-VolumeQuotasAdminTestJSON-574558566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.222s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:06 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d3f59ae4-bc43-48b7-a051-d0330ad3f9c3 tempest-VolumeQuotasAdminTestJSON-574558566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:31:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-640543104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cf84f9c-4e56-4e76-bce9-f5c597758fc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92258b69cbae4c468e9d2f5786a2d3dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:31:05Z,use_quota=True,user_id='5182308bbc4449c4bdfdccfa9d689942',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:31:06 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-d3f59ae4-bc43-48b7-a051-d0330ad3f9c3 tempest-VolumeQuotasAdminTestJSON-574558566 None] Creating volume 4cf84f9c-4e56-4e76-bce9-f5c597758fc2 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:31:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d3f59ae4-bc43-48b7-a051-d0330ad3f9c3 tempest-VolumeQuotasAdminTestJSON-574558566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d3f59ae4-bc43-48b7-a051-d0330ad3f9c3 tempest-VolumeQuotasAdminTestJSON-574558566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:06 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d3f59ae4-bc43-48b7-a051-d0330ad3f9c3 tempest-VolumeQuotasAdminTestJSON-574558566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:06 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d3f59ae4-bc43-48b7-a051-d0330ad3f9c3 tempest-VolumeQuotasAdminTestJSON-574558566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d3f59ae4-bc43-48b7-a051-d0330ad3f9c3 tempest-VolumeQuotasAdminTestJSON-574558566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:06 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d3f59ae4-bc43-48b7-a051-d0330ad3f9c3 tempest-VolumeQuotasAdminTestJSON-574558566 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:31:06 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-d3f59ae4-bc43-48b7-a051-d0330ad3f9c3 tempest-VolumeQuotasAdminTestJSON-574558566 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:31:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d3f59ae4-bc43-48b7-a051-d0330ad3f9c3 tempest-VolumeQuotasAdminTestJSON-574558566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4cf84f9c-4e56-4e76-bce9-f5c597758fc2 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:06 devstack sudo[99827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4cf84f9c-4e56-4e76-bce9-f5c597758fc2 1073741824 Jul 07 17:31:06 devstack sudo[99827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:06 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a6f1bba7-8773-4e21-818d-836493b8870d tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4949896-2aba-44ea-a23f-db68b7539ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:06 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a6f1bba7-8773-4e21-818d-836493b8870d tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a9d42b-1dde-4c90-b90b-8b0baa96b043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:06 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-a6f1bba7-8773-4e21-818d-836493b8870d tempest-VolumesSnapshotTestJSON-1060003704 None] Volume volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8 (e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8): created successfully Jul 07 17:31:06 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a6f1bba7-8773-4e21-818d-836493b8870d tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a9d42b-1dde-4c90-b90b-8b0baa96b043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:06 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a6f1bba7-8773-4e21-818d-836493b8870d tempest-VolumesSnapshotTestJSON-1060003704 None] Flow 'volume_create_manager' (13674af7-6670-4080-aec8-71e5223603db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:31:06 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-a6f1bba7-8773-4e21-818d-836493b8870d tempest-VolumesSnapshotTestJSON-1060003704 None] Created volume successfully. Jul 07 17:31:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-97c59184-a176-4bf0-bad7-2aa8573007d4 tempest-VolumesSnapshotTestJSON-1060003704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:06 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9b96ba41-eae2-4c48-8456-3f863650ba02 tempest-TestInstancesWithCinderVolumes-1646852817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f21ac044-33b9-4741-8eb1-588290f3615e" returned: 0 in 1.002s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9b96ba41-eae2-4c48-8456-3f863650ba02 tempest-TestInstancesWithCinderVolumes-1646852817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f21ac044-33b9-4741-8eb1-588290f3615e {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:06 devstack sudo[99832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f21ac044-33b9-4741-8eb1-588290f3615e Jul 07 17:31:06 devstack sudo[99832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:07 devstack sudo[99827]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d3f59ae4-bc43-48b7-a051-d0330ad3f9c3 tempest-VolumeQuotasAdminTestJSON-574558566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4cf84f9c-4e56-4e76-bce9-f5c597758fc2 1073741824" returned: 0 in 1.045s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d3f59ae4-bc43-48b7-a051-d0330ad3f9c3 tempest-VolumeQuotasAdminTestJSON-574558566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4cf84f9c-4e56-4e76-bce9-f5c597758fc2 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:07 devstack sudo[99839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4cf84f9c-4e56-4e76-bce9-f5c597758fc2 Jul 07 17:31:07 devstack sudo[99839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:07 devstack sudo[99832]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9b96ba41-eae2-4c48-8456-3f863650ba02 tempest-TestInstancesWithCinderVolumes-1646852817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f21ac044-33b9-4741-8eb1-588290f3615e" returned: 0 in 0.770s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:07 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9b96ba41-eae2-4c48-8456-3f863650ba02 tempest-TestInstancesWithCinderVolumes-1646852817 None] Lock "cinder-quobyte-f21ac044-33b9-4741-8eb1-588290f3615e" released by "delete_volume" :: held 1.834s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:07 devstack cinder-volume[87233]: WARNING cinder.quota [None req-9b96ba41-eae2-4c48-8456-3f863650ba02 tempest-TestInstancesWithCinderVolumes-1646852817 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1583937251-777048823 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1583937251-777048823, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:31:07 devstack cinder-volume[87233]: WARNING cinder.quota [None req-9b96ba41-eae2-4c48-8456-3f863650ba02 tempest-TestInstancesWithCinderVolumes-1646852817 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1583937251-777048823 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1583937251-777048823, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:31:07 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-9b96ba41-eae2-4c48-8456-3f863650ba02 tempest-TestInstancesWithCinderVolumes-1646852817 None] Created reservations ['87ebe47d-8c51-4ff5-b449-ed79c0692556', '393f15c6-e020-415a-ab1d-fc9172be7d3f', '73699893-86c0-456d-a599-ad656584f8e0', 'bcb59fc8-db12-4d5e-abb1-e0147e4625c5'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:31:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9b96ba41-eae2-4c48-8456-3f863650ba02 tempest-TestInstancesWithCinderVolumes-1646852817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9b96ba41-eae2-4c48-8456-3f863650ba02 tempest-TestInstancesWithCinderVolumes-1646852817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:07 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-9b96ba41-eae2-4c48-8456-3f863650ba02 tempest-TestInstancesWithCinderVolumes-1646852817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:07 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-9b96ba41-eae2-4c48-8456-3f863650ba02 tempest-TestInstancesWithCinderVolumes-1646852817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9b96ba41-eae2-4c48-8456-3f863650ba02 tempest-TestInstancesWithCinderVolumes-1646852817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9b96ba41-eae2-4c48-8456-3f863650ba02 tempest-TestInstancesWithCinderVolumes-1646852817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:07 devstack sudo[99842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:31:07 devstack sudo[99842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:08 devstack sudo[99839]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d3f59ae4-bc43-48b7-a051-d0330ad3f9c3 tempest-VolumeQuotasAdminTestJSON-574558566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4cf84f9c-4e56-4e76-bce9-f5c597758fc2" returned: 0 in 0.834s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:08 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d3f59ae4-bc43-48b7-a051-d0330ad3f9c3 tempest-VolumeQuotasAdminTestJSON-574558566 None] <== create_volume: return (1936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:31:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d3f59ae4-bc43-48b7-a051-d0330ad3f9c3 tempest-VolumeQuotasAdminTestJSON-574558566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.940s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-97c59184-a176-4bf0-bad7-2aa8573007d4 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.502s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:08 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-97c59184-a176-4bf0-bad7-2aa8573007d4 tempest-VolumesSnapshotTestJSON-1060003704 None] Creating offline snapshot 2b202fe9-8485-4616-84a4-fbe29cd78e4d of volume e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8 {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:31:08 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba3b0a6-c352-46ea-a548-e14e248d474e]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-97c59184-a176-4bf0-bad7-2aa8573007d4 tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:08 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d3f59ae4-bc43-48b7-a051-d0330ad3f9c3 tempest-VolumeQuotasAdminTestJSON-574558566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92a10cf1-13e6-4388-b42f-eea45b9eb1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cf84f9c-4e56-4e76-bce9-f5c597758fc2', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:08 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d3f59ae4-bc43-48b7-a051-d0330ad3f9c3 tempest-VolumeQuotasAdminTestJSON-574558566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9917dccf-6c30-46e9-8838-01f84b4413a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:08 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-d3f59ae4-bc43-48b7-a051-d0330ad3f9c3 tempest-VolumeQuotasAdminTestJSON-574558566 None] Volume volume-4cf84f9c-4e56-4e76-bce9-f5c597758fc2 (4cf84f9c-4e56-4e76-bce9-f5c597758fc2): created successfully Jul 07 17:31:08 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d3f59ae4-bc43-48b7-a051-d0330ad3f9c3 tempest-VolumeQuotasAdminTestJSON-574558566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9917dccf-6c30-46e9-8838-01f84b4413a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:08 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d3f59ae4-bc43-48b7-a051-d0330ad3f9c3 tempest-VolumeQuotasAdminTestJSON-574558566 None] Flow 'volume_create_manager' (c6740228-f5da-462d-b81e-2392a60e8b50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:31:08 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-d3f59ae4-bc43-48b7-a051-d0330ad3f9c3 tempest-VolumeQuotasAdminTestJSON-574558566 None] Created volume successfully. Jul 07 17:31:08 devstack sudo[99845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8 Jul 07 17:31:08 devstack sudo[99845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:08 devstack sudo[99842]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9b96ba41-eae2-4c48-8456-3f863650ba02 tempest-TestInstancesWithCinderVolumes-1646852817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.886s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:08 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-9b96ba41-eae2-4c48-8456-3f863650ba02 tempest-TestInstancesWithCinderVolumes-1646852817 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:31:08 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-9b96ba41-eae2-4c48-8456-3f863650ba02 tempest-TestInstancesWithCinderVolumes-1646852817 None] Deleted volume successfully. Jul 07 17:31:08 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9b96ba41-eae2-4c48-8456-3f863650ba02 tempest-TestInstancesWithCinderVolumes-1646852817 None] Lock "cinder-f21ac044-33b9-4741-8eb1-588290f3615e-delete_volume" released by "delete_volume" :: held 3.002s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:09 devstack sudo[99845]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-97c59184-a176-4bf0-bad7-2aa8573007d4 tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8" returned: 0 in 0.899s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-97c59184-a176-4bf0-bad7-2aa8573007d4 tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8.2b202fe9-8485-4616-84a4-fbe29cd78e4d 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:09 devstack sudo[99853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8.2b202fe9-8485-4616-84a4-fbe29cd78e4d 1G Jul 07 17:31:09 devstack sudo[99853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:09 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-fb8bc00f-2164-440f-be0a-a16b5d8219d7 tempest-VolumeQuotasAdminTestJSON-887934845 None] Transfer volume completed successfully. Jul 07 17:31:10 devstack sudo[99853]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-97c59184-a176-4bf0-bad7-2aa8573007d4 tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8.2b202fe9-8485-4616-84a4-fbe29cd78e4d 1G" returned: 0 in 0.985s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-97c59184-a176-4bf0-bad7-2aa8573007d4 tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8.2b202fe9-8485-4616-84a4-fbe29cd78e4d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:10 devstack sudo[99863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8.2b202fe9-8485-4616-84a4-fbe29cd78e4d Jul 07 17:31:10 devstack sudo[99863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:11 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-88b0a4ac-ed4a-4978-a4d6-a062ba24ddc2 tempest-VolumeQuotasAdminTestJSON-1682760520 None] Acquiring lock "cinder-4cf84f9c-4e56-4e76-bce9-f5c597758fc2-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:11 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-88b0a4ac-ed4a-4978-a4d6-a062ba24ddc2 tempest-VolumeQuotasAdminTestJSON-1682760520 None] Lock "cinder-4cf84f9c-4e56-4e76-bce9-f5c597758fc2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:11 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-88b0a4ac-ed4a-4978-a4d6-a062ba24ddc2 tempest-VolumeQuotasAdminTestJSON-1682760520 None] Acquiring lock "cinder-quobyte-4cf84f9c-4e56-4e76-bce9-f5c597758fc2" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:11 devstack sudo[99863]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-97c59184-a176-4bf0-bad7-2aa8573007d4 tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8.2b202fe9-8485-4616-84a4-fbe29cd78e4d" returned: 0 in 1.006s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:11 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-97c59184-a176-4bf0-bad7-2aa8573007d4 tempest-VolumesSnapshotTestJSON-1060003704 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8.2b202fe9-8485-4616-84a4-fbe29cd78e4d is being set with open permissions: ugo+rw Jul 07 17:31:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-97c59184-a176-4bf0-bad7-2aa8573007d4 tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8.2b202fe9-8485-4616-84a4-fbe29cd78e4d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:11 devstack sudo[99888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8.2b202fe9-8485-4616-84a4-fbe29cd78e4d Jul 07 17:31:11 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-88b0a4ac-ed4a-4978-a4d6-a062ba24ddc2 tempest-VolumeQuotasAdminTestJSON-1682760520 None] Lock "cinder-quobyte-4cf84f9c-4e56-4e76-bce9-f5c597758fc2" acquired by "delete_volume" :: waited 0.051s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:11 devstack sudo[99888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:11 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b06fb1-e566-485d-9ddc-2051fe7b7450]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-88b0a4ac-ed4a-4978-a4d6-a062ba24ddc2 tempest-VolumeQuotasAdminTestJSON-1682760520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4cf84f9c-4e56-4e76-bce9-f5c597758fc2 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:11 devstack sudo[99890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4cf84f9c-4e56-4e76-bce9-f5c597758fc2 Jul 07 17:31:11 devstack sudo[99890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:11 devstack sudo[99888]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-97c59184-a176-4bf0-bad7-2aa8573007d4 tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8.2b202fe9-8485-4616-84a4-fbe29cd78e4d" returned: 0 in 0.788s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-97c59184-a176-4bf0-bad7-2aa8573007d4 tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:11 devstack sudo[99896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8.info Jul 07 17:31:11 devstack sudo[99896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:12 devstack sudo[99890]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-88b0a4ac-ed4a-4978-a4d6-a062ba24ddc2 tempest-VolumeQuotasAdminTestJSON-1682760520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4cf84f9c-4e56-4e76-bce9-f5c597758fc2" returned: 0 in 0.898s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-88b0a4ac-ed4a-4978-a4d6-a062ba24ddc2 tempest-VolumeQuotasAdminTestJSON-1682760520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4cf84f9c-4e56-4e76-bce9-f5c597758fc2 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:12 devstack sudo[99899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4cf84f9c-4e56-4e76-bce9-f5c597758fc2 Jul 07 17:31:12 devstack sudo[99899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:12 devstack sudo[99896]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-97c59184-a176-4bf0-bad7-2aa8573007d4 tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8.info" returned: 0 in 0.726s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:12 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-97c59184-a176-4bf0-bad7-2aa8573007d4 tempest-VolumesSnapshotTestJSON-1060003704 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8.info is being set with open permissions: ugo+rw Jul 07 17:31:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-97c59184-a176-4bf0-bad7-2aa8573007d4 tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:12 devstack sudo[99903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8.info Jul 07 17:31:12 devstack sudo[99903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:12 devstack sudo[99899]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-88b0a4ac-ed4a-4978-a4d6-a062ba24ddc2 tempest-VolumeQuotasAdminTestJSON-1682760520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4cf84f9c-4e56-4e76-bce9-f5c597758fc2" returned: 0 in 0.655s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:12 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-88b0a4ac-ed4a-4978-a4d6-a062ba24ddc2 tempest-VolumeQuotasAdminTestJSON-1682760520 None] Lock "cinder-quobyte-4cf84f9c-4e56-4e76-bce9-f5c597758fc2" released by "delete_volume" :: held 1.607s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:12 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-88b0a4ac-ed4a-4978-a4d6-a062ba24ddc2 tempest-VolumeQuotasAdminTestJSON-1682760520 None] Created reservations ['92235bbc-346d-4210-bb48-50057c403654', '860e2b5a-78d9-4312-9f9e-23cc4990845b', '3246d021-d591-4f60-a5a2-a05384f432d3', '1e0cb4b7-7a1e-4a86-9281-06c06397f7e6'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:31:12 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-c32c7101-ddfb-4dbc-9a40-aee29f5ffc6c req-f183abcd-a2fb-4818-98d2-259f292b68f7 tempest-TestInstancesWithCinderVolumes-1646852817 None] Terminate volume connection completed successfully. Jul 07 17:31:12 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-c32c7101-ddfb-4dbc-9a40-aee29f5ffc6c req-f183abcd-a2fb-4818-98d2-259f292b68f7 tempest-TestInstancesWithCinderVolumes-1646852817 None] Deleting attachment b15948b9-36dc-40e9-a516-71b45ed8034a. {{(pid=87233) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:31:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-88b0a4ac-ed4a-4978-a4d6-a062ba24ddc2 tempest-VolumeQuotasAdminTestJSON-1682760520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-88b0a4ac-ed4a-4978-a4d6-a062ba24ddc2 tempest-VolumeQuotasAdminTestJSON-1682760520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:12 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-88b0a4ac-ed4a-4978-a4d6-a062ba24ddc2 tempest-VolumeQuotasAdminTestJSON-1682760520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:12 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-88b0a4ac-ed4a-4978-a4d6-a062ba24ddc2 tempest-VolumeQuotasAdminTestJSON-1682760520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-88b0a4ac-ed4a-4978-a4d6-a062ba24ddc2 tempest-VolumeQuotasAdminTestJSON-1682760520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-88b0a4ac-ed4a-4978-a4d6-a062ba24ddc2 tempest-VolumeQuotasAdminTestJSON-1682760520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:12 devstack sudo[99905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:31:12 devstack sudo[99905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:13 devstack sudo[99903]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-97c59184-a176-4bf0-bad7-2aa8573007d4 tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8.info" returned: 0 in 0.692s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-97c59184-a176-4bf0-bad7-2aa8573007d4 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.216s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:13 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-97c59184-a176-4bf0-bad7-2aa8573007d4 tempest-VolumesSnapshotTestJSON-1060003704 None] Create snapshot completed successfully Jul 07 17:31:13 devstack sudo[99905]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-88b0a4ac-ed4a-4978-a4d6-a062ba24ddc2 tempest-VolumeQuotasAdminTestJSON-1682760520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.704s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:13 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-88b0a4ac-ed4a-4978-a4d6-a062ba24ddc2 tempest-VolumeQuotasAdminTestJSON-1682760520 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:31:13 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-88b0a4ac-ed4a-4978-a4d6-a062ba24ddc2 tempest-VolumeQuotasAdminTestJSON-1682760520 None] Deleted volume successfully. Jul 07 17:31:13 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-88b0a4ac-ed4a-4978-a4d6-a062ba24ddc2 tempest-VolumeQuotasAdminTestJSON-1682760520 None] Lock "cinder-4cf84f9c-4e56-4e76-bce9-f5c597758fc2-delete_volume" released by "delete_volume" :: held 2.595s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:14 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:31:14 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Flow 'volume_create_manager' (9c041d73-85ec-4b4c-b83e-526653198c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:31:14 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4ade5ba-c6ab-44a4-ac88-c6868a6e9284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:14 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4ade5ba-c6ab-44a4-ac88-c6868a6e9284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-617595484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b1b5a6a-2f6e-4641-99c5-7c709123b829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7189f681c2474250884e895d36964163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2b202fe9-8485-4616-84a4-fbe29cd78e4d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:31:15Z,use_quota=True,user_id='3a40585286124ecd838d56d41d077832',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:14 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54adc7d3-6027-4909-9fd3-f8536b1a9417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:14 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54adc7d3-6027-4909-9fd3-f8536b1a9417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:14 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53872bb3-e568-4da9-98c8-1728150d6df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:14 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53872bb3-e568-4da9-98c8-1728150d6df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5b1b5a6a-2f6e-4641-99c5-7c709123b829', 'volume_name': 'volume-5b1b5a6a-2f6e-4641-99c5-7c709123b829', 'volume_size': 1, 'snapshot_id': '2b202fe9-8485-4616-84a4-fbe29cd78e4d'}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:14 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad2bcb73-f09c-4a56-a314-150b76513453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:14 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad2bcb73-f09c-4a56-a314-150b76513453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:14 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fbd659b-c2af-4980-9d17-8ac9e018ede3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:14 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Volume 5b1b5a6a-2f6e-4641-99c5-7c709123b829: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5b1b5a6a-2f6e-4641-99c5-7c709123b829', 'volume_size': 1, 'snapshot_id': '2b202fe9-8485-4616-84a4-fbe29cd78e4d'} Jul 07 17:31:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:14 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Acquiring lock "cinder-quobyte-2b202fe9-8485-4616-84a4-fbe29cd78e4d-5b1b5a6a-2f6e-4641-99c5-7c709123b829" by "_create_volume_from_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:14 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "cinder-quobyte-2b202fe9-8485-4616-84a4-fbe29cd78e4d-5b1b5a6a-2f6e-4641-99c5-7c709123b829" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:14 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Creating volume 5b1b5a6a-2f6e-4641-99c5-7c709123b829 from snapshot 2b202fe9-8485-4616-84a4-fbe29cd78e4d {{(pid=87233) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 17:31:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:14 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:14 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:14 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:31:14 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Acquiring lock "cinder-quobyte-5b1b5a6a-2f6e-4641-99c5-7c709123b829" by "_copy_volume_from_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:14 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "cinder-quobyte-5b1b5a6a-2f6e-4641-99c5-7c709123b829" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:14 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] snapshot: 2b202fe9-8485-4616-84a4-fbe29cd78e4d, volume: 5b1b5a6a-2f6e-4641-99c5-7c709123b829, {{(pid=87233) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 17:31:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:14 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:14 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:14 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[081ab124-43de-46c0-b140-efe5be5d4699]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8.2b202fe9-8485-4616-84a4-fbe29cd78e4d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:15 devstack sudo[99943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8.2b202fe9-8485-4616-84a4-fbe29cd78e4d Jul 07 17:31:15 devstack sudo[99943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:15 devstack sudo[99943]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8.2b202fe9-8485-4616-84a4-fbe29cd78e4d" returned: 0 in 0.916s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:15 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:31:15 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] will copy from snapshot at /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8 {{(pid=87233) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 17:31:15 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Creating direct copy from snapshot {{(pid=87233) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 17:31:15 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[44cc73be-825a-4462-ba48-6a2283953942]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:15 devstack sudo[99950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8 Jul 07 17:31:15 devstack sudo[99950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:16 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9dadf95c-d7d2-41b3-ae0f-f6156d29b749 tempest-TestInstancesWithCinderVolumes-1646852817 None] Acquiring lock "cinder-c3dc9c94-4ad2-41b1-a4d0-621baf2611b3-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:16 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9dadf95c-d7d2-41b3-ae0f-f6156d29b749 tempest-TestInstancesWithCinderVolumes-1646852817 None] Lock "cinder-c3dc9c94-4ad2-41b1-a4d0-621baf2611b3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:16 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9dadf95c-d7d2-41b3-ae0f-f6156d29b749 tempest-TestInstancesWithCinderVolumes-1646852817 None] Acquiring lock "cinder-quobyte-c3dc9c94-4ad2-41b1-a4d0-621baf2611b3" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:16 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9dadf95c-d7d2-41b3-ae0f-f6156d29b749 tempest-TestInstancesWithCinderVolumes-1646852817 None] Lock "cinder-quobyte-c3dc9c94-4ad2-41b1-a4d0-621baf2611b3" acquired by "delete_volume" :: waited 0.021s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:16 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[57793a4b-3835-4c13-af41-6593bdf0f723]: (4, 'raw') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9dadf95c-d7d2-41b3-ae0f-f6156d29b749 tempest-TestInstancesWithCinderVolumes-1646852817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c3dc9c94-4ad2-41b1-a4d0-621baf2611b3 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:16 devstack sudo[99952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c3dc9c94-4ad2-41b1-a4d0-621baf2611b3 Jul 07 17:31:16 devstack sudo[99952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:16 devstack sudo[99950]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8" returned: 0 in 1.007s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:16 devstack cinder-volume[87233]: DEBUG cinder.utils [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Path /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5b1b5a6a-2f6e-4641-99c5-7c709123b829 not found in is_blk_device check {{(pid=87233) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 17:31:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5b1b5a6a-2f6e-4641-99c5-7c709123b829 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:16 devstack sudo[99958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5b1b5a6a-2f6e-4641-99c5-7c709123b829 Jul 07 17:31:16 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:17 devstack sudo[99952]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9dadf95c-d7d2-41b3-ae0f-f6156d29b749 tempest-TestInstancesWithCinderVolumes-1646852817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c3dc9c94-4ad2-41b1-a4d0-621baf2611b3" returned: 0 in 0.899s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9dadf95c-d7d2-41b3-ae0f-f6156d29b749 tempest-TestInstancesWithCinderVolumes-1646852817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c3dc9c94-4ad2-41b1-a4d0-621baf2611b3 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:17 devstack sudo[99962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c3dc9c94-4ad2-41b1-a4d0-621baf2611b3 Jul 07 17:31:17 devstack sudo[99962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:18 devstack sudo[99962]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9dadf95c-d7d2-41b3-ae0f-f6156d29b749 tempest-TestInstancesWithCinderVolumes-1646852817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c3dc9c94-4ad2-41b1-a4d0-621baf2611b3" returned: 1 in 1.119s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9dadf95c-d7d2-41b3-ae0f-f6156d29b749 tempest-TestInstancesWithCinderVolumes-1646852817 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c3dc9c94-4ad2-41b1-a4d0-621baf2611b3' failed. Not Retrying. {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:31:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9dadf95c-d7d2-41b3-ae0f-f6156d29b749 tempest-TestInstancesWithCinderVolumes-1646852817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c3dc9c94-4ad2-41b1-a4d0-621baf2611b3 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:18 devstack sudo[99977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c3dc9c94-4ad2-41b1-a4d0-621baf2611b3 Jul 07 17:31:18 devstack sudo[99977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:19 devstack sudo[99977]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9dadf95c-d7d2-41b3-ae0f-f6156d29b749 tempest-TestInstancesWithCinderVolumes-1646852817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c3dc9c94-4ad2-41b1-a4d0-621baf2611b3" returned: 0 in 1.672s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:20 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9dadf95c-d7d2-41b3-ae0f-f6156d29b749 tempest-TestInstancesWithCinderVolumes-1646852817 None] Lock "cinder-quobyte-c3dc9c94-4ad2-41b1-a4d0-621baf2611b3" released by "delete_volume" :: held 3.803s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:20 devstack cinder-volume[87233]: WARNING cinder.quota [None req-9dadf95c-d7d2-41b3-ae0f-f6156d29b749 tempest-TestInstancesWithCinderVolumes-1646852817 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1661763057-1501994081 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1661763057-1501994081, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:31:20 devstack cinder-volume[87233]: WARNING cinder.quota [None req-9dadf95c-d7d2-41b3-ae0f-f6156d29b749 tempest-TestInstancesWithCinderVolumes-1646852817 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1661763057-1501994081 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1661763057-1501994081, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:31:20 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-9dadf95c-d7d2-41b3-ae0f-f6156d29b749 tempest-TestInstancesWithCinderVolumes-1646852817 None] Created reservations ['01d89371-8884-4a8b-89a2-45ccb10d7927', '3a6c717d-54d7-4141-82d2-a9b40d815444', '77a86b37-d704-4fb3-b6fc-203b92e02471', '77bf77de-ba29-4bfd-8314-60e252f7eb12'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:31:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9dadf95c-d7d2-41b3-ae0f-f6156d29b749 tempest-TestInstancesWithCinderVolumes-1646852817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9dadf95c-d7d2-41b3-ae0f-f6156d29b749 tempest-TestInstancesWithCinderVolumes-1646852817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:20 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-9dadf95c-d7d2-41b3-ae0f-f6156d29b749 tempest-TestInstancesWithCinderVolumes-1646852817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:20 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-9dadf95c-d7d2-41b3-ae0f-f6156d29b749 tempest-TestInstancesWithCinderVolumes-1646852817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9dadf95c-d7d2-41b3-ae0f-f6156d29b749 tempest-TestInstancesWithCinderVolumes-1646852817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9dadf95c-d7d2-41b3-ae0f-f6156d29b749 tempest-TestInstancesWithCinderVolumes-1646852817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:20 devstack sudo[99982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:31:20 devstack sudo[99982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:21 devstack sudo[99982]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9dadf95c-d7d2-41b3-ae0f-f6156d29b749 tempest-TestInstancesWithCinderVolumes-1646852817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 1.495s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:21 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-9dadf95c-d7d2-41b3-ae0f-f6156d29b749 tempest-TestInstancesWithCinderVolumes-1646852817 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:31:21 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-9dadf95c-d7d2-41b3-ae0f-f6156d29b749 tempest-TestInstancesWithCinderVolumes-1646852817 None] Deleted volume successfully. Jul 07 17:31:21 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9dadf95c-d7d2-41b3-ae0f-f6156d29b749 tempest-TestInstancesWithCinderVolumes-1646852817 None] Lock "cinder-c3dc9c94-4ad2-41b1-a4d0-621baf2611b3-delete_volume" released by "delete_volume" :: held 5.761s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:23 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5b1b5a6a-2f6e-4641-99c5-7c709123b829" returned: 0 in 6.190s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:23 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe68791-bcaf-47cf-8380-20503875384c]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:23 devstack sudo[99992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8 Jul 07 17:31:23 devstack sudo[99992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:24 devstack sudo[99992]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8" returned: 0 in 1.032s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:24 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Image conversion details: src /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8, size 1024.00 MB, duration 6.19 sec, destination /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5b1b5a6a-2f6e-4641-99c5-7c709123b829 {{(pid=87233) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:31:24 devstack cinder-volume[87233]: INFO cinder.image.image_utils [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Converted 1024.00 MB image at 165.41 MB/s Jul 07 17:31:24 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5b1b5a6a-2f6e-4641-99c5-7c709123b829 is being set with open permissions: ugo+rw Jul 07 17:31:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5b1b5a6a-2f6e-4641-99c5-7c709123b829 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:24 devstack sudo[99999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5b1b5a6a-2f6e-4641-99c5-7c709123b829 Jul 07 17:31:24 devstack sudo[99999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:24 devstack sudo[99999]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5b1b5a6a-2f6e-4641-99c5-7c709123b829" returned: 0 in 0.791s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:24 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "cinder-quobyte-5b1b5a6a-2f6e-4641-99c5-7c709123b829" released by "_copy_volume_from_snapshot" :: held 10.084s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:24 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "cinder-quobyte-2b202fe9-8485-4616-84a4-fbe29cd78e4d-5b1b5a6a-2f6e-4641-99c5-7c709123b829" released by "_create_volume_from_snapshot" :: held 10.144s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.173s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:24 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fbd659b-c2af-4980-9d17-8ac9e018ede3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b1b5a6a-2f6e-4641-99c5-7c709123b829', 'volume_size': 1, 'snapshot_id': '2b202fe9-8485-4616-84a4-fbe29cd78e4d'}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:24 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4249a78-82b9-4fe9-bebc-bd4e925c3f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:24 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Volume volume-5b1b5a6a-2f6e-4641-99c5-7c709123b829 (5b1b5a6a-2f6e-4641-99c5-7c709123b829): created successfully Jul 07 17:31:24 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4249a78-82b9-4fe9-bebc-bd4e925c3f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:24 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Flow 'volume_create_manager' (9c041d73-85ec-4b4c-b83e-526653198c5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:31:25 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-da9d4621-0929-4ed9-baf9-9edb9c24d78c tempest-VolumesSnapshotTestJSON-1060003704 None] Created volume successfully. Jul 07 17:31:25 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-e2860676-0143-4479-97ca-9d208e4379ee tempest-VolumesSnapshotTestJSON-1060003704 None] Acquiring lock "cinder-5b1b5a6a-2f6e-4641-99c5-7c709123b829-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:25 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-e2860676-0143-4479-97ca-9d208e4379ee tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "cinder-5b1b5a6a-2f6e-4641-99c5-7c709123b829-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:25 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-e2860676-0143-4479-97ca-9d208e4379ee tempest-VolumesSnapshotTestJSON-1060003704 None] Acquiring lock "cinder-quobyte-5b1b5a6a-2f6e-4641-99c5-7c709123b829" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:26 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-e2860676-0143-4479-97ca-9d208e4379ee tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "cinder-quobyte-5b1b5a6a-2f6e-4641-99c5-7c709123b829" acquired by "delete_volume" :: waited 0.027s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:26 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[380e23cf-70a4-4f4a-942e-fdf914c46f73]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e2860676-0143-4479-97ca-9d208e4379ee tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5b1b5a6a-2f6e-4641-99c5-7c709123b829 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:26 devstack sudo[100003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5b1b5a6a-2f6e-4641-99c5-7c709123b829 Jul 07 17:31:26 devstack sudo[100003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:26 devstack sudo[100003]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e2860676-0143-4479-97ca-9d208e4379ee tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5b1b5a6a-2f6e-4641-99c5-7c709123b829" returned: 0 in 0.936s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e2860676-0143-4479-97ca-9d208e4379ee tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5b1b5a6a-2f6e-4641-99c5-7c709123b829 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:27 devstack sudo[100008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5b1b5a6a-2f6e-4641-99c5-7c709123b829 Jul 07 17:31:27 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:27 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e2860676-0143-4479-97ca-9d208e4379ee tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5b1b5a6a-2f6e-4641-99c5-7c709123b829" returned: 0 in 0.695s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:27 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-e2860676-0143-4479-97ca-9d208e4379ee tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "cinder-quobyte-5b1b5a6a-2f6e-4641-99c5-7c709123b829" released by "delete_volume" :: held 1.692s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:27 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-e2860676-0143-4479-97ca-9d208e4379ee tempest-VolumesSnapshotTestJSON-1060003704 None] Created reservations ['ba6e66ac-e52c-4424-a4f2-18706e7f7251', 'b0e82e2f-3026-4607-b6eb-4048ca3bb4db', '0f8f1659-20ce-449c-861a-2ac8d52c4b9e', '797e1aaa-733c-4102-826d-7149cc1bf76a'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:31:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e2860676-0143-4479-97ca-9d208e4379ee tempest-VolumesSnapshotTestJSON-1060003704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e2860676-0143-4479-97ca-9d208e4379ee tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:27 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-e2860676-0143-4479-97ca-9d208e4379ee tempest-VolumesSnapshotTestJSON-1060003704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:27 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-e2860676-0143-4479-97ca-9d208e4379ee tempest-VolumesSnapshotTestJSON-1060003704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e2860676-0143-4479-97ca-9d208e4379ee tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e2860676-0143-4479-97ca-9d208e4379ee tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:27 devstack sudo[100012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:31:27 devstack sudo[100012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:28 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-99249f49-d953-43e6-ac04-76d0828cd1de tempest-VolumesSnapshotTestJSON-1060003704 None] Acquiring lock "cinder-2b202fe9-8485-4616-84a4-fbe29cd78e4d-delete_snapshot" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:28 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-99249f49-d953-43e6-ac04-76d0828cd1de tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "cinder-2b202fe9-8485-4616-84a4-fbe29cd78e4d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:28 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-99249f49-d953-43e6-ac04-76d0828cd1de tempest-VolumesSnapshotTestJSON-1060003704 None] Acquiring lock "cinder-quobyte-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:28 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-99249f49-d953-43e6-ac04-76d0828cd1de tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "cinder-quobyte-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:28 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-99249f49-d953-43e6-ac04-76d0828cd1de tempest-VolumesSnapshotTestJSON-1060003704 None] Acquiring lock "cinder-quobyte-2b202fe9-8485-4616-84a4-fbe29cd78e4d" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:28 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-99249f49-d953-43e6-ac04-76d0828cd1de tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "cinder-quobyte-2b202fe9-8485-4616-84a4-fbe29cd78e4d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:28 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-99249f49-d953-43e6-ac04-76d0828cd1de tempest-VolumesSnapshotTestJSON-1060003704 None] Deleting offline snapshot 2b202fe9-8485-4616-84a4-fbe29cd78e4d of volume e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:31:28 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-99249f49-d953-43e6-ac04-76d0828cd1de tempest-VolumesSnapshotTestJSON-1060003704 None] snapshot_file for this snap is: volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8.2b202fe9-8485-4616-84a4-fbe29cd78e4d {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:31:28 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c94510-5ff5-4273-b604-020684a5e9b0]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-99249f49-d953-43e6-ac04-76d0828cd1de tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8.2b202fe9-8485-4616-84a4-fbe29cd78e4d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:28 devstack sudo[100014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8.2b202fe9-8485-4616-84a4-fbe29cd78e4d Jul 07 17:31:28 devstack sudo[100014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:28 devstack sudo[100012]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e2860676-0143-4479-97ca-9d208e4379ee tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.874s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:28 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-e2860676-0143-4479-97ca-9d208e4379ee tempest-VolumesSnapshotTestJSON-1060003704 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:31:28 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-e2860676-0143-4479-97ca-9d208e4379ee tempest-VolumesSnapshotTestJSON-1060003704 None] Deleted volume successfully. Jul 07 17:31:28 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-e2860676-0143-4479-97ca-9d208e4379ee tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "cinder-5b1b5a6a-2f6e-4641-99c5-7c709123b829-delete_volume" released by "delete_volume" :: held 2.850s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:29 devstack sudo[100014]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-99249f49-d953-43e6-ac04-76d0828cd1de tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8.2b202fe9-8485-4616-84a4-fbe29cd78e4d" returned: 0 in 0.845s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:29 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-99249f49-d953-43e6-ac04-76d0828cd1de tempest-VolumesSnapshotTestJSON-1060003704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:31:29 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[da78cd0e-c3e9-4774-9fd7-3ad53ef4c062]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-99249f49-d953-43e6-ac04-76d0828cd1de tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:29 devstack sudo[100020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8 Jul 07 17:31:29 devstack sudo[100020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:30 devstack sudo[100020]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-99249f49-d953-43e6-ac04-76d0828cd1de tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8" returned: 0 in 0.881s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-99249f49-d953-43e6-ac04-76d0828cd1de tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8.2b202fe9-8485-4616-84a4-fbe29cd78e4d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:30 devstack sudo[100026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8.2b202fe9-8485-4616-84a4-fbe29cd78e4d Jul 07 17:31:30 devstack sudo[100026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:30 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-40298bba-b376-4645-bcfb-00e687977ec1 tempest-VolumeTypesAccessTest-1055954812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:31:30 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-40298bba-b376-4645-bcfb-00e687977ec1 tempest-VolumeTypesAccessTest-1055954812 None] Flow 'volume_create_manager' (610d9573-d197-4b6a-b3c1-1377a77ce52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:31:30 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-40298bba-b376-4645-bcfb-00e687977ec1 tempest-VolumeTypesAccessTest-1055954812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3567ab95-5a53-4d78-83e1-7c2c46dc4a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:30 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-40298bba-b376-4645-bcfb-00e687977ec1 tempest-VolumeTypesAccessTest-1055954812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3567ab95-5a53-4d78-83e1-7c2c46dc4a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1576382242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e5248fe-1dc5-4e68-9a64-4a02bd7d191c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7adf94b683a40908ceeb615e2311267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:31:31Z,use_quota=True,user_id='fa564e19661f4394b7957555d0af6df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bb40593-4796-467b-a913-de44d0180060),volume_type_id=7bb40593-4796-467b-a913-de44d0180060)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:30 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-40298bba-b376-4645-bcfb-00e687977ec1 tempest-VolumeTypesAccessTest-1055954812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92691ebc-3e20-42e5-9146-4f9092fd0011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:30 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-40298bba-b376-4645-bcfb-00e687977ec1 tempest-VolumeTypesAccessTest-1055954812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92691ebc-3e20-42e5-9146-4f9092fd0011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:30 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-40298bba-b376-4645-bcfb-00e687977ec1 tempest-VolumeTypesAccessTest-1055954812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf6de6d5-3a04-4af6-9463-3713533f67a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:30 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-40298bba-b376-4645-bcfb-00e687977ec1 tempest-VolumeTypesAccessTest-1055954812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf6de6d5-3a04-4af6-9463-3713533f67a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e5248fe-1dc5-4e68-9a64-4a02bd7d191c', 'volume_name': 'volume-8e5248fe-1dc5-4e68-9a64-4a02bd7d191c', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:30 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-40298bba-b376-4645-bcfb-00e687977ec1 tempest-VolumeTypesAccessTest-1055954812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1336e26-b8ca-417c-9e49-c83811d6c9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:30 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-40298bba-b376-4645-bcfb-00e687977ec1 tempest-VolumeTypesAccessTest-1055954812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1336e26-b8ca-417c-9e49-c83811d6c9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:30 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-40298bba-b376-4645-bcfb-00e687977ec1 tempest-VolumeTypesAccessTest-1055954812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07473728-7190-4599-a5e0-36fd30db1a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:30 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-40298bba-b376-4645-bcfb-00e687977ec1 tempest-VolumeTypesAccessTest-1055954812 None] Volume 8e5248fe-1dc5-4e68-9a64-4a02bd7d191c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e5248fe-1dc5-4e68-9a64-4a02bd7d191c', 'volume_size': 1} Jul 07 17:31:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-40298bba-b376-4645-bcfb-00e687977ec1 tempest-VolumeTypesAccessTest-1055954812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-40298bba-b376-4645-bcfb-00e687977ec1 tempest-VolumeTypesAccessTest-1055954812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:30 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-40298bba-b376-4645-bcfb-00e687977ec1 tempest-VolumeTypesAccessTest-1055954812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1576382242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e5248fe-1dc5-4e68-9a64-4a02bd7d191c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7adf94b683a40908ceeb615e2311267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:31:31Z,use_quota=True,user_id='fa564e19661f4394b7957555d0af6df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bb40593-4796-467b-a913-de44d0180060),volume_type_id=7bb40593-4796-467b-a913-de44d0180060)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:31:31 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-40298bba-b376-4645-bcfb-00e687977ec1 tempest-VolumeTypesAccessTest-1055954812 None] Creating volume 8e5248fe-1dc5-4e68-9a64-4a02bd7d191c {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:31:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-40298bba-b376-4645-bcfb-00e687977ec1 tempest-VolumeTypesAccessTest-1055954812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-40298bba-b376-4645-bcfb-00e687977ec1 tempest-VolumeTypesAccessTest-1055954812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:31 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-40298bba-b376-4645-bcfb-00e687977ec1 tempest-VolumeTypesAccessTest-1055954812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:31 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-40298bba-b376-4645-bcfb-00e687977ec1 tempest-VolumeTypesAccessTest-1055954812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-40298bba-b376-4645-bcfb-00e687977ec1 tempest-VolumeTypesAccessTest-1055954812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:31 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-40298bba-b376-4645-bcfb-00e687977ec1 tempest-VolumeTypesAccessTest-1055954812 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:31:31 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-40298bba-b376-4645-bcfb-00e687977ec1 tempest-VolumeTypesAccessTest-1055954812 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:31:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-40298bba-b376-4645-bcfb-00e687977ec1 tempest-VolumeTypesAccessTest-1055954812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8e5248fe-1dc5-4e68-9a64-4a02bd7d191c 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:31 devstack sudo[100026]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-99249f49-d953-43e6-ac04-76d0828cd1de tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8.2b202fe9-8485-4616-84a4-fbe29cd78e4d" returned: 0 in 0.858s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-99249f49-d953-43e6-ac04-76d0828cd1de tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8.2b202fe9-8485-4616-84a4-fbe29cd78e4d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:31 devstack sudo[100032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8e5248fe-1dc5-4e68-9a64-4a02bd7d191c 1073741824 Jul 07 17:31:31 devstack sudo[100032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:31 devstack sudo[100034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8.2b202fe9-8485-4616-84a4-fbe29cd78e4d Jul 07 17:31:31 devstack sudo[100034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:31 devstack sudo[100034]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-99249f49-d953-43e6-ac04-76d0828cd1de tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8.2b202fe9-8485-4616-84a4-fbe29cd78e4d" returned: 0 in 0.711s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:31 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-99249f49-d953-43e6-ac04-76d0828cd1de tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "cinder-quobyte-2b202fe9-8485-4616-84a4-fbe29cd78e4d" released by "_delete_snapshot" :: held 3.470s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:31 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-99249f49-d953-43e6-ac04-76d0828cd1de tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "cinder-quobyte-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8" released by "delete_snapshot" :: held 3.501s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:31 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-99249f49-d953-43e6-ac04-76d0828cd1de tempest-VolumesSnapshotTestJSON-1060003704 None] Created reservations ['849fb728-d3c2-4756-9da2-8e6d4011fae7', 'dcd1eb1b-28a8-4767-a7d0-866fe077d6f9', '2bb41594-0bfd-4fa2-ac4c-3da812c80fe2', '4921a12e-031e-4c15-897b-71b4ea52b111'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:31:31 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-99249f49-d953-43e6-ac04-76d0828cd1de tempest-VolumesSnapshotTestJSON-1060003704 None] Delete snapshot completed successfully. Jul 07 17:31:32 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-99249f49-d953-43e6-ac04-76d0828cd1de tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "cinder-2b202fe9-8485-4616-84a4-fbe29cd78e4d-delete_snapshot" released by "delete_snapshot" :: held 3.710s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:32 devstack sudo[100032]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-40298bba-b376-4645-bcfb-00e687977ec1 tempest-VolumeTypesAccessTest-1055954812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8e5248fe-1dc5-4e68-9a64-4a02bd7d191c 1073741824" returned: 0 in 1.012s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-40298bba-b376-4645-bcfb-00e687977ec1 tempest-VolumeTypesAccessTest-1055954812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8e5248fe-1dc5-4e68-9a64-4a02bd7d191c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:32 devstack sudo[100042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8e5248fe-1dc5-4e68-9a64-4a02bd7d191c Jul 07 17:31:32 devstack sudo[100042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:32 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9e6127ff-6ef3-4120-b49d-0ca8240d63c2 tempest-VolumesSnapshotTestJSON-1060003704 None] Acquiring lock "cinder-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:32 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9e6127ff-6ef3-4120-b49d-0ca8240d63c2 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "cinder-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:32 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9e6127ff-6ef3-4120-b49d-0ca8240d63c2 tempest-VolumesSnapshotTestJSON-1060003704 None] Acquiring lock "cinder-quobyte-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:32 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9e6127ff-6ef3-4120-b49d-0ca8240d63c2 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "cinder-quobyte-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8" acquired by "delete_volume" :: waited 0.021s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:32 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed2cae5-f21c-412c-ba78-af34b26f37e1]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9e6127ff-6ef3-4120-b49d-0ca8240d63c2 tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:32 devstack sudo[100042]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-40298bba-b376-4645-bcfb-00e687977ec1 tempest-VolumeTypesAccessTest-1055954812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8e5248fe-1dc5-4e68-9a64-4a02bd7d191c" returned: 0 in 0.778s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:32 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-40298bba-b376-4645-bcfb-00e687977ec1 tempest-VolumeTypesAccessTest-1055954812 None] <== create_volume: return (1850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:31:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-40298bba-b376-4645-bcfb-00e687977ec1 tempest-VolumeTypesAccessTest-1055954812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.856s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:32 devstack sudo[100046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8 Jul 07 17:31:32 devstack sudo[100046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:32 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-40298bba-b376-4645-bcfb-00e687977ec1 tempest-VolumeTypesAccessTest-1055954812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07473728-7190-4599-a5e0-36fd30db1a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e5248fe-1dc5-4e68-9a64-4a02bd7d191c', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:32 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-40298bba-b376-4645-bcfb-00e687977ec1 tempest-VolumeTypesAccessTest-1055954812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (007c565b-c7c9-4cd1-a2c4-1a1773f47f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:32 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-40298bba-b376-4645-bcfb-00e687977ec1 tempest-VolumeTypesAccessTest-1055954812 None] Volume volume-8e5248fe-1dc5-4e68-9a64-4a02bd7d191c (8e5248fe-1dc5-4e68-9a64-4a02bd7d191c): created successfully Jul 07 17:31:32 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-40298bba-b376-4645-bcfb-00e687977ec1 tempest-VolumeTypesAccessTest-1055954812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (007c565b-c7c9-4cd1-a2c4-1a1773f47f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:32 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-40298bba-b376-4645-bcfb-00e687977ec1 tempest-VolumeTypesAccessTest-1055954812 None] Flow 'volume_create_manager' (610d9573-d197-4b6a-b3c1-1377a77ce52b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:31:32 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-40298bba-b376-4645-bcfb-00e687977ec1 tempest-VolumeTypesAccessTest-1055954812 None] Created volume successfully. Jul 07 17:31:33 devstack sudo[100046]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9e6127ff-6ef3-4120-b49d-0ca8240d63c2 tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8" returned: 0 in 0.945s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9e6127ff-6ef3-4120-b49d-0ca8240d63c2 tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:33 devstack sudo[100052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8 Jul 07 17:31:33 devstack sudo[100052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:34 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ae3a3751-36ba-4761-a19e-1e2c3a1415dc tempest-VolumeTypesAccessTest-1055954812 None] Acquiring lock "cinder-8e5248fe-1dc5-4e68-9a64-4a02bd7d191c-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:34 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ae3a3751-36ba-4761-a19e-1e2c3a1415dc tempest-VolumeTypesAccessTest-1055954812 None] Lock "cinder-8e5248fe-1dc5-4e68-9a64-4a02bd7d191c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:34 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:INSERT=28,cinder:UPDATE=128,cinder:SELECT=97,cinder:DELETE=11 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:31:34 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ae3a3751-36ba-4761-a19e-1e2c3a1415dc tempest-VolumeTypesAccessTest-1055954812 None] Acquiring lock "cinder-quobyte-8e5248fe-1dc5-4e68-9a64-4a02bd7d191c" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:34 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ae3a3751-36ba-4761-a19e-1e2c3a1415dc tempest-VolumeTypesAccessTest-1055954812 None] Lock "cinder-quobyte-8e5248fe-1dc5-4e68-9a64-4a02bd7d191c" acquired by "delete_volume" :: waited 0.020s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:34 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2747643c-a1ca-4dd1-8e54-cdcf0b54bcea]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ae3a3751-36ba-4761-a19e-1e2c3a1415dc tempest-VolumeTypesAccessTest-1055954812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8e5248fe-1dc5-4e68-9a64-4a02bd7d191c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:34 devstack sudo[100052]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9e6127ff-6ef3-4120-b49d-0ca8240d63c2 tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8" returned: 0 in 0.785s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:34 devstack sudo[100054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8e5248fe-1dc5-4e68-9a64-4a02bd7d191c Jul 07 17:31:34 devstack sudo[100054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:34 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9e6127ff-6ef3-4120-b49d-0ca8240d63c2 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "cinder-quobyte-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8" released by "delete_volume" :: held 1.815s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:34 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-9e6127ff-6ef3-4120-b49d-0ca8240d63c2 tempest-VolumesSnapshotTestJSON-1060003704 None] Created reservations ['70d98209-208a-4470-8b9a-083259d7b937', 'ce661f9d-5952-469f-b3f2-7edc58295d33', '6da02bdc-2336-43e4-991d-55d6f8d2c42f', '573a740b-f2ee-40a5-946b-ee2c1e6b6521'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:31:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9e6127ff-6ef3-4120-b49d-0ca8240d63c2 tempest-VolumesSnapshotTestJSON-1060003704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9e6127ff-6ef3-4120-b49d-0ca8240d63c2 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:34 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-9e6127ff-6ef3-4120-b49d-0ca8240d63c2 tempest-VolumesSnapshotTestJSON-1060003704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:34 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-9e6127ff-6ef3-4120-b49d-0ca8240d63c2 tempest-VolumesSnapshotTestJSON-1060003704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9e6127ff-6ef3-4120-b49d-0ca8240d63c2 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9e6127ff-6ef3-4120-b49d-0ca8240d63c2 tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:34 devstack sudo[100057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:31:34 devstack sudo[100057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:34 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-85dda390-fc90-4944-b866-df66dedaaf20 tempest-VolumesSnapshotTestJSON-1060003704 None] Acquiring lock "cinder-b2558d64-6e60-4c64-a4f1-bb591428a95d-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:34 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-85dda390-fc90-4944-b866-df66dedaaf20 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "cinder-b2558d64-6e60-4c64-a4f1-bb591428a95d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:35 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-85dda390-fc90-4944-b866-df66dedaaf20 tempest-VolumesSnapshotTestJSON-1060003704 None] Acquiring lock "cinder-quobyte-b2558d64-6e60-4c64-a4f1-bb591428a95d" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:35 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-85dda390-fc90-4944-b866-df66dedaaf20 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "cinder-quobyte-b2558d64-6e60-4c64-a4f1-bb591428a95d" acquired by "delete_volume" :: waited 0.022s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:35 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdc5065-a857-4b6c-9081-d5a0ba77fe88]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-85dda390-fc90-4944-b866-df66dedaaf20 tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b2558d64-6e60-4c64-a4f1-bb591428a95d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:35 devstack sudo[100059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b2558d64-6e60-4c64-a4f1-bb591428a95d Jul 07 17:31:35 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:35 devstack sudo[100054]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ae3a3751-36ba-4761-a19e-1e2c3a1415dc tempest-VolumeTypesAccessTest-1055954812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8e5248fe-1dc5-4e68-9a64-4a02bd7d191c" returned: 0 in 1.040s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ae3a3751-36ba-4761-a19e-1e2c3a1415dc tempest-VolumeTypesAccessTest-1055954812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8e5248fe-1dc5-4e68-9a64-4a02bd7d191c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:35 devstack sudo[100065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8e5248fe-1dc5-4e68-9a64-4a02bd7d191c Jul 07 17:31:35 devstack sudo[100065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:35 devstack sudo[100057]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9e6127ff-6ef3-4120-b49d-0ca8240d63c2 tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.803s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:35 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-9e6127ff-6ef3-4120-b49d-0ca8240d63c2 tempest-VolumesSnapshotTestJSON-1060003704 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:31:35 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-9e6127ff-6ef3-4120-b49d-0ca8240d63c2 tempest-VolumesSnapshotTestJSON-1060003704 None] Deleted volume successfully. Jul 07 17:31:35 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9e6127ff-6ef3-4120-b49d-0ca8240d63c2 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "cinder-e815bfcc-c2c4-4e2b-9fb7-b6ceebe9a7c8-delete_volume" released by "delete_volume" :: held 2.892s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:36 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-85dda390-fc90-4944-b866-df66dedaaf20 tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b2558d64-6e60-4c64-a4f1-bb591428a95d" returned: 0 in 0.999s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-85dda390-fc90-4944-b866-df66dedaaf20 tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b2558d64-6e60-4c64-a4f1-bb591428a95d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:36 devstack sudo[100071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b2558d64-6e60-4c64-a4f1-bb591428a95d Jul 07 17:31:36 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:36 devstack sudo[100065]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ae3a3751-36ba-4761-a19e-1e2c3a1415dc tempest-VolumeTypesAccessTest-1055954812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8e5248fe-1dc5-4e68-9a64-4a02bd7d191c" returned: 0 in 0.823s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:36 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ae3a3751-36ba-4761-a19e-1e2c3a1415dc tempest-VolumeTypesAccessTest-1055954812 None] Lock "cinder-quobyte-8e5248fe-1dc5-4e68-9a64-4a02bd7d191c" released by "delete_volume" :: held 1.913s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:36 devstack cinder-volume[87233]: WARNING cinder.quota [None req-ae3a3751-36ba-4761-a19e-1e2c3a1415dc tempest-VolumeTypesAccessTest-1055954812 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-740200095 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-740200095, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:31:36 devstack cinder-volume[87233]: WARNING cinder.quota [None req-ae3a3751-36ba-4761-a19e-1e2c3a1415dc tempest-VolumeTypesAccessTest-1055954812 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-740200095 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-740200095, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:31:36 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-ae3a3751-36ba-4761-a19e-1e2c3a1415dc tempest-VolumeTypesAccessTest-1055954812 None] Created reservations ['1f9f5e6b-5dc0-4a84-b601-75903873660a', 'ef7cb9cb-6fff-4ab7-96b4-40b8c1399158', '8111ec0c-9d50-4084-8e36-474a53b4c583', '3f46c3a2-01fb-49a0-80b4-7f1858dd1cc2'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:31:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ae3a3751-36ba-4761-a19e-1e2c3a1415dc tempest-VolumeTypesAccessTest-1055954812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ae3a3751-36ba-4761-a19e-1e2c3a1415dc tempest-VolumeTypesAccessTest-1055954812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:36 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ae3a3751-36ba-4761-a19e-1e2c3a1415dc tempest-VolumeTypesAccessTest-1055954812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:36 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ae3a3751-36ba-4761-a19e-1e2c3a1415dc tempest-VolumeTypesAccessTest-1055954812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ae3a3751-36ba-4761-a19e-1e2c3a1415dc tempest-VolumeTypesAccessTest-1055954812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ae3a3751-36ba-4761-a19e-1e2c3a1415dc tempest-VolumeTypesAccessTest-1055954812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:36 devstack sudo[100073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:31:36 devstack sudo[100073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:36 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-85dda390-fc90-4944-b866-df66dedaaf20 tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b2558d64-6e60-4c64-a4f1-bb591428a95d" returned: 0 in 0.779s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:36 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-85dda390-fc90-4944-b866-df66dedaaf20 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "cinder-quobyte-b2558d64-6e60-4c64-a4f1-bb591428a95d" released by "delete_volume" :: held 1.866s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:37 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-85dda390-fc90-4944-b866-df66dedaaf20 tempest-VolumesSnapshotTestJSON-1060003704 None] Created reservations ['1b606125-9b04-4749-860b-845367751fbb', '68777408-bd09-4fd6-ad0b-57680c6cfd6b', 'a905b65f-2bfe-44f1-964f-be991fd6216b', '4bb0b06e-7bcb-486d-a297-91fbfac0f21d'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:31:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-85dda390-fc90-4944-b866-df66dedaaf20 tempest-VolumesSnapshotTestJSON-1060003704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-85dda390-fc90-4944-b866-df66dedaaf20 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:37 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-85dda390-fc90-4944-b866-df66dedaaf20 tempest-VolumesSnapshotTestJSON-1060003704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:37 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-85dda390-fc90-4944-b866-df66dedaaf20 tempest-VolumesSnapshotTestJSON-1060003704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-85dda390-fc90-4944-b866-df66dedaaf20 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-85dda390-fc90-4944-b866-df66dedaaf20 tempest-VolumesSnapshotTestJSON-1060003704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:37 devstack sudo[100073]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ae3a3751-36ba-4761-a19e-1e2c3a1415dc tempest-VolumeTypesAccessTest-1055954812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.963s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:37 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-ae3a3751-36ba-4761-a19e-1e2c3a1415dc tempest-VolumeTypesAccessTest-1055954812 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:31:37 devstack sudo[100077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:31:37 devstack sudo[100077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:37 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-ae3a3751-36ba-4761-a19e-1e2c3a1415dc tempest-VolumeTypesAccessTest-1055954812 None] Deleted volume successfully. Jul 07 17:31:37 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ae3a3751-36ba-4761-a19e-1e2c3a1415dc tempest-VolumeTypesAccessTest-1055954812 None] Lock "cinder-8e5248fe-1dc5-4e68-9a64-4a02bd7d191c-delete_volume" released by "delete_volume" :: held 3.151s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:37 devstack sudo[100077]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-85dda390-fc90-4944-b866-df66dedaaf20 tempest-VolumesSnapshotTestJSON-1060003704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.706s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:37 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-85dda390-fc90-4944-b866-df66dedaaf20 tempest-VolumesSnapshotTestJSON-1060003704 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:31:38 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-85dda390-fc90-4944-b866-df66dedaaf20 tempest-VolumesSnapshotTestJSON-1060003704 None] Deleted volume successfully. Jul 07 17:31:38 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-85dda390-fc90-4944-b866-df66dedaaf20 tempest-VolumesSnapshotTestJSON-1060003704 None] Lock "cinder-b2558d64-6e60-4c64-a4f1-bb591428a95d-delete_volume" released by "delete_volume" :: held 3.040s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:43 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:31:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:43 devstack sudo[100082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:31:43 devstack sudo[100082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:44 devstack sudo[100082]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.802s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:44 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:31:44 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:31:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread count: 28 {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:31:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread info: [<_MainThread(MainThread, started 126077716062336)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:31:47 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:SELECT=15,cinder:INSERT=7,cinder:UPDATE=24,cinder:DELETE=2 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:31:48 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:UPDATE=111,cinder:SELECT=91,cinder:DELETE=7,cinder:INSERT=28 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:31:48 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9ce1628-8c2b-40bd-8e86-a82663de8440 tempest-VolumesSnapshotListTestJSON-245896798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:31:49 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c9ce1628-8c2b-40bd-8e86-a82663de8440 tempest-VolumesSnapshotListTestJSON-245896798 None] Flow 'volume_create_manager' (db3c2ff3-8cff-4341-aec5-a963b0a1b207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:31:49 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c9ce1628-8c2b-40bd-8e86-a82663de8440 tempest-VolumesSnapshotListTestJSON-245896798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (022e84db-6a3a-44da-96b0-f069df583ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:49 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c9ce1628-8c2b-40bd-8e86-a82663de8440 tempest-VolumesSnapshotListTestJSON-245896798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (022e84db-6a3a-44da-96b0-f069df583ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:31:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-306265431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02d1aaaa-1a71-4b52-813d-a7a3abfadcb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80fda5ce12e848549209d6acffa4f684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:31:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:31:49Z,use_quota=True,user_id='18b9ed24564342b19dd605c421ade369',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:49 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c9ce1628-8c2b-40bd-8e86-a82663de8440 tempest-VolumesSnapshotListTestJSON-245896798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b721235-8b13-4302-bfbe-20904dcc262d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:49 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c9ce1628-8c2b-40bd-8e86-a82663de8440 tempest-VolumesSnapshotListTestJSON-245896798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b721235-8b13-4302-bfbe-20904dcc262d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:49 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c9ce1628-8c2b-40bd-8e86-a82663de8440 tempest-VolumesSnapshotListTestJSON-245896798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54156608-59f0-487d-9e4f-53e42e9355a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:49 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c9ce1628-8c2b-40bd-8e86-a82663de8440 tempest-VolumesSnapshotListTestJSON-245896798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54156608-59f0-487d-9e4f-53e42e9355a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02d1aaaa-1a71-4b52-813d-a7a3abfadcb8', 'volume_name': 'volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:49 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c9ce1628-8c2b-40bd-8e86-a82663de8440 tempest-VolumesSnapshotListTestJSON-245896798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20d73330-fde6-488a-9d4a-a95aba6b0367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:49 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c9ce1628-8c2b-40bd-8e86-a82663de8440 tempest-VolumesSnapshotListTestJSON-245896798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20d73330-fde6-488a-9d4a-a95aba6b0367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:49 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c9ce1628-8c2b-40bd-8e86-a82663de8440 tempest-VolumesSnapshotListTestJSON-245896798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38188125-7634-447a-b829-28dd1f11065a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:49 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-c9ce1628-8c2b-40bd-8e86-a82663de8440 tempest-VolumesSnapshotListTestJSON-245896798 None] Volume 02d1aaaa-1a71-4b52-813d-a7a3abfadcb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8', 'volume_size': 1} Jul 07 17:31:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c9ce1628-8c2b-40bd-8e86-a82663de8440 tempest-VolumesSnapshotListTestJSON-245896798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c9ce1628-8c2b-40bd-8e86-a82663de8440 tempest-VolumesSnapshotListTestJSON-245896798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:49 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c9ce1628-8c2b-40bd-8e86-a82663de8440 tempest-VolumesSnapshotListTestJSON-245896798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:31:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-306265431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02d1aaaa-1a71-4b52-813d-a7a3abfadcb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80fda5ce12e848549209d6acffa4f684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:31:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:31:49Z,use_quota=True,user_id='18b9ed24564342b19dd605c421ade369',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:31:49 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-c9ce1628-8c2b-40bd-8e86-a82663de8440 tempest-VolumesSnapshotListTestJSON-245896798 None] Creating volume 02d1aaaa-1a71-4b52-813d-a7a3abfadcb8 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:31:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c9ce1628-8c2b-40bd-8e86-a82663de8440 tempest-VolumesSnapshotListTestJSON-245896798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c9ce1628-8c2b-40bd-8e86-a82663de8440 tempest-VolumesSnapshotListTestJSON-245896798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:49 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c9ce1628-8c2b-40bd-8e86-a82663de8440 tempest-VolumesSnapshotListTestJSON-245896798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:49 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c9ce1628-8c2b-40bd-8e86-a82663de8440 tempest-VolumesSnapshotListTestJSON-245896798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c9ce1628-8c2b-40bd-8e86-a82663de8440 tempest-VolumesSnapshotListTestJSON-245896798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:49 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c9ce1628-8c2b-40bd-8e86-a82663de8440 tempest-VolumesSnapshotListTestJSON-245896798 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:31:49 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-c9ce1628-8c2b-40bd-8e86-a82663de8440 tempest-VolumesSnapshotListTestJSON-245896798 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:31:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c9ce1628-8c2b-40bd-8e86-a82663de8440 tempest-VolumesSnapshotListTestJSON-245896798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:49 devstack sudo[100086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8 1073741824 Jul 07 17:31:49 devstack sudo[100086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:50 devstack sudo[100086]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c9ce1628-8c2b-40bd-8e86-a82663de8440 tempest-VolumesSnapshotListTestJSON-245896798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8 1073741824" returned: 0 in 1.034s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c9ce1628-8c2b-40bd-8e86-a82663de8440 tempest-VolumesSnapshotListTestJSON-245896798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:50 devstack sudo[100092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8 Jul 07 17:31:50 devstack sudo[100092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:50 devstack sudo[100092]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c9ce1628-8c2b-40bd-8e86-a82663de8440 tempest-VolumesSnapshotListTestJSON-245896798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8" returned: 0 in 0.739s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:50 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c9ce1628-8c2b-40bd-8e86-a82663de8440 tempest-VolumesSnapshotListTestJSON-245896798 None] <== create_volume: return (1833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:31:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c9ce1628-8c2b-40bd-8e86-a82663de8440 tempest-VolumesSnapshotListTestJSON-245896798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.836s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:50 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c9ce1628-8c2b-40bd-8e86-a82663de8440 tempest-VolumesSnapshotListTestJSON-245896798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38188125-7634-447a-b829-28dd1f11065a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:50 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c9ce1628-8c2b-40bd-8e86-a82663de8440 tempest-VolumesSnapshotListTestJSON-245896798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ca30bee-a80f-44b8-adeb-8973e0dd7bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:50 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-c9ce1628-8c2b-40bd-8e86-a82663de8440 tempest-VolumesSnapshotListTestJSON-245896798 None] Volume volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8 (02d1aaaa-1a71-4b52-813d-a7a3abfadcb8): created successfully Jul 07 17:31:50 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c9ce1628-8c2b-40bd-8e86-a82663de8440 tempest-VolumesSnapshotListTestJSON-245896798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ca30bee-a80f-44b8-adeb-8973e0dd7bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c9ce1628-8c2b-40bd-8e86-a82663de8440 tempest-VolumesSnapshotListTestJSON-245896798 None] Flow 'volume_create_manager' (db3c2ff3-8cff-4341-aec5-a963b0a1b207) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:31:51 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-c9ce1628-8c2b-40bd-8e86-a82663de8440 tempest-VolumesSnapshotListTestJSON-245896798 None] Created volume successfully. Jul 07 17:31:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e2c6f414-9860-42ca-909d-bd9a5665fac2 tempest-VolumesSnapshotListTestJSON-245896798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e2c6f414-9860-42ca-909d-bd9a5665fac2 tempest-VolumesSnapshotListTestJSON-245896798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:52 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-e2c6f414-9860-42ca-909d-bd9a5665fac2 tempest-VolumesSnapshotListTestJSON-245896798 None] Creating offline snapshot f3a2a447-ca32-4915-9396-6b76e93816f0 of volume 02d1aaaa-1a71-4b52-813d-a7a3abfadcb8 {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:31:52 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d41233-47eb-437e-9538-9b48fede9655]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e2c6f414-9860-42ca-909d-bd9a5665fac2 tempest-VolumesSnapshotListTestJSON-245896798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:52 devstack sudo[100096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8 Jul 07 17:31:52 devstack sudo[100096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:53 devstack sudo[100096]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e2c6f414-9860-42ca-909d-bd9a5665fac2 tempest-VolumesSnapshotListTestJSON-245896798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8" returned: 0 in 0.973s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e2c6f414-9860-42ca-909d-bd9a5665fac2 tempest-VolumesSnapshotListTestJSON-245896798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.f3a2a447-ca32-4915-9396-6b76e93816f0 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:53 devstack sudo[100101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.f3a2a447-ca32-4915-9396-6b76e93816f0 1G Jul 07 17:31:53 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:54 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e2c6f414-9860-42ca-909d-bd9a5665fac2 tempest-VolumesSnapshotListTestJSON-245896798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.f3a2a447-ca32-4915-9396-6b76e93816f0 1G" returned: 0 in 1.045s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e2c6f414-9860-42ca-909d-bd9a5665fac2 tempest-VolumesSnapshotListTestJSON-245896798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.f3a2a447-ca32-4915-9396-6b76e93816f0 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:54 devstack sudo[100108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.f3a2a447-ca32-4915-9396-6b76e93816f0 Jul 07 17:31:54 devstack sudo[100108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:55 devstack sudo[100108]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e2c6f414-9860-42ca-909d-bd9a5665fac2 tempest-VolumesSnapshotListTestJSON-245896798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.f3a2a447-ca32-4915-9396-6b76e93816f0" returned: 0 in 0.905s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:55 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-e2c6f414-9860-42ca-909d-bd9a5665fac2 tempest-VolumesSnapshotListTestJSON-245896798 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.f3a2a447-ca32-4915-9396-6b76e93816f0 is being set with open permissions: ugo+rw Jul 07 17:31:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e2c6f414-9860-42ca-909d-bd9a5665fac2 tempest-VolumesSnapshotListTestJSON-245896798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.f3a2a447-ca32-4915-9396-6b76e93816f0 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:55 devstack sudo[100115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.f3a2a447-ca32-4915-9396-6b76e93816f0 Jul 07 17:31:55 devstack sudo[100115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:56 devstack sudo[100115]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e2c6f414-9860-42ca-909d-bd9a5665fac2 tempest-VolumesSnapshotListTestJSON-245896798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.f3a2a447-ca32-4915-9396-6b76e93816f0" returned: 0 in 0.767s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e2c6f414-9860-42ca-909d-bd9a5665fac2 tempest-VolumesSnapshotListTestJSON-245896798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:56 devstack sudo[100118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.info Jul 07 17:31:56 devstack sudo[100118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:57 devstack sudo[100118]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e2c6f414-9860-42ca-909d-bd9a5665fac2 tempest-VolumesSnapshotListTestJSON-245896798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.info" returned: 0 in 0.827s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:57 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-e2c6f414-9860-42ca-909d-bd9a5665fac2 tempest-VolumesSnapshotListTestJSON-245896798 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.info is being set with open permissions: ugo+rw Jul 07 17:31:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e2c6f414-9860-42ca-909d-bd9a5665fac2 tempest-VolumesSnapshotListTestJSON-245896798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:57 devstack sudo[100121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.info Jul 07 17:31:57 devstack sudo[100121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:57 devstack sudo[100121]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e2c6f414-9860-42ca-909d-bd9a5665fac2 tempest-VolumesSnapshotListTestJSON-245896798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.info" returned: 0 in 0.772s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e2c6f414-9860-42ca-909d-bd9a5665fac2 tempest-VolumesSnapshotListTestJSON-245896798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.419s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:57 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-e2c6f414-9860-42ca-909d-bd9a5665fac2 tempest-VolumesSnapshotListTestJSON-245896798 None] Create snapshot completed successfully Jul 07 17:31:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-03a726c7-1477-4e5e-a590-590a4d053145 tempest-VolumesSnapshotListTestJSON-245896798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-03a726c7-1477-4e5e-a590-590a4d053145 tempest-VolumesSnapshotListTestJSON-245896798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:59 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-03a726c7-1477-4e5e-a590-590a4d053145 tempest-VolumesSnapshotListTestJSON-245896798 None] Creating offline snapshot 6cf04681-e9ea-4083-aa0e-550c917c4e12 of volume 02d1aaaa-1a71-4b52-813d-a7a3abfadcb8 {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:31:59 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf2e14d-b74a-4b25-b4e0-7bfc594fb99f]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-03a726c7-1477-4e5e-a590-590a4d053145 tempest-VolumesSnapshotListTestJSON-245896798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.f3a2a447-ca32-4915-9396-6b76e93816f0 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:59 devstack sudo[100124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.f3a2a447-ca32-4915-9396-6b76e93816f0 Jul 07 17:31:59 devstack sudo[100124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:59 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-38633b51-34e7-430f-bea6-38ed6b4e2036 tempest-SnapshotMetadataTestJSON-91279543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:31:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-38633b51-34e7-430f-bea6-38ed6b4e2036 tempest-SnapshotMetadataTestJSON-91279543 None] Flow 'volume_create_manager' (71accf8a-3a48-4fdb-a312-0c60a0581ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:31:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-38633b51-34e7-430f-bea6-38ed6b4e2036 tempest-SnapshotMetadataTestJSON-91279543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bbbd3e2-6f8b-4c24-ad7b-a8b7a4cf94c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-38633b51-34e7-430f-bea6-38ed6b4e2036 tempest-SnapshotMetadataTestJSON-91279543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bbbd3e2-6f8b-4c24-ad7b-a8b7a4cf94c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1913968779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0d15c2b-f7f0-440a-8845-077a76ae236a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6750a55afb2b4491aa862c383ee2abc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:32:00Z,use_quota=True,user_id='f47595fbd3da454a8e3c83b7a6675e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-38633b51-34e7-430f-bea6-38ed6b4e2036 tempest-SnapshotMetadataTestJSON-91279543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa203bc9-0c22-4dc4-a084-15daf1ab478c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-38633b51-34e7-430f-bea6-38ed6b4e2036 tempest-SnapshotMetadataTestJSON-91279543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa203bc9-0c22-4dc4-a084-15daf1ab478c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-38633b51-34e7-430f-bea6-38ed6b4e2036 tempest-SnapshotMetadataTestJSON-91279543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7a41dc4-5851-4461-8a8a-27cf1ab0b50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-38633b51-34e7-430f-bea6-38ed6b4e2036 tempest-SnapshotMetadataTestJSON-91279543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7a41dc4-5851-4461-8a8a-27cf1ab0b50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0d15c2b-f7f0-440a-8845-077a76ae236a', 'volume_name': 'volume-a0d15c2b-f7f0-440a-8845-077a76ae236a', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-38633b51-34e7-430f-bea6-38ed6b4e2036 tempest-SnapshotMetadataTestJSON-91279543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2912e881-6ff1-4fbd-8c48-6091a0d939fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-38633b51-34e7-430f-bea6-38ed6b4e2036 tempest-SnapshotMetadataTestJSON-91279543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2912e881-6ff1-4fbd-8c48-6091a0d939fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-38633b51-34e7-430f-bea6-38ed6b4e2036 tempest-SnapshotMetadataTestJSON-91279543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c31541bd-533f-4db6-b42a-6fe34329e857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:59 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-38633b51-34e7-430f-bea6-38ed6b4e2036 tempest-SnapshotMetadataTestJSON-91279543 None] Volume a0d15c2b-f7f0-440a-8845-077a76ae236a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0d15c2b-f7f0-440a-8845-077a76ae236a', 'volume_size': 1} Jul 07 17:31:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-38633b51-34e7-430f-bea6-38ed6b4e2036 tempest-SnapshotMetadataTestJSON-91279543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:00 devstack sudo[100124]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-03a726c7-1477-4e5e-a590-590a4d053145 tempest-VolumesSnapshotListTestJSON-245896798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.f3a2a447-ca32-4915-9396-6b76e93816f0" returned: 0 in 0.877s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:00 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-03a726c7-1477-4e5e-a590-590a4d053145 tempest-VolumesSnapshotListTestJSON-245896798 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:32:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-03a726c7-1477-4e5e-a590-590a4d053145 tempest-VolumesSnapshotListTestJSON-245896798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.f3a2a447-ca32-4915-9396-6b76e93816f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.6cf04681-e9ea-4083-aa0e-550c917c4e12 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:00 devstack sudo[100131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.f3a2a447-ca32-4915-9396-6b76e93816f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.6cf04681-e9ea-4083-aa0e-550c917c4e12 1G Jul 07 17:32:00 devstack sudo[100131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:00 devstack sudo[100131]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-03a726c7-1477-4e5e-a590-590a4d053145 tempest-VolumesSnapshotListTestJSON-245896798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.f3a2a447-ca32-4915-9396-6b76e93816f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.6cf04681-e9ea-4083-aa0e-550c917c4e12 1G" returned: 0 in 0.893s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-03a726c7-1477-4e5e-a590-590a4d053145 tempest-VolumesSnapshotListTestJSON-245896798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.f3a2a447-ca32-4915-9396-6b76e93816f0 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.6cf04681-e9ea-4083-aa0e-550c917c4e12 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:00 devstack sudo[100139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.f3a2a447-ca32-4915-9396-6b76e93816f0 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.6cf04681-e9ea-4083-aa0e-550c917c4e12 Jul 07 17:32:00 devstack sudo[100139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:01 devstack sudo[100139]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-03a726c7-1477-4e5e-a590-590a4d053145 tempest-VolumesSnapshotListTestJSON-245896798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.f3a2a447-ca32-4915-9396-6b76e93816f0 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.6cf04681-e9ea-4083-aa0e-550c917c4e12" returned: 0 in 0.707s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:01 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-03a726c7-1477-4e5e-a590-590a4d053145 tempest-VolumesSnapshotListTestJSON-245896798 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.6cf04681-e9ea-4083-aa0e-550c917c4e12 is being set with open permissions: ugo+rw Jul 07 17:32:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-03a726c7-1477-4e5e-a590-590a4d053145 tempest-VolumesSnapshotListTestJSON-245896798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.6cf04681-e9ea-4083-aa0e-550c917c4e12 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:01 devstack sudo[100144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.6cf04681-e9ea-4083-aa0e-550c917c4e12 Jul 07 17:32:01 devstack sudo[100144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:02 devstack sudo[100144]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-03a726c7-1477-4e5e-a590-590a4d053145 tempest-VolumesSnapshotListTestJSON-245896798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.6cf04681-e9ea-4083-aa0e-550c917c4e12" returned: 0 in 0.667s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-03a726c7-1477-4e5e-a590-590a4d053145 tempest-VolumesSnapshotListTestJSON-245896798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.270s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-38633b51-34e7-430f-bea6-38ed6b4e2036 tempest-SnapshotMetadataTestJSON-91279543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.492s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:02 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-38633b51-34e7-430f-bea6-38ed6b4e2036 tempest-SnapshotMetadataTestJSON-91279543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1913968779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0d15c2b-f7f0-440a-8845-077a76ae236a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6750a55afb2b4491aa862c383ee2abc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:32:00Z,use_quota=True,user_id='f47595fbd3da454a8e3c83b7a6675e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:32:02 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-38633b51-34e7-430f-bea6-38ed6b4e2036 tempest-SnapshotMetadataTestJSON-91279543 None] Creating volume a0d15c2b-f7f0-440a-8845-077a76ae236a {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:32:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-38633b51-34e7-430f-bea6-38ed6b4e2036 tempest-SnapshotMetadataTestJSON-91279543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-38633b51-34e7-430f-bea6-38ed6b4e2036 tempest-SnapshotMetadataTestJSON-91279543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:02 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-38633b51-34e7-430f-bea6-38ed6b4e2036 tempest-SnapshotMetadataTestJSON-91279543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:32:02 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-38633b51-34e7-430f-bea6-38ed6b4e2036 tempest-SnapshotMetadataTestJSON-91279543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:32:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-38633b51-34e7-430f-bea6-38ed6b4e2036 tempest-SnapshotMetadataTestJSON-91279543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:02 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-38633b51-34e7-430f-bea6-38ed6b4e2036 tempest-SnapshotMetadataTestJSON-91279543 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:32:02 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-38633b51-34e7-430f-bea6-38ed6b4e2036 tempest-SnapshotMetadataTestJSON-91279543 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:32:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-38633b51-34e7-430f-bea6-38ed6b4e2036 tempest-SnapshotMetadataTestJSON-91279543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0d15c2b-f7f0-440a-8845-077a76ae236a 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:02 devstack sudo[100147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0d15c2b-f7f0-440a-8845-077a76ae236a 1073741824 Jul 07 17:32:02 devstack sudo[100147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:02 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-03a726c7-1477-4e5e-a590-590a4d053145 tempest-VolumesSnapshotListTestJSON-245896798 None] Create snapshot completed successfully Jul 07 17:32:03 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:32:03 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Flow 'volume_create_manager' (7db7d419-09c9-4dbc-8818-4917b7b091c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:32:03 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c302c5c-d7e6-4f9b-9801-96a48b762a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:03 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c302c5c-d7e6-4f9b-9801-96a48b762a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-469258150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e09b9c94-9373-4bac-9614-06b37514b12a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e520a62f0754fbeab3414f6ffbd91f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:32:03Z,use_quota=True,user_id='b281227b410144e2b11fb7f893ec37a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:03 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (046a812e-22b4-47b7-ae17-c3c62d788f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:03 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (046a812e-22b4-47b7-ae17-c3c62d788f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:03 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af9cf3bf-3923-4cbc-8bc6-3b2e2691e632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:03 devstack cinder-volume[87233]: DEBUG cinder.image.glance [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Creating Keystone auth plugin from conf {{(pid=87233) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 17:32:03 devstack sudo[100147]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-38633b51-34e7-430f-bea6-38ed6b4e2036 tempest-SnapshotMetadataTestJSON-91279543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0d15c2b-f7f0-440a-8845-077a76ae236a 1073741824" returned: 0 in 1.032s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-38633b51-34e7-430f-bea6-38ed6b4e2036 tempest-SnapshotMetadataTestJSON-91279543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0d15c2b-f7f0-440a-8845-077a76ae236a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:03 devstack sudo[100154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0d15c2b-f7f0-440a-8845-077a76ae236a Jul 07 17:32:03 devstack sudo[100154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-864ff2f6-d53d-4065-bce1-b2317fb3ddec tempest-VolumesSnapshotListTestJSON-245896798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:03 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af9cf3bf-3923-4cbc-8bc6-3b2e2691e632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e09b9c94-9373-4bac-9614-06b37514b12a', 'volume_name': 'volume-e09b9c94-9373-4bac-9614-06b37514b12a', 'volume_size': 1, 'image_id': '0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ed2f318bab304b78b69744376e93ea0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'created_at': datetime.datetime(2026, 7, 7, 15, 11, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 11, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e7aa8bb-335b-45a2-aabb-4dc50188f189/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:03 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abc1e65e-fd41-437e-82c9-f8bfcfdc56b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:03 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abc1e65e-fd41-437e-82c9-f8bfcfdc56b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:03 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7fb1e81-1733-4f6a-b7fd-4be58cea8b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:03 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Volume e09b9c94-9373-4bac-9614-06b37514b12a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e09b9c94-9373-4bac-9614-06b37514b12a', 'volume_size': 1, 'image_id': '0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ed2f318bab304b78b69744376e93ea0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'created_at': datetime.datetime(2026, 7, 7, 15, 11, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 11, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e7aa8bb-335b-45a2-aabb-4dc50188f189/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 17:32:03 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Trying to clone e09b9c94-9373-4bac-9614-06b37514b12a from image 0e7aa8bb-335b-45a2-aabb-4dc50188f189 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'metadata': {}}]). {{(pid=87233) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 17:32:04 devstack sudo[100154]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:04 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_xyxsbvz9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87233) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 17:32:04 devstack cinder-volume[87233]: INFO cinder.image.image_utils [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Image download 20.69 MB at 20.69 MB/s Jul 07 17:32:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-38633b51-34e7-430f-bea6-38ed6b4e2036 tempest-SnapshotMetadataTestJSON-91279543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0d15c2b-f7f0-440a-8845-077a76ae236a" returned: 0 in 0.744s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:04 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-38633b51-34e7-430f-bea6-38ed6b4e2036 tempest-SnapshotMetadataTestJSON-91279543 None] <== create_volume: return (1857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:32:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-38633b51-34e7-430f-bea6-38ed6b4e2036 tempest-SnapshotMetadataTestJSON-91279543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.861s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-864ff2f6-d53d-4065-bce1-b2317fb3ddec tempest-VolumesSnapshotListTestJSON-245896798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.716s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:04 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-864ff2f6-d53d-4065-bce1-b2317fb3ddec tempest-VolumesSnapshotListTestJSON-245896798 None] Creating offline snapshot 142a626f-78a3-41d0-a84e-8e9f51a68a27 of volume 02d1aaaa-1a71-4b52-813d-a7a3abfadcb8 {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:32:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-38633b51-34e7-430f-bea6-38ed6b4e2036 tempest-SnapshotMetadataTestJSON-91279543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c31541bd-533f-4db6-b42a-6fe34329e857) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0d15c2b-f7f0-440a-8845-077a76ae236a', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-38633b51-34e7-430f-bea6-38ed6b4e2036 tempest-SnapshotMetadataTestJSON-91279543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (332d6075-1a6a-4b5f-b0e4-5f5aad4ef44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:04 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0394c0e2-e54d-44cf-9109-2cda26f61b7d]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-864ff2f6-d53d-4065-bce1-b2317fb3ddec tempest-VolumesSnapshotListTestJSON-245896798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.6cf04681-e9ea-4083-aa0e-550c917c4e12 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:04 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0556633-5b39-4264-8548-1e22394c6785]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_xyxsbvz9devstack@QuobyteHD {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:04 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-38633b51-34e7-430f-bea6-38ed6b4e2036 tempest-SnapshotMetadataTestJSON-91279543 None] Volume volume-a0d15c2b-f7f0-440a-8845-077a76ae236a (a0d15c2b-f7f0-440a-8845-077a76ae236a): created successfully Jul 07 17:32:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-38633b51-34e7-430f-bea6-38ed6b4e2036 tempest-SnapshotMetadataTestJSON-91279543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (332d6075-1a6a-4b5f-b0e4-5f5aad4ef44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-38633b51-34e7-430f-bea6-38ed6b4e2036 tempest-SnapshotMetadataTestJSON-91279543 None] Flow 'volume_create_manager' (71accf8a-3a48-4fdb-a312-0c60a0581ae8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:32:04 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-38633b51-34e7-430f-bea6-38ed6b4e2036 tempest-SnapshotMetadataTestJSON-91279543 None] Created volume successfully. Jul 07 17:32:04 devstack sudo[100158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.6cf04681-e9ea-4083-aa0e-550c917c4e12 Jul 07 17:32:04 devstack sudo[100158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:04 devstack sudo[100159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_xyxsbvz9devstack@QuobyteHD Jul 07 17:32:04 devstack sudo[100159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:05 devstack sudo[100158]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-864ff2f6-d53d-4065-bce1-b2317fb3ddec tempest-VolumesSnapshotListTestJSON-245896798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.6cf04681-e9ea-4083-aa0e-550c917c4e12" returned: 0 in 0.857s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:05 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-864ff2f6-d53d-4065-bce1-b2317fb3ddec tempest-VolumesSnapshotListTestJSON-245896798 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:32:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-864ff2f6-d53d-4065-bce1-b2317fb3ddec tempest-VolumesSnapshotListTestJSON-245896798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.6cf04681-e9ea-4083-aa0e-550c917c4e12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.142a626f-78a3-41d0-a84e-8e9f51a68a27 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:05 devstack sudo[100169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.6cf04681-e9ea-4083-aa0e-550c917c4e12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.142a626f-78a3-41d0-a84e-8e9f51a68a27 1G Jul 07 17:32:05 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:05 devstack sudo[100159]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_xyxsbvz9devstack@QuobyteHD" returned: 0 in 0.890s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:05 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Temporary image 0e7aa8bb-335b-45a2-aabb-4dc50188f189 is fetched for user b281227b410144e2b11fb7f893ec37a8. {{(pid=87233) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 17:32:05 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdcd52a-8439-4021-ac8f-7cb762e0eacb]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_xyxsbvz9devstack@QuobyteHD {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-340e952e-e034-450b-bfa7-d98ae79e36c2 tempest-SnapshotMetadataTestJSON-91279543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:05 devstack sudo[100171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_xyxsbvz9devstack@QuobyteHD Jul 07 17:32:05 devstack sudo[100171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:06 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-864ff2f6-d53d-4065-bce1-b2317fb3ddec tempest-VolumesSnapshotListTestJSON-245896798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.6cf04681-e9ea-4083-aa0e-550c917c4e12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.142a626f-78a3-41d0-a84e-8e9f51a68a27 1G" returned: 0 in 0.915s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-864ff2f6-d53d-4065-bce1-b2317fb3ddec tempest-VolumesSnapshotListTestJSON-245896798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.6cf04681-e9ea-4083-aa0e-550c917c4e12 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.142a626f-78a3-41d0-a84e-8e9f51a68a27 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:06 devstack sudo[100179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.6cf04681-e9ea-4083-aa0e-550c917c4e12 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.142a626f-78a3-41d0-a84e-8e9f51a68a27 Jul 07 17:32:06 devstack sudo[100179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:06 devstack sudo[100171]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_xyxsbvz9devstack@QuobyteHD" returned: 0 in 0.821s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:06 devstack sudo[100179]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-864ff2f6-d53d-4065-bce1-b2317fb3ddec tempest-VolumesSnapshotListTestJSON-245896798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.6cf04681-e9ea-4083-aa0e-550c917c4e12 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.142a626f-78a3-41d0-a84e-8e9f51a68a27" returned: 0 in 0.682s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:06 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-864ff2f6-d53d-4065-bce1-b2317fb3ddec tempest-VolumesSnapshotListTestJSON-245896798 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.142a626f-78a3-41d0-a84e-8e9f51a68a27 is being set with open permissions: ugo+rw Jul 07 17:32:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-864ff2f6-d53d-4065-bce1-b2317fb3ddec tempest-VolumesSnapshotListTestJSON-245896798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.142a626f-78a3-41d0-a84e-8e9f51a68a27 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:06 devstack sudo[100184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.142a626f-78a3-41d0-a84e-8e9f51a68a27 Jul 07 17:32:06 devstack sudo[100184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:07 devstack sudo[100184]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-864ff2f6-d53d-4065-bce1-b2317fb3ddec tempest-VolumesSnapshotListTestJSON-245896798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.142a626f-78a3-41d0-a84e-8e9f51a68a27" returned: 0 in 0.700s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-864ff2f6-d53d-4065-bce1-b2317fb3ddec tempest-VolumesSnapshotListTestJSON-245896798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.274s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-340e952e-e034-450b-bfa7-d98ae79e36c2 tempest-SnapshotMetadataTestJSON-91279543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.153s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:07 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-340e952e-e034-450b-bfa7-d98ae79e36c2 tempest-SnapshotMetadataTestJSON-91279543 None] Creating offline snapshot 4b5d621a-e6b8-4641-83c2-925d862be928 of volume a0d15c2b-f7f0-440a-8845-077a76ae236a {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:32:07 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-864ff2f6-d53d-4065-bce1-b2317fb3ddec tempest-VolumesSnapshotListTestJSON-245896798 None] Create snapshot completed successfully Jul 07 17:32:07 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f0adbd-7334-471c-a69d-1fbaaae0abcc]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-340e952e-e034-450b-bfa7-d98ae79e36c2 tempest-SnapshotMetadataTestJSON-91279543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0d15c2b-f7f0-440a-8845-077a76ae236a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:07 devstack sudo[100187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0d15c2b-f7f0-440a-8845-077a76ae236a Jul 07 17:32:07 devstack sudo[100187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:08 devstack sudo[100187]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-340e952e-e034-450b-bfa7-d98ae79e36c2 tempest-SnapshotMetadataTestJSON-91279543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0d15c2b-f7f0-440a-8845-077a76ae236a" returned: 0 in 0.839s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-340e952e-e034-450b-bfa7-d98ae79e36c2 tempest-SnapshotMetadataTestJSON-91279543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0d15c2b-f7f0-440a-8845-077a76ae236a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0d15c2b-f7f0-440a-8845-077a76ae236a.4b5d621a-e6b8-4641-83c2-925d862be928 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:08 devstack sudo[100192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0d15c2b-f7f0-440a-8845-077a76ae236a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0d15c2b-f7f0-440a-8845-077a76ae236a.4b5d621a-e6b8-4641-83c2-925d862be928 1G Jul 07 17:32:08 devstack sudo[100192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:08 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d23cb2a5-36e8-4b5c-8025-f5d2c35e37a5 tempest-VolumesSnapshotListTestJSON-245896798 None] Acquiring lock "cinder-142a626f-78a3-41d0-a84e-8e9f51a68a27-delete_snapshot" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:08 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d23cb2a5-36e8-4b5c-8025-f5d2c35e37a5 tempest-VolumesSnapshotListTestJSON-245896798 None] Lock "cinder-142a626f-78a3-41d0-a84e-8e9f51a68a27-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:08 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d23cb2a5-36e8-4b5c-8025-f5d2c35e37a5 tempest-VolumesSnapshotListTestJSON-245896798 None] Acquiring lock "cinder-quobyte-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:08 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d23cb2a5-36e8-4b5c-8025-f5d2c35e37a5 tempest-VolumesSnapshotListTestJSON-245896798 None] Lock "cinder-quobyte-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:08 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d23cb2a5-36e8-4b5c-8025-f5d2c35e37a5 tempest-VolumesSnapshotListTestJSON-245896798 None] Acquiring lock "cinder-quobyte-142a626f-78a3-41d0-a84e-8e9f51a68a27" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:08 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d23cb2a5-36e8-4b5c-8025-f5d2c35e37a5 tempest-VolumesSnapshotListTestJSON-245896798 None] Lock "cinder-quobyte-142a626f-78a3-41d0-a84e-8e9f51a68a27" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:08 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-d23cb2a5-36e8-4b5c-8025-f5d2c35e37a5 tempest-VolumesSnapshotListTestJSON-245896798 None] Deleting offline snapshot 142a626f-78a3-41d0-a84e-8e9f51a68a27 of volume 02d1aaaa-1a71-4b52-813d-a7a3abfadcb8 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:32:08 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-d23cb2a5-36e8-4b5c-8025-f5d2c35e37a5 tempest-VolumesSnapshotListTestJSON-245896798 None] snapshot_file for this snap is: volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.142a626f-78a3-41d0-a84e-8e9f51a68a27 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:32:08 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[50901118-c604-41fb-a718-3f4cc67f5d9b]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d23cb2a5-36e8-4b5c-8025-f5d2c35e37a5 tempest-VolumesSnapshotListTestJSON-245896798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.142a626f-78a3-41d0-a84e-8e9f51a68a27 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:08 devstack sudo[100194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.142a626f-78a3-41d0-a84e-8e9f51a68a27 Jul 07 17:32:08 devstack sudo[100194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:09 devstack sudo[100192]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-340e952e-e034-450b-bfa7-d98ae79e36c2 tempest-SnapshotMetadataTestJSON-91279543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0d15c2b-f7f0-440a-8845-077a76ae236a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0d15c2b-f7f0-440a-8845-077a76ae236a.4b5d621a-e6b8-4641-83c2-925d862be928 1G" returned: 0 in 0.812s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-340e952e-e034-450b-bfa7-d98ae79e36c2 tempest-SnapshotMetadataTestJSON-91279543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0d15c2b-f7f0-440a-8845-077a76ae236a -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0d15c2b-f7f0-440a-8845-077a76ae236a.4b5d621a-e6b8-4641-83c2-925d862be928 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:09 devstack sudo[100199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0d15c2b-f7f0-440a-8845-077a76ae236a -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0d15c2b-f7f0-440a-8845-077a76ae236a.4b5d621a-e6b8-4641-83c2-925d862be928 Jul 07 17:32:09 devstack sudo[100199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:09 devstack sudo[100194]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d23cb2a5-36e8-4b5c-8025-f5d2c35e37a5 tempest-VolumesSnapshotListTestJSON-245896798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.142a626f-78a3-41d0-a84e-8e9f51a68a27" returned: 0 in 0.790s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:09 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-d23cb2a5-36e8-4b5c-8025-f5d2c35e37a5 tempest-VolumesSnapshotListTestJSON-245896798 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:32:09 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe18ef3-c1b5-4442-8757-0a9292252733]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d23cb2a5-36e8-4b5c-8025-f5d2c35e37a5 tempest-VolumesSnapshotListTestJSON-245896798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.6cf04681-e9ea-4083-aa0e-550c917c4e12 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:09 devstack sudo[100204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.6cf04681-e9ea-4083-aa0e-550c917c4e12 Jul 07 17:32:09 devstack sudo[100204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:09 devstack sudo[100199]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-340e952e-e034-450b-bfa7-d98ae79e36c2 tempest-SnapshotMetadataTestJSON-91279543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0d15c2b-f7f0-440a-8845-077a76ae236a -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0d15c2b-f7f0-440a-8845-077a76ae236a.4b5d621a-e6b8-4641-83c2-925d862be928" returned: 0 in 0.669s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:09 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-340e952e-e034-450b-bfa7-d98ae79e36c2 tempest-SnapshotMetadataTestJSON-91279543 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0d15c2b-f7f0-440a-8845-077a76ae236a.4b5d621a-e6b8-4641-83c2-925d862be928 is being set with open permissions: ugo+rw Jul 07 17:32:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-340e952e-e034-450b-bfa7-d98ae79e36c2 tempest-SnapshotMetadataTestJSON-91279543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0d15c2b-f7f0-440a-8845-077a76ae236a.4b5d621a-e6b8-4641-83c2-925d862be928 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:09 devstack sudo[100209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0d15c2b-f7f0-440a-8845-077a76ae236a.4b5d621a-e6b8-4641-83c2-925d862be928 Jul 07 17:32:09 devstack sudo[100209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:10 devstack sudo[100204]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d23cb2a5-36e8-4b5c-8025-f5d2c35e37a5 tempest-VolumesSnapshotListTestJSON-245896798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.6cf04681-e9ea-4083-aa0e-550c917c4e12" returned: 0 in 0.808s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:10 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-d23cb2a5-36e8-4b5c-8025-f5d2c35e37a5 tempest-VolumesSnapshotListTestJSON-245896798 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:32:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d23cb2a5-36e8-4b5c-8025-f5d2c35e37a5 tempest-VolumesSnapshotListTestJSON-245896798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.142a626f-78a3-41d0-a84e-8e9f51a68a27 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:10 devstack sudo[100214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.142a626f-78a3-41d0-a84e-8e9f51a68a27 Jul 07 17:32:10 devstack sudo[100214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:10 devstack sudo[100209]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-340e952e-e034-450b-bfa7-d98ae79e36c2 tempest-SnapshotMetadataTestJSON-91279543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0d15c2b-f7f0-440a-8845-077a76ae236a.4b5d621a-e6b8-4641-83c2-925d862be928" returned: 0 in 0.644s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-340e952e-e034-450b-bfa7-d98ae79e36c2 tempest-SnapshotMetadataTestJSON-91279543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0d15c2b-f7f0-440a-8845-077a76ae236a.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:10 devstack sudo[100218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0d15c2b-f7f0-440a-8845-077a76ae236a.info Jul 07 17:32:10 devstack sudo[100218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:11 devstack sudo[100214]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d23cb2a5-36e8-4b5c-8025-f5d2c35e37a5 tempest-VolumesSnapshotListTestJSON-245896798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.142a626f-78a3-41d0-a84e-8e9f51a68a27" returned: 0 in 0.816s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d23cb2a5-36e8-4b5c-8025-f5d2c35e37a5 tempest-VolumesSnapshotListTestJSON-245896798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.142a626f-78a3-41d0-a84e-8e9f51a68a27 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:11 devstack sudo[100223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.142a626f-78a3-41d0-a84e-8e9f51a68a27 Jul 07 17:32:11 devstack sudo[100223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:11 devstack sudo[100218]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-340e952e-e034-450b-bfa7-d98ae79e36c2 tempest-SnapshotMetadataTestJSON-91279543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0d15c2b-f7f0-440a-8845-077a76ae236a.info" returned: 0 in 0.647s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:11 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-340e952e-e034-450b-bfa7-d98ae79e36c2 tempest-SnapshotMetadataTestJSON-91279543 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0d15c2b-f7f0-440a-8845-077a76ae236a.info is being set with open permissions: ugo+rw Jul 07 17:32:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-340e952e-e034-450b-bfa7-d98ae79e36c2 tempest-SnapshotMetadataTestJSON-91279543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0d15c2b-f7f0-440a-8845-077a76ae236a.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:11 devstack sudo[100226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0d15c2b-f7f0-440a-8845-077a76ae236a.info Jul 07 17:32:11 devstack sudo[100226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:11 devstack sudo[100223]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d23cb2a5-36e8-4b5c-8025-f5d2c35e37a5 tempest-VolumesSnapshotListTestJSON-245896798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.142a626f-78a3-41d0-a84e-8e9f51a68a27" returned: 0 in 0.675s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:11 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d23cb2a5-36e8-4b5c-8025-f5d2c35e37a5 tempest-VolumesSnapshotListTestJSON-245896798 None] Lock "cinder-quobyte-142a626f-78a3-41d0-a84e-8e9f51a68a27" released by "_delete_snapshot" :: held 3.206s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:11 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d23cb2a5-36e8-4b5c-8025-f5d2c35e37a5 tempest-VolumesSnapshotListTestJSON-245896798 None] Lock "cinder-quobyte-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8" released by "delete_snapshot" :: held 3.234s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:11 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-d23cb2a5-36e8-4b5c-8025-f5d2c35e37a5 tempest-VolumesSnapshotListTestJSON-245896798 None] Created reservations ['39bd624c-3403-4263-8365-93aea5d4df66', '79d55a3a-4ace-4ede-bfa3-af4df9f3bb9d', '4175ddc2-eee8-4179-b082-3258e81b6895', '52438648-d9c6-4611-99e9-e43f4aa4b181'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:32:11 devstack sudo[100226]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-340e952e-e034-450b-bfa7-d98ae79e36c2 tempest-SnapshotMetadataTestJSON-91279543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0d15c2b-f7f0-440a-8845-077a76ae236a.info" returned: 0 in 0.649s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-340e952e-e034-450b-bfa7-d98ae79e36c2 tempest-SnapshotMetadataTestJSON-91279543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.367s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.718s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:11 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-469258150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e09b9c94-9373-4bac-9614-06b37514b12a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e520a62f0754fbeab3414f6ffbd91f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:32:03Z,use_quota=True,user_id='b281227b410144e2b11fb7f893ec37a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:32:11 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Creating volume e09b9c94-9373-4bac-9614-06b37514b12a {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:32:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:11 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:32:11 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:32:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:11 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:32:11 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:32:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e09b9c94-9373-4bac-9614-06b37514b12a 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:11 devstack sudo[100230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e09b9c94-9373-4bac-9614-06b37514b12a 1073741824 Jul 07 17:32:11 devstack sudo[100230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:11 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-340e952e-e034-450b-bfa7-d98ae79e36c2 tempest-SnapshotMetadataTestJSON-91279543 None] Create snapshot completed successfully Jul 07 17:32:11 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-d23cb2a5-36e8-4b5c-8025-f5d2c35e37a5 tempest-VolumesSnapshotListTestJSON-245896798 None] Delete snapshot completed successfully. Jul 07 17:32:11 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d23cb2a5-36e8-4b5c-8025-f5d2c35e37a5 tempest-VolumesSnapshotListTestJSON-245896798 None] Lock "cinder-142a626f-78a3-41d0-a84e-8e9f51a68a27-delete_snapshot" released by "delete_snapshot" :: held 3.446s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:12 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3f13467b-e6c5-4741-8654-224a57b74226 tempest-VolumesSnapshotListTestJSON-245896798 None] Acquiring lock "cinder-6cf04681-e9ea-4083-aa0e-550c917c4e12-delete_snapshot" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:12 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3f13467b-e6c5-4741-8654-224a57b74226 tempest-VolumesSnapshotListTestJSON-245896798 None] Lock "cinder-6cf04681-e9ea-4083-aa0e-550c917c4e12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:12 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3f13467b-e6c5-4741-8654-224a57b74226 tempest-VolumesSnapshotListTestJSON-245896798 None] Acquiring lock "cinder-quobyte-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:12 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3f13467b-e6c5-4741-8654-224a57b74226 tempest-VolumesSnapshotListTestJSON-245896798 None] Lock "cinder-quobyte-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:12 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3f13467b-e6c5-4741-8654-224a57b74226 tempest-VolumesSnapshotListTestJSON-245896798 None] Acquiring lock "cinder-quobyte-6cf04681-e9ea-4083-aa0e-550c917c4e12" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:12 devstack sudo[100230]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:12 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3f13467b-e6c5-4741-8654-224a57b74226 tempest-VolumesSnapshotListTestJSON-245896798 None] Lock "cinder-quobyte-6cf04681-e9ea-4083-aa0e-550c917c4e12" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:12 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-3f13467b-e6c5-4741-8654-224a57b74226 tempest-VolumesSnapshotListTestJSON-245896798 None] Deleting offline snapshot 6cf04681-e9ea-4083-aa0e-550c917c4e12 of volume 02d1aaaa-1a71-4b52-813d-a7a3abfadcb8 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:32:12 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-3f13467b-e6c5-4741-8654-224a57b74226 tempest-VolumesSnapshotListTestJSON-245896798 None] snapshot_file for this snap is: volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.6cf04681-e9ea-4083-aa0e-550c917c4e12 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:32:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e09b9c94-9373-4bac-9614-06b37514b12a 1073741824" returned: 0 in 0.970s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:12 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee16ee7-be94-4cc5-af65-e2ebdc5cde3e]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3f13467b-e6c5-4741-8654-224a57b74226 tempest-VolumesSnapshotListTestJSON-245896798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.6cf04681-e9ea-4083-aa0e-550c917c4e12 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e09b9c94-9373-4bac-9614-06b37514b12a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:12 devstack sudo[100237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e09b9c94-9373-4bac-9614-06b37514b12a Jul 07 17:32:12 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:12 devstack sudo[100236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.6cf04681-e9ea-4083-aa0e-550c917c4e12 Jul 07 17:32:12 devstack sudo[100236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:13 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-250cf6e0-de21-4d19-b815-884d11385f5f tempest-SnapshotMetadataTestJSON-91279543 None] Acquiring lock "cinder-4b5d621a-e6b8-4641-83c2-925d862be928-delete_snapshot" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:13 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-250cf6e0-de21-4d19-b815-884d11385f5f tempest-SnapshotMetadataTestJSON-91279543 None] Lock "cinder-4b5d621a-e6b8-4641-83c2-925d862be928-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:13 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-250cf6e0-de21-4d19-b815-884d11385f5f tempest-SnapshotMetadataTestJSON-91279543 None] Acquiring lock "cinder-quobyte-a0d15c2b-f7f0-440a-8845-077a76ae236a" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:13 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-250cf6e0-de21-4d19-b815-884d11385f5f tempest-SnapshotMetadataTestJSON-91279543 None] Lock "cinder-quobyte-a0d15c2b-f7f0-440a-8845-077a76ae236a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:13 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-250cf6e0-de21-4d19-b815-884d11385f5f tempest-SnapshotMetadataTestJSON-91279543 None] Acquiring lock "cinder-quobyte-4b5d621a-e6b8-4641-83c2-925d862be928" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:13 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-250cf6e0-de21-4d19-b815-884d11385f5f tempest-SnapshotMetadataTestJSON-91279543 None] Lock "cinder-quobyte-4b5d621a-e6b8-4641-83c2-925d862be928" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:13 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-250cf6e0-de21-4d19-b815-884d11385f5f tempest-SnapshotMetadataTestJSON-91279543 None] Deleting offline snapshot 4b5d621a-e6b8-4641-83c2-925d862be928 of volume a0d15c2b-f7f0-440a-8845-077a76ae236a {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:32:13 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-250cf6e0-de21-4d19-b815-884d11385f5f tempest-SnapshotMetadataTestJSON-91279543 None] snapshot_file for this snap is: volume-a0d15c2b-f7f0-440a-8845-077a76ae236a.4b5d621a-e6b8-4641-83c2-925d862be928 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:32:13 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf8d06d-674c-4ed6-acf8-af5527bbb68f]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-250cf6e0-de21-4d19-b815-884d11385f5f tempest-SnapshotMetadataTestJSON-91279543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0d15c2b-f7f0-440a-8845-077a76ae236a.4b5d621a-e6b8-4641-83c2-925d862be928 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:13 devstack sudo[100241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0d15c2b-f7f0-440a-8845-077a76ae236a.4b5d621a-e6b8-4641-83c2-925d862be928 Jul 07 17:32:13 devstack sudo[100241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:13 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e09b9c94-9373-4bac-9614-06b37514b12a" returned: 0 in 0.716s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:13 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] <== create_volume: return (1750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:32:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.755s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:13 devstack cinder-volume[87233]: DEBUG cinder.volume.volume_utils [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Attempting download of 0e7aa8bb-335b-45a2-aabb-4dc50188f189 ((None, [{'url': 'file:///opt/stack/data/glance/images/0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'metadata': {}}])) to volume e09b9c94-9373-4bac-9614-06b37514b12a. {{(pid=87233) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 17:32:13 devstack sudo[100236]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3f13467b-e6c5-4741-8654-224a57b74226 tempest-VolumesSnapshotListTestJSON-245896798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.6cf04681-e9ea-4083-aa0e-550c917c4e12" returned: 0 in 0.849s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:13 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-3f13467b-e6c5-4741-8654-224a57b74226 tempest-VolumesSnapshotListTestJSON-245896798 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:32:13 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc7d336-8503-47a5-a12e-381a5cae6479]: (4, 'raw') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e7aa8bb-335b-45a2-aabb-4dc50188f189_bouvayw5 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:13 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d65139-9378-4502-8b20-80087b1ebe8b]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3f13467b-e6c5-4741-8654-224a57b74226 tempest-VolumesSnapshotListTestJSON-245896798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.f3a2a447-ca32-4915-9396-6b76e93816f0 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:13 devstack sudo[100246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e7aa8bb-335b-45a2-aabb-4dc50188f189_bouvayw5 Jul 07 17:32:13 devstack sudo[100246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:13 devstack sudo[100247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.f3a2a447-ca32-4915-9396-6b76e93816f0 Jul 07 17:32:13 devstack sudo[100247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:14 devstack sudo[100241]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-250cf6e0-de21-4d19-b815-884d11385f5f tempest-SnapshotMetadataTestJSON-91279543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0d15c2b-f7f0-440a-8845-077a76ae236a.4b5d621a-e6b8-4641-83c2-925d862be928" returned: 0 in 0.873s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:14 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-250cf6e0-de21-4d19-b815-884d11385f5f tempest-SnapshotMetadataTestJSON-91279543 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0d15c2b-f7f0-440a-8845-077a76ae236a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:32:14 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7fb836-f43c-4c15-ade2-53a2631739be]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-250cf6e0-de21-4d19-b815-884d11385f5f tempest-SnapshotMetadataTestJSON-91279543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0d15c2b-f7f0-440a-8845-077a76ae236a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:14 devstack sudo[100253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0d15c2b-f7f0-440a-8845-077a76ae236a Jul 07 17:32:14 devstack sudo[100253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:14 devstack sudo[100246]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e7aa8bb-335b-45a2-aabb-4dc50188f189_bouvayw5" returned: 0 in 0.786s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e7aa8bb-335b-45a2-aabb-4dc50188f189_bouvayw5 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:14 devstack sudo[100247]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3f13467b-e6c5-4741-8654-224a57b74226 tempest-VolumesSnapshotListTestJSON-245896798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.f3a2a447-ca32-4915-9396-6b76e93816f0" returned: 0 in 0.818s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:14 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-3f13467b-e6c5-4741-8654-224a57b74226 tempest-VolumesSnapshotListTestJSON-245896798 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:32:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3f13467b-e6c5-4741-8654-224a57b74226 tempest-VolumesSnapshotListTestJSON-245896798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.6cf04681-e9ea-4083-aa0e-550c917c4e12 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:14 devstack sudo[100261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.6cf04681-e9ea-4083-aa0e-550c917c4e12 Jul 07 17:32:14 devstack sudo[100261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:14 devstack sudo[100260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e7aa8bb-335b-45a2-aabb-4dc50188f189_bouvayw5 Jul 07 17:32:14 devstack sudo[100260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:15 devstack sudo[100253]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-250cf6e0-de21-4d19-b815-884d11385f5f tempest-SnapshotMetadataTestJSON-91279543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0d15c2b-f7f0-440a-8845-077a76ae236a" returned: 0 in 0.801s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-250cf6e0-de21-4d19-b815-884d11385f5f tempest-SnapshotMetadataTestJSON-91279543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0d15c2b-f7f0-440a-8845-077a76ae236a.4b5d621a-e6b8-4641-83c2-925d862be928 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:15 devstack sudo[100270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0d15c2b-f7f0-440a-8845-077a76ae236a.4b5d621a-e6b8-4641-83c2-925d862be928 Jul 07 17:32:15 devstack sudo[100270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:15 devstack sudo[100260]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e7aa8bb-335b-45a2-aabb-4dc50188f189_bouvayw5" returned: 1 in 0.801s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e7aa8bb-335b-45a2-aabb-4dc50188f189_bouvayw5' failed. Not Retrying. {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:32:15 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a71805e-a983-4abf-b893-ad0ae3d59504]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_xyxsbvz9devstack@QuobyteHD {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:15 devstack sudo[100261]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3f13467b-e6c5-4741-8654-224a57b74226 tempest-VolumesSnapshotListTestJSON-245896798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.6cf04681-e9ea-4083-aa0e-550c917c4e12" returned: 0 in 0.848s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3f13467b-e6c5-4741-8654-224a57b74226 tempest-VolumesSnapshotListTestJSON-245896798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.6cf04681-e9ea-4083-aa0e-550c917c4e12 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:15 devstack sudo[100309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.6cf04681-e9ea-4083-aa0e-550c917c4e12 Jul 07 17:32:15 devstack sudo[100309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:15 devstack sudo[100308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_xyxsbvz9devstack@QuobyteHD Jul 07 17:32:15 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:16 devstack sudo[100270]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-250cf6e0-de21-4d19-b815-884d11385f5f tempest-SnapshotMetadataTestJSON-91279543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0d15c2b-f7f0-440a-8845-077a76ae236a.4b5d621a-e6b8-4641-83c2-925d862be928" returned: 0 in 0.879s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-250cf6e0-de21-4d19-b815-884d11385f5f tempest-SnapshotMetadataTestJSON-91279543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0d15c2b-f7f0-440a-8845-077a76ae236a.4b5d621a-e6b8-4641-83c2-925d862be928 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:16 devstack sudo[100323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0d15c2b-f7f0-440a-8845-077a76ae236a.4b5d621a-e6b8-4641-83c2-925d862be928 Jul 07 17:32:16 devstack sudo[100323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:16 devstack sudo[100309]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3f13467b-e6c5-4741-8654-224a57b74226 tempest-VolumesSnapshotListTestJSON-245896798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.6cf04681-e9ea-4083-aa0e-550c917c4e12" returned: 0 in 0.741s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:16 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_xyxsbvz9devstack@QuobyteHD" returned: 0 in 0.850s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:16 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] 0e7aa8bb-335b-45a2-aabb-4dc50188f189 was qcow2, converting to raw {{(pid=87233) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 17:32:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_xyxsbvz9devstack@QuobyteHD /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e09b9c94-9373-4bac-9614-06b37514b12a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:16 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3f13467b-e6c5-4741-8654-224a57b74226 tempest-VolumesSnapshotListTestJSON-245896798 None] Lock "cinder-quobyte-6cf04681-e9ea-4083-aa0e-550c917c4e12" released by "_delete_snapshot" :: held 3.403s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:16 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3f13467b-e6c5-4741-8654-224a57b74226 tempest-VolumesSnapshotListTestJSON-245896798 None] Lock "cinder-quobyte-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8" released by "delete_snapshot" :: held 3.434s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:16 devstack sudo[100325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_xyxsbvz9devstack@QuobyteHD /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e09b9c94-9373-4bac-9614-06b37514b12a Jul 07 17:32:16 devstack sudo[100325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:16 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-3f13467b-e6c5-4741-8654-224a57b74226 tempest-VolumesSnapshotListTestJSON-245896798 None] Created reservations ['c8ce60df-41e8-4de0-a68b-292f87259c13', '6deb1cee-6277-4b78-b664-21f4b4c3850b', 'f6b7c865-3fdc-4cac-b35a-209d71dab023', '89f7cb3d-4d9e-4447-a942-6a83856db5d5'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:32:16 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-3f13467b-e6c5-4741-8654-224a57b74226 tempest-VolumesSnapshotListTestJSON-245896798 None] Delete snapshot completed successfully. Jul 07 17:32:16 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3f13467b-e6c5-4741-8654-224a57b74226 tempest-VolumesSnapshotListTestJSON-245896798 None] Lock "cinder-6cf04681-e9ea-4083-aa0e-550c917c4e12-delete_snapshot" released by "delete_snapshot" :: held 3.623s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:16 devstack sudo[100323]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-250cf6e0-de21-4d19-b815-884d11385f5f tempest-SnapshotMetadataTestJSON-91279543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0d15c2b-f7f0-440a-8845-077a76ae236a.4b5d621a-e6b8-4641-83c2-925d862be928" returned: 0 in 0.690s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:16 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-250cf6e0-de21-4d19-b815-884d11385f5f tempest-SnapshotMetadataTestJSON-91279543 None] Lock "cinder-quobyte-4b5d621a-e6b8-4641-83c2-925d862be928" released by "_delete_snapshot" :: held 3.364s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:16 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-250cf6e0-de21-4d19-b815-884d11385f5f tempest-SnapshotMetadataTestJSON-91279543 None] Lock "cinder-quobyte-a0d15c2b-f7f0-440a-8845-077a76ae236a" released by "delete_snapshot" :: held 3.393s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:16 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-250cf6e0-de21-4d19-b815-884d11385f5f tempest-SnapshotMetadataTestJSON-91279543 None] Created reservations ['f3cd342a-28ff-45d6-b743-987ac5b85edc', '964c1625-53d1-4fff-87b3-72b58486f2ce', '25e35d21-603a-496f-acd5-69f15a81168a', 'fed63f42-d951-42ac-8801-227b96e47dd7'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:32:16 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-250cf6e0-de21-4d19-b815-884d11385f5f tempest-SnapshotMetadataTestJSON-91279543 None] Delete snapshot completed successfully. Jul 07 17:32:16 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-250cf6e0-de21-4d19-b815-884d11385f5f tempest-SnapshotMetadataTestJSON-91279543 None] Lock "cinder-4b5d621a-e6b8-4641-83c2-925d862be928-delete_snapshot" released by "delete_snapshot" :: held 3.565s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:16 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-349bde3b-5b99-4ad9-91b8-64dbc2e86b03 tempest-VolumesSnapshotListTestJSON-245896798 None] Acquiring lock "cinder-f3a2a447-ca32-4915-9396-6b76e93816f0-delete_snapshot" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:17 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-349bde3b-5b99-4ad9-91b8-64dbc2e86b03 tempest-VolumesSnapshotListTestJSON-245896798 None] Lock "cinder-f3a2a447-ca32-4915-9396-6b76e93816f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:17 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-349bde3b-5b99-4ad9-91b8-64dbc2e86b03 tempest-VolumesSnapshotListTestJSON-245896798 None] Acquiring lock "cinder-quobyte-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:17 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-349bde3b-5b99-4ad9-91b8-64dbc2e86b03 tempest-VolumesSnapshotListTestJSON-245896798 None] Lock "cinder-quobyte-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:17 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-349bde3b-5b99-4ad9-91b8-64dbc2e86b03 tempest-VolumesSnapshotListTestJSON-245896798 None] Acquiring lock "cinder-quobyte-f3a2a447-ca32-4915-9396-6b76e93816f0" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:17 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-349bde3b-5b99-4ad9-91b8-64dbc2e86b03 tempest-VolumesSnapshotListTestJSON-245896798 None] Lock "cinder-quobyte-f3a2a447-ca32-4915-9396-6b76e93816f0" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:17 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-349bde3b-5b99-4ad9-91b8-64dbc2e86b03 tempest-VolumesSnapshotListTestJSON-245896798 None] Deleting offline snapshot f3a2a447-ca32-4915-9396-6b76e93816f0 of volume 02d1aaaa-1a71-4b52-813d-a7a3abfadcb8 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:32:17 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-349bde3b-5b99-4ad9-91b8-64dbc2e86b03 tempest-VolumesSnapshotListTestJSON-245896798 None] snapshot_file for this snap is: volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.f3a2a447-ca32-4915-9396-6b76e93816f0 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:32:17 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[540693a7-5054-440e-b07e-a59f5e22b0ce]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-349bde3b-5b99-4ad9-91b8-64dbc2e86b03 tempest-VolumesSnapshotListTestJSON-245896798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.f3a2a447-ca32-4915-9396-6b76e93816f0 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:17 devstack sudo[100333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.f3a2a447-ca32-4915-9396-6b76e93816f0 Jul 07 17:32:17 devstack sudo[100333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:17 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-1696d479-fa18-44ec-a16f-40dc5f5e4e59 tempest-SnapshotMetadataTestJSON-91279543 None] Acquiring lock "cinder-a0d15c2b-f7f0-440a-8845-077a76ae236a-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:17 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-1696d479-fa18-44ec-a16f-40dc5f5e4e59 tempest-SnapshotMetadataTestJSON-91279543 None] Lock "cinder-a0d15c2b-f7f0-440a-8845-077a76ae236a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:17 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-1696d479-fa18-44ec-a16f-40dc5f5e4e59 tempest-SnapshotMetadataTestJSON-91279543 None] Acquiring lock "cinder-quobyte-a0d15c2b-f7f0-440a-8845-077a76ae236a" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:17 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-1696d479-fa18-44ec-a16f-40dc5f5e4e59 tempest-SnapshotMetadataTestJSON-91279543 None] Lock "cinder-quobyte-a0d15c2b-f7f0-440a-8845-077a76ae236a" acquired by "delete_volume" :: waited 0.023s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:17 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a16bc3-b79f-468f-810c-f84b28270cb9]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1696d479-fa18-44ec-a16f-40dc5f5e4e59 tempest-SnapshotMetadataTestJSON-91279543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0d15c2b-f7f0-440a-8845-077a76ae236a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:18 devstack sudo[100333]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-349bde3b-5b99-4ad9-91b8-64dbc2e86b03 tempest-VolumesSnapshotListTestJSON-245896798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.f3a2a447-ca32-4915-9396-6b76e93816f0" returned: 0 in 0.971s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:18 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-349bde3b-5b99-4ad9-91b8-64dbc2e86b03 tempest-VolumesSnapshotListTestJSON-245896798 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:32:18 devstack sudo[100337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0d15c2b-f7f0-440a-8845-077a76ae236a Jul 07 17:32:18 devstack sudo[100337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:18 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa794ba-fb4f-4c17-8b9f-179805a20912]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-349bde3b-5b99-4ad9-91b8-64dbc2e86b03 tempest-VolumesSnapshotListTestJSON-245896798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:18 devstack sudo[100340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8 Jul 07 17:32:18 devstack sudo[100340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:18 devstack sudo[100325]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_xyxsbvz9devstack@QuobyteHD /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e09b9c94-9373-4bac-9614-06b37514b12a" returned: 0 in 2.284s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:18 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_xyxsbvz9devstack@QuobyteHD, size 112.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e09b9c94-9373-4bac-9614-06b37514b12a {{(pid=87233) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:32:18 devstack cinder-volume[87233]: INFO cinder.image.image_utils [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Converted 112.00 MB image at 48.98 MB/s Jul 07 17:32:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e09b9c94-9373-4bac-9614-06b37514b12a 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:18 devstack sudo[100342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e09b9c94-9373-4bac-9614-06b37514b12a 1G Jul 07 17:32:18 devstack sudo[100342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:18 devstack sudo[100337]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1696d479-fa18-44ec-a16f-40dc5f5e4e59 tempest-SnapshotMetadataTestJSON-91279543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0d15c2b-f7f0-440a-8845-077a76ae236a" returned: 0 in 1.022s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1696d479-fa18-44ec-a16f-40dc5f5e4e59 tempest-SnapshotMetadataTestJSON-91279543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0d15c2b-f7f0-440a-8845-077a76ae236a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:18 devstack sudo[100350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0d15c2b-f7f0-440a-8845-077a76ae236a Jul 07 17:32:18 devstack sudo[100340]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:18 devstack sudo[100350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-349bde3b-5b99-4ad9-91b8-64dbc2e86b03 tempest-VolumesSnapshotListTestJSON-245896798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8" returned: 0 in 0.852s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-349bde3b-5b99-4ad9-91b8-64dbc2e86b03 tempest-VolumesSnapshotListTestJSON-245896798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.f3a2a447-ca32-4915-9396-6b76e93816f0 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:18 devstack sudo[100352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.f3a2a447-ca32-4915-9396-6b76e93816f0 Jul 07 17:32:18 devstack sudo[100352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:19 devstack sudo[100342]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e09b9c94-9373-4bac-9614-06b37514b12a 1G" returned: 0 in 0.755s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:19 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[18276c3d-1c37-4785-8a36-036d763bd849]: (4, 'raw') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e09b9c94-9373-4bac-9614-06b37514b12a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:19 devstack sudo[100357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e09b9c94-9373-4bac-9614-06b37514b12a Jul 07 17:32:19 devstack sudo[100357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:19 devstack sudo[100350]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1696d479-fa18-44ec-a16f-40dc5f5e4e59 tempest-SnapshotMetadataTestJSON-91279543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a0d15c2b-f7f0-440a-8845-077a76ae236a" returned: 0 in 0.715s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:19 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-1696d479-fa18-44ec-a16f-40dc5f5e4e59 tempest-SnapshotMetadataTestJSON-91279543 None] Lock "cinder-quobyte-a0d15c2b-f7f0-440a-8845-077a76ae236a" released by "delete_volume" :: held 1.810s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:19 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-1696d479-fa18-44ec-a16f-40dc5f5e4e59 tempest-SnapshotMetadataTestJSON-91279543 None] Created reservations ['04469278-42a0-4875-b04f-c704ff38578a', '42329793-a188-431b-9c50-ffb25db08df7', '7bc33917-7bab-4759-a096-c846fd27c157', '1d2525c8-9b6e-45fb-b6d0-d188bf64ef2b'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:32:19 devstack sudo[100352]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-349bde3b-5b99-4ad9-91b8-64dbc2e86b03 tempest-VolumesSnapshotListTestJSON-245896798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.f3a2a447-ca32-4915-9396-6b76e93816f0" returned: 0 in 0.828s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-349bde3b-5b99-4ad9-91b8-64dbc2e86b03 tempest-VolumesSnapshotListTestJSON-245896798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.f3a2a447-ca32-4915-9396-6b76e93816f0 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1696d479-fa18-44ec-a16f-40dc5f5e4e59 tempest-SnapshotMetadataTestJSON-91279543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1696d479-fa18-44ec-a16f-40dc5f5e4e59 tempest-SnapshotMetadataTestJSON-91279543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:19 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-1696d479-fa18-44ec-a16f-40dc5f5e4e59 tempest-SnapshotMetadataTestJSON-91279543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:32:19 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-1696d479-fa18-44ec-a16f-40dc5f5e4e59 tempest-SnapshotMetadataTestJSON-91279543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:32:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1696d479-fa18-44ec-a16f-40dc5f5e4e59 tempest-SnapshotMetadataTestJSON-91279543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1696d479-fa18-44ec-a16f-40dc5f5e4e59 tempest-SnapshotMetadataTestJSON-91279543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:19 devstack sudo[100364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.f3a2a447-ca32-4915-9396-6b76e93816f0 Jul 07 17:32:19 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:19 devstack sudo[100365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:32:19 devstack sudo[100365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:20 devstack sudo[100357]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e09b9c94-9373-4bac-9614-06b37514b12a" returned: 0 in 0.851s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e09b9c94-9373-4bac-9614-06b37514b12a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:20 devstack sudo[100370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e09b9c94-9373-4bac-9614-06b37514b12a Jul 07 17:32:20 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:20 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-349bde3b-5b99-4ad9-91b8-64dbc2e86b03 tempest-VolumesSnapshotListTestJSON-245896798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8.f3a2a447-ca32-4915-9396-6b76e93816f0" returned: 0 in 0.822s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:20 devstack sudo[100365]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1696d479-fa18-44ec-a16f-40dc5f5e4e59 tempest-SnapshotMetadataTestJSON-91279543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.816s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:20 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-1696d479-fa18-44ec-a16f-40dc5f5e4e59 tempest-SnapshotMetadataTestJSON-91279543 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:32:20 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-1696d479-fa18-44ec-a16f-40dc5f5e4e59 tempest-SnapshotMetadataTestJSON-91279543 None] Deleted volume successfully. Jul 07 17:32:20 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-349bde3b-5b99-4ad9-91b8-64dbc2e86b03 tempest-VolumesSnapshotListTestJSON-245896798 None] Lock "cinder-quobyte-f3a2a447-ca32-4915-9396-6b76e93816f0" released by "_delete_snapshot" :: held 3.626s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:20 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-349bde3b-5b99-4ad9-91b8-64dbc2e86b03 tempest-VolumesSnapshotListTestJSON-245896798 None] Lock "cinder-quobyte-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8" released by "delete_snapshot" :: held 3.659s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:20 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-1696d479-fa18-44ec-a16f-40dc5f5e4e59 tempest-SnapshotMetadataTestJSON-91279543 None] Lock "cinder-a0d15c2b-f7f0-440a-8845-077a76ae236a-delete_volume" released by "delete_volume" :: held 2.923s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:20 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-349bde3b-5b99-4ad9-91b8-64dbc2e86b03 tempest-VolumesSnapshotListTestJSON-245896798 None] Created reservations ['6f54c315-efcd-4e1f-a0b6-3a44acbdf209', '0f1b994a-af51-45d5-9f8c-5eb483771090', '5af1b9ad-47fa-4a8f-a167-3568c3148b32', '6fa52053-1b41-4b22-86de-b93cac50989d'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:32:20 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-349bde3b-5b99-4ad9-91b8-64dbc2e86b03 tempest-VolumesSnapshotListTestJSON-245896798 None] Delete snapshot completed successfully. Jul 07 17:32:20 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-349bde3b-5b99-4ad9-91b8-64dbc2e86b03 tempest-VolumesSnapshotListTestJSON-245896798 None] Lock "cinder-f3a2a447-ca32-4915-9396-6b76e93816f0-delete_snapshot" released by "delete_snapshot" :: held 3.823s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:20 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e09b9c94-9373-4bac-9614-06b37514b12a" returned: 1 in 0.874s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e09b9c94-9373-4bac-9614-06b37514b12a' failed. Not Retrying. {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:32:20 devstack cinder-volume[87233]: DEBUG cinder.volume.volume_utils [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Downloaded image 0e7aa8bb-335b-45a2-aabb-4dc50188f189 ((None, [{'url': 'file:///opt/stack/data/glance/images/0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'metadata': {}}])) to volume e09b9c94-9373-4bac-9614-06b37514b12a successfully. {{(pid=87233) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 17:32:20 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Temporary image 0e7aa8bb-335b-45a2-aabb-4dc50188f189 for user b281227b410144e2b11fb7f893ec37a8 is deleted. {{(pid=87233) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 17:32:20 devstack cinder-volume[87233]: DEBUG cinder.volume.volume_utils [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Marking volume e09b9c94-9373-4bac-9614-06b37514b12a as bootable. {{(pid=87233) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 17:32:21 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Copying metadata from image 0e7aa8bb-335b-45a2-aabb-4dc50188f189 to e09b9c94-9373-4bac-9614-06b37514b12a. {{(pid=87233) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 17:32:21 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Creating volume glance metadata for volume e09b9c94-9373-4bac-9614-06b37514b12a backed by image 0e7aa8bb-335b-45a2-aabb-4dc50188f189 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87233) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 17:32:21 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7fb1e81-1733-4f6a-b7fd-4be58cea8b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e09b9c94-9373-4bac-9614-06b37514b12a', 'volume_size': 1, 'image_id': '0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ed2f318bab304b78b69744376e93ea0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'created_at': datetime.datetime(2026, 7, 7, 15, 11, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 11, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e7aa8bb-335b-45a2-aabb-4dc50188f189/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:21 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ddf3e5c-0dc1-468e-bccd-22233397bc73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:21 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Volume volume-e09b9c94-9373-4bac-9614-06b37514b12a (e09b9c94-9373-4bac-9614-06b37514b12a): created successfully Jul 07 17:32:21 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ddf3e5c-0dc1-468e-bccd-22233397bc73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:21 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Flow 'volume_create_manager' (7db7d419-09c9-4dbc-8818-4917b7b091c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:32:21 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-bc6628d9-3b8e-47f7-bd41-754e9428a70c tempest-TestShelveInstance-1988315190 None] Created volume successfully. Jul 07 17:32:21 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-f861ea29-7a32-40da-9df9-bf73be9c5a46 tempest-VolumesSnapshotListTestJSON-245896798 None] Acquiring lock "cinder-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:21 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-f861ea29-7a32-40da-9df9-bf73be9c5a46 tempest-VolumesSnapshotListTestJSON-245896798 None] Lock "cinder-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:21 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-f861ea29-7a32-40da-9df9-bf73be9c5a46 tempest-VolumesSnapshotListTestJSON-245896798 None] Acquiring lock "cinder-quobyte-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:21 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-f861ea29-7a32-40da-9df9-bf73be9c5a46 tempest-VolumesSnapshotListTestJSON-245896798 None] Lock "cinder-quobyte-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8" acquired by "delete_volume" :: waited 0.021s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:21 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5420b1bc-10f2-4fe2-a429-d13ab7544ac8]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f861ea29-7a32-40da-9df9-bf73be9c5a46 tempest-VolumesSnapshotListTestJSON-245896798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:21 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8 Jul 07 17:32:21 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:22 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f861ea29-7a32-40da-9df9-bf73be9c5a46 tempest-VolumesSnapshotListTestJSON-245896798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8" returned: 0 in 0.868s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f861ea29-7a32-40da-9df9-bf73be9c5a46 tempest-VolumesSnapshotListTestJSON-245896798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:22 devstack sudo[100390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8 Jul 07 17:32:22 devstack sudo[100390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:23 devstack sudo[100390]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f861ea29-7a32-40da-9df9-bf73be9c5a46 tempest-VolumesSnapshotListTestJSON-245896798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8" returned: 0 in 0.765s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:23 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-f861ea29-7a32-40da-9df9-bf73be9c5a46 tempest-VolumesSnapshotListTestJSON-245896798 None] Lock "cinder-quobyte-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8" released by "delete_volume" :: held 1.726s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:23 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-f861ea29-7a32-40da-9df9-bf73be9c5a46 tempest-VolumesSnapshotListTestJSON-245896798 None] Created reservations ['75175983-37eb-4dfb-a4b2-e1acc9c46cfc', 'afa81b63-07d6-4550-8ec6-4bbe47ebe497', 'd462892c-edc5-4f84-aa22-599ca78eea2b', '75973b80-1000-44b2-9a39-913f554ad015'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:32:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f861ea29-7a32-40da-9df9-bf73be9c5a46 tempest-VolumesSnapshotListTestJSON-245896798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f861ea29-7a32-40da-9df9-bf73be9c5a46 tempest-VolumesSnapshotListTestJSON-245896798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:23 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-f861ea29-7a32-40da-9df9-bf73be9c5a46 tempest-VolumesSnapshotListTestJSON-245896798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:32:23 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-f861ea29-7a32-40da-9df9-bf73be9c5a46 tempest-VolumesSnapshotListTestJSON-245896798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:32:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f861ea29-7a32-40da-9df9-bf73be9c5a46 tempest-VolumesSnapshotListTestJSON-245896798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f861ea29-7a32-40da-9df9-bf73be9c5a46 tempest-VolumesSnapshotListTestJSON-245896798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:23 devstack sudo[100398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:32:23 devstack sudo[100398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:24 devstack sudo[100398]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f861ea29-7a32-40da-9df9-bf73be9c5a46 tempest-VolumesSnapshotListTestJSON-245896798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.831s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:24 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-f861ea29-7a32-40da-9df9-bf73be9c5a46 tempest-VolumesSnapshotListTestJSON-245896798 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:32:24 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-f861ea29-7a32-40da-9df9-bf73be9c5a46 tempest-VolumesSnapshotListTestJSON-245896798 None] Deleted volume successfully. Jul 07 17:32:24 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-f861ea29-7a32-40da-9df9-bf73be9c5a46 tempest-VolumesSnapshotListTestJSON-245896798 None] Lock "cinder-02d1aaaa-1a71-4b52-813d-a7a3abfadcb8-delete_volume" released by "delete_volume" :: held 2.835s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:25 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-81547b61-540c-463e-83e9-8f657a70580b tempest-VolumesTransfersV355Test-7094821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:32:25 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-81547b61-540c-463e-83e9-8f657a70580b tempest-VolumesTransfersV355Test-7094821 None] Flow 'volume_create_manager' (b6f172a5-9b3f-48a5-ae56-4e25026c78d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:32:25 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-81547b61-540c-463e-83e9-8f657a70580b tempest-VolumesTransfersV355Test-7094821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb105e8e-9a8a-4a63-83f8-b57d366476f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:25 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-81547b61-540c-463e-83e9-8f657a70580b tempest-VolumesTransfersV355Test-7094821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb105e8e-9a8a-4a63-83f8-b57d366476f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-238157945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c6af6b6-2c38-41e6-a108-6ee91da4c5b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='648a140ecf434ded82268779bea72bc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:32:25Z,use_quota=True,user_id='2b6353afd5244b7c8e2cb530af8374db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:25 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-81547b61-540c-463e-83e9-8f657a70580b tempest-VolumesTransfersV355Test-7094821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (194b6483-8445-4567-9657-3a43262f6c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:25 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-81547b61-540c-463e-83e9-8f657a70580b tempest-VolumesTransfersV355Test-7094821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (194b6483-8445-4567-9657-3a43262f6c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:25 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-81547b61-540c-463e-83e9-8f657a70580b tempest-VolumesTransfersV355Test-7094821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c53d9e28-be24-425d-bc43-81dbb579805a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:25 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-81547b61-540c-463e-83e9-8f657a70580b tempest-VolumesTransfersV355Test-7094821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c53d9e28-be24-425d-bc43-81dbb579805a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c6af6b6-2c38-41e6-a108-6ee91da4c5b1', 'volume_name': 'volume-9c6af6b6-2c38-41e6-a108-6ee91da4c5b1', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:25 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-81547b61-540c-463e-83e9-8f657a70580b tempest-VolumesTransfersV355Test-7094821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37ce1fd0-7bda-447e-8fd1-72896b6e31d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:25 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-81547b61-540c-463e-83e9-8f657a70580b tempest-VolumesTransfersV355Test-7094821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37ce1fd0-7bda-447e-8fd1-72896b6e31d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:25 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-81547b61-540c-463e-83e9-8f657a70580b tempest-VolumesTransfersV355Test-7094821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71e62c32-7902-4abb-9a46-9cda8b511e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:25 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-81547b61-540c-463e-83e9-8f657a70580b tempest-VolumesTransfersV355Test-7094821 None] Volume 9c6af6b6-2c38-41e6-a108-6ee91da4c5b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c6af6b6-2c38-41e6-a108-6ee91da4c5b1', 'volume_size': 1} Jul 07 17:32:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-81547b61-540c-463e-83e9-8f657a70580b tempest-VolumesTransfersV355Test-7094821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-81547b61-540c-463e-83e9-8f657a70580b tempest-VolumesTransfersV355Test-7094821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:25 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-81547b61-540c-463e-83e9-8f657a70580b tempest-VolumesTransfersV355Test-7094821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-238157945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c6af6b6-2c38-41e6-a108-6ee91da4c5b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='648a140ecf434ded82268779bea72bc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:32:25Z,use_quota=True,user_id='2b6353afd5244b7c8e2cb530af8374db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:32:25 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-81547b61-540c-463e-83e9-8f657a70580b tempest-VolumesTransfersV355Test-7094821 None] Creating volume 9c6af6b6-2c38-41e6-a108-6ee91da4c5b1 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:32:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-81547b61-540c-463e-83e9-8f657a70580b tempest-VolumesTransfersV355Test-7094821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-81547b61-540c-463e-83e9-8f657a70580b tempest-VolumesTransfersV355Test-7094821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:25 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-81547b61-540c-463e-83e9-8f657a70580b tempest-VolumesTransfersV355Test-7094821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:32:25 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-81547b61-540c-463e-83e9-8f657a70580b tempest-VolumesTransfersV355Test-7094821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:32:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-81547b61-540c-463e-83e9-8f657a70580b tempest-VolumesTransfersV355Test-7094821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:25 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-81547b61-540c-463e-83e9-8f657a70580b tempest-VolumesTransfersV355Test-7094821 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:32:25 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-81547b61-540c-463e-83e9-8f657a70580b tempest-VolumesTransfersV355Test-7094821 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:32:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-81547b61-540c-463e-83e9-8f657a70580b tempest-VolumesTransfersV355Test-7094821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-9c6af6b6-2c38-41e6-a108-6ee91da4c5b1 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:25 devstack sudo[100401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-9c6af6b6-2c38-41e6-a108-6ee91da4c5b1 1073741824 Jul 07 17:32:25 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:26 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-81547b61-540c-463e-83e9-8f657a70580b tempest-VolumesTransfersV355Test-7094821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-9c6af6b6-2c38-41e6-a108-6ee91da4c5b1 1073741824" returned: 0 in 0.980s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-81547b61-540c-463e-83e9-8f657a70580b tempest-VolumesTransfersV355Test-7094821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-9c6af6b6-2c38-41e6-a108-6ee91da4c5b1 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:26 devstack sudo[100407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-9c6af6b6-2c38-41e6-a108-6ee91da4c5b1 Jul 07 17:32:26 devstack sudo[100407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:27 devstack sudo[100407]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-81547b61-540c-463e-83e9-8f657a70580b tempest-VolumesTransfersV355Test-7094821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-9c6af6b6-2c38-41e6-a108-6ee91da4c5b1" returned: 0 in 0.691s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:27 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-81547b61-540c-463e-83e9-8f657a70580b tempest-VolumesTransfersV355Test-7094821 None] <== create_volume: return (1714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:32:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-81547b61-540c-463e-83e9-8f657a70580b tempest-VolumesTransfersV355Test-7094821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.718s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:27 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-81547b61-540c-463e-83e9-8f657a70580b tempest-VolumesTransfersV355Test-7094821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71e62c32-7902-4abb-9a46-9cda8b511e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c6af6b6-2c38-41e6-a108-6ee91da4c5b1', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:27 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-81547b61-540c-463e-83e9-8f657a70580b tempest-VolumesTransfersV355Test-7094821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be9e92e0-5dbb-4b7d-8a8d-39eddcc5bb75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:27 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-81547b61-540c-463e-83e9-8f657a70580b tempest-VolumesTransfersV355Test-7094821 None] Volume volume-9c6af6b6-2c38-41e6-a108-6ee91da4c5b1 (9c6af6b6-2c38-41e6-a108-6ee91da4c5b1): created successfully Jul 07 17:32:27 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-81547b61-540c-463e-83e9-8f657a70580b tempest-VolumesTransfersV355Test-7094821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be9e92e0-5dbb-4b7d-8a8d-39eddcc5bb75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:27 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-81547b61-540c-463e-83e9-8f657a70580b tempest-VolumesTransfersV355Test-7094821 None] Flow 'volume_create_manager' (b6f172a5-9b3f-48a5-ae56-4e25026c78d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:32:27 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-81547b61-540c-463e-83e9-8f657a70580b tempest-VolumesTransfersV355Test-7094821 None] Created volume successfully. Jul 07 17:32:28 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-b25039f0-206d-49ce-8012-ae2a0d3314a4 tempest-VolumesTransfersV355Test-979663227 None] Transfer volume completed successfully. Jul 07 17:32:29 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-fb38d0f7-08a5-46d4-bd35-645904b7c5f4 tempest-VolumesTransfersV355Test-1186117276 None] Acquiring lock "cinder-9c6af6b6-2c38-41e6-a108-6ee91da4c5b1-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:29 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-fb38d0f7-08a5-46d4-bd35-645904b7c5f4 tempest-VolumesTransfersV355Test-1186117276 None] Lock "cinder-9c6af6b6-2c38-41e6-a108-6ee91da4c5b1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-006f1e51-ea62-4ce6-b960-9e1db6a54699 req-5f94b119-a3b6-43cc-b049-5cae2a614fb4 tempest-TestShelveInstance-1988315190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-006f1e51-ea62-4ce6-b960-9e1db6a54699 req-5f94b119-a3b6-43cc-b049-5cae2a614fb4 tempest-TestShelveInstance-1988315190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:29 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-fb38d0f7-08a5-46d4-bd35-645904b7c5f4 tempest-VolumesTransfersV355Test-1186117276 None] Acquiring lock "cinder-quobyte-9c6af6b6-2c38-41e6-a108-6ee91da4c5b1" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:29 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-fb38d0f7-08a5-46d4-bd35-645904b7c5f4 tempest-VolumesTransfersV355Test-1186117276 None] Lock "cinder-quobyte-9c6af6b6-2c38-41e6-a108-6ee91da4c5b1" acquired by "delete_volume" :: waited 0.028s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:29 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f79067-67a6-4505-ae14-c94127eb9ae1]: (4, 'raw') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-006f1e51-ea62-4ce6-b960-9e1db6a54699 req-5f94b119-a3b6-43cc-b049-5cae2a614fb4 tempest-TestShelveInstance-1988315190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e09b9c94-9373-4bac-9614-06b37514b12a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:29 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b861e6-465e-4d39-8128-c35332224721]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fb38d0f7-08a5-46d4-bd35-645904b7c5f4 tempest-VolumesTransfersV355Test-1186117276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-9c6af6b6-2c38-41e6-a108-6ee91da4c5b1 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:29 devstack sudo[100418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e09b9c94-9373-4bac-9614-06b37514b12a Jul 07 17:32:29 devstack sudo[100418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:29 devstack sudo[100419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-9c6af6b6-2c38-41e6-a108-6ee91da4c5b1 Jul 07 17:32:29 devstack sudo[100419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:30 devstack sudo[100418]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-006f1e51-ea62-4ce6-b960-9e1db6a54699 req-5f94b119-a3b6-43cc-b049-5cae2a614fb4 tempest-TestShelveInstance-1988315190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e09b9c94-9373-4bac-9614-06b37514b12a" returned: 0 in 1.006s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-006f1e51-ea62-4ce6-b960-9e1db6a54699 req-5f94b119-a3b6-43cc-b049-5cae2a614fb4 tempest-TestShelveInstance-1988315190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e09b9c94-9373-4bac-9614-06b37514b12a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:30 devstack sudo[100419]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fb38d0f7-08a5-46d4-bd35-645904b7c5f4 tempest-VolumesTransfersV355Test-1186117276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-9c6af6b6-2c38-41e6-a108-6ee91da4c5b1" returned: 0 in 1.046s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fb38d0f7-08a5-46d4-bd35-645904b7c5f4 tempest-VolumesTransfersV355Test-1186117276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-9c6af6b6-2c38-41e6-a108-6ee91da4c5b1 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:30 devstack sudo[100430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-9c6af6b6-2c38-41e6-a108-6ee91da4c5b1 Jul 07 17:32:30 devstack sudo[100430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:30 devstack sudo[100429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e09b9c94-9373-4bac-9614-06b37514b12a Jul 07 17:32:30 devstack sudo[100429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:31 devstack sudo[100429]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-006f1e51-ea62-4ce6-b960-9e1db6a54699 req-5f94b119-a3b6-43cc-b049-5cae2a614fb4 tempest-TestShelveInstance-1988315190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e09b9c94-9373-4bac-9614-06b37514b12a" returned: 1 in 0.848s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-006f1e51-ea62-4ce6-b960-9e1db6a54699 req-5f94b119-a3b6-43cc-b049-5cae2a614fb4 tempest-TestShelveInstance-1988315190 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e09b9c94-9373-4bac-9614-06b37514b12a' failed. Not Retrying. {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:32:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-006f1e51-ea62-4ce6-b960-9e1db6a54699 req-5f94b119-a3b6-43cc-b049-5cae2a614fb4 tempest-TestShelveInstance-1988315190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.925s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:31 devstack sudo[100430]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fb38d0f7-08a5-46d4-bd35-645904b7c5f4 tempest-VolumesTransfersV355Test-1186117276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-9c6af6b6-2c38-41e6-a108-6ee91da4c5b1" returned: 0 in 0.805s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:31 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-fb38d0f7-08a5-46d4-bd35-645904b7c5f4 tempest-VolumesTransfersV355Test-1186117276 None] Lock "cinder-quobyte-9c6af6b6-2c38-41e6-a108-6ee91da4c5b1" released by "delete_volume" :: held 1.900s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:31 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:32:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Flow 'volume_create_manager' (8b93a4a3-ae7d-4409-a8c5-b070f7cbfb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:32:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f38adb65-0fa1-44ba-a82c-dd9949982c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f38adb65-0fa1-44ba-a82c-dd9949982c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:32:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c98eddb-e280-4fd3-8f21-09e0323f563f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54ed1fec21c7495bb6b0db50368e6fc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:32:32Z,use_quota=True,user_id='144b9d87a10b40328410e40a292b35b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d494a966-0539-4316-a05b-4c839e253bf3),volume_type_id=d494a966-0539-4316-a05b-4c839e253bf3)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399eecf1-44d6-464e-9319-27415c8faa0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399eecf1-44d6-464e-9319-27415c8faa0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (489731e1-9fb8-421e-883b-645e82f9ecae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:31 devstack cinder-volume[87233]: DEBUG cinder.image.glance [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Creating Keystone auth plugin from conf {{(pid=87233) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 17:32:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-006f1e51-ea62-4ce6-b960-9e1db6a54699 req-5f94b119-a3b6-43cc-b049-5cae2a614fb4 tempest-TestShelveInstance-1988315190 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7', 'name': 'volume-e09b9c94-9373-4bac-9614-06b37514b12a', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2f00a48d-d1e3-408c-a169-4cba6f19ca92', 'enforce_multipath': True} {{(pid=87233) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:32:31 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-fb38d0f7-08a5-46d4-bd35-645904b7c5f4 tempest-VolumesTransfersV355Test-1186117276 None] Created reservations ['38cc9e8f-c27a-4986-928c-684ba069e41b', '98367b75-739b-4fff-94b0-0678fadb7b97', 'b3fb6534-979a-4094-a8d2-0d780f49dc29', '3746193f-b4d5-4295-b3b1-1b28976a017a'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:32:31 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-006f1e51-ea62-4ce6-b960-9e1db6a54699 req-5f94b119-a3b6-43cc-b049-5cae2a614fb4 tempest-TestShelveInstance-1988315190 None] attachment_update completed successfully. Jul 07 17:32:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-fb38d0f7-08a5-46d4-bd35-645904b7c5f4 tempest-VolumesTransfersV355Test-1186117276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-fb38d0f7-08a5-46d4-bd35-645904b7c5f4 tempest-VolumesTransfersV355Test-1186117276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:31 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-fb38d0f7-08a5-46d4-bd35-645904b7c5f4 tempest-VolumesTransfersV355Test-1186117276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:32:31 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-fb38d0f7-08a5-46d4-bd35-645904b7c5f4 tempest-VolumesTransfersV355Test-1186117276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:32:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-fb38d0f7-08a5-46d4-bd35-645904b7c5f4 tempest-VolumesTransfersV355Test-1186117276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fb38d0f7-08a5-46d4-bd35-645904b7c5f4 tempest-VolumesTransfersV355Test-1186117276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:31 devstack sudo[100437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:32:31 devstack sudo[100437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (489731e1-9fb8-421e-883b-645e82f9ecae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5c98eddb-e280-4fd3-8f21-09e0323f563f', 'volume_name': 'volume-5c98eddb-e280-4fd3-8f21-09e0323f563f', 'volume_size': 1, 'image_id': '30d815e6-4186-4838-b636-dc97ee613fdf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30d815e6-4186-4838-b636-dc97ee613fdf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5957d4aef1e7e5ed76226e56dfbb72dd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '54ed1fec21c7495bb6b0db50368e6fc0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'da93809ad32aa60b4b6524a9845a1f1e5c6a44cda849d327d3e14f274a7904f389077f58b00bfd3c68575f85f6bd863d32f4d615c2f737f2c6b979732bcb0968', 'id': '30d815e6-4186-4838-b636-dc97ee613fdf', 'created_at': datetime.datetime(2026, 7, 7, 15, 32, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 32, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30d815e6-4186-4838-b636-dc97ee613fdf/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dacd879-874e-463e-a755-a5c707a0bd8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dacd879-874e-463e-a755-a5c707a0bd8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58aaaefe-c022-41a8-811e-b489573075ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:31 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Volume 5c98eddb-e280-4fd3-8f21-09e0323f563f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5c98eddb-e280-4fd3-8f21-09e0323f563f', 'volume_size': 1, 'image_id': '30d815e6-4186-4838-b636-dc97ee613fdf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30d815e6-4186-4838-b636-dc97ee613fdf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5957d4aef1e7e5ed76226e56dfbb72dd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '54ed1fec21c7495bb6b0db50368e6fc0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'da93809ad32aa60b4b6524a9845a1f1e5c6a44cda849d327d3e14f274a7904f389077f58b00bfd3c68575f85f6bd863d32f4d615c2f737f2c6b979732bcb0968', 'id': '30d815e6-4186-4838-b636-dc97ee613fdf', 'created_at': datetime.datetime(2026, 7, 7, 15, 32, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 32, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30d815e6-4186-4838-b636-dc97ee613fdf/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 07 17:32:31 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Trying to clone 5c98eddb-e280-4fd3-8f21-09e0323f563f from image 30d815e6-4186-4838-b636-dc97ee613fdf at location (None, [{'url': 'file:///opt/stack/data/glance/images/30d815e6-4186-4838-b636-dc97ee613fdf', 'metadata': {}}]). {{(pid=87233) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 17:32:32 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_30d815e6-4186-4838-b636-dc97ee613fdf__i9mbjl5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87233) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 17:32:32 devstack cinder-volume[87233]: INFO cinder.image.image_utils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Image download 0.00 MB at 0.00 MB/s Jul 07 17:32:32 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[451aba49-ec32-471f-af1f-67d0faa7437a]: (4, 'raw') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_30d815e6-4186-4838-b636-dc97ee613fdf__i9mbjl5devstack@QuobyteHD {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:32 devstack sudo[100439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_30d815e6-4186-4838-b636-dc97ee613fdf__i9mbjl5devstack@QuobyteHD Jul 07 17:32:32 devstack sudo[100439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:32 devstack sudo[100437]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fb38d0f7-08a5-46d4-bd35-645904b7c5f4 tempest-VolumesTransfersV355Test-1186117276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.764s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:32 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-fb38d0f7-08a5-46d4-bd35-645904b7c5f4 tempest-VolumesTransfersV355Test-1186117276 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:32:32 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-fb38d0f7-08a5-46d4-bd35-645904b7c5f4 tempest-VolumesTransfersV355Test-1186117276 None] Deleted volume successfully. Jul 07 17:32:32 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-fb38d0f7-08a5-46d4-bd35-645904b7c5f4 tempest-VolumesTransfersV355Test-1186117276 None] Lock "cinder-9c6af6b6-2c38-41e6-a108-6ee91da4c5b1-delete_volume" released by "delete_volume" :: held 3.015s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:32 devstack sudo[100439]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_30d815e6-4186-4838-b636-dc97ee613fdf__i9mbjl5devstack@QuobyteHD" returned: 0 in 0.762s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30d815e6-4186-4838-b636-dc97ee613fdf__i9mbjl5devstack@QuobyteHD {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:33 devstack sudo[100444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30d815e6-4186-4838-b636-dc97ee613fdf__i9mbjl5devstack@QuobyteHD Jul 07 17:32:33 devstack sudo[100444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:33 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-0259d86c-7df9-47c1-9e51-20042b03d699 tempest-VolumesTransfersV355Test-7094821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:32:33 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0259d86c-7df9-47c1-9e51-20042b03d699 tempest-VolumesTransfersV355Test-7094821 None] Flow 'volume_create_manager' (c4ebff65-1f25-4580-b929-4b5ecb5efe8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:32:33 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0259d86c-7df9-47c1-9e51-20042b03d699 tempest-VolumesTransfersV355Test-7094821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0031bbe2-c307-4d88-afcc-78b87a4b86f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:33 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0259d86c-7df9-47c1-9e51-20042b03d699 tempest-VolumesTransfersV355Test-7094821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0031bbe2-c307-4d88-afcc-78b87a4b86f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1238289956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9b1b37a-e56f-418e-9e4a-859d33f7f1f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='648a140ecf434ded82268779bea72bc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:32:33Z,use_quota=True,user_id='2b6353afd5244b7c8e2cb530af8374db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:33 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0259d86c-7df9-47c1-9e51-20042b03d699 tempest-VolumesTransfersV355Test-7094821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15d2bc24-e2e6-4fed-ad63-d81852f695df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:33 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0259d86c-7df9-47c1-9e51-20042b03d699 tempest-VolumesTransfersV355Test-7094821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15d2bc24-e2e6-4fed-ad63-d81852f695df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:33 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0259d86c-7df9-47c1-9e51-20042b03d699 tempest-VolumesTransfersV355Test-7094821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (273b2374-0c3b-411d-8e23-3616fcd96e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:33 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0259d86c-7df9-47c1-9e51-20042b03d699 tempest-VolumesTransfersV355Test-7094821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (273b2374-0c3b-411d-8e23-3616fcd96e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9b1b37a-e56f-418e-9e4a-859d33f7f1f1', 'volume_name': 'volume-a9b1b37a-e56f-418e-9e4a-859d33f7f1f1', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:33 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0259d86c-7df9-47c1-9e51-20042b03d699 tempest-VolumesTransfersV355Test-7094821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (098699db-315d-458a-ba03-f0801560e6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:33 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0259d86c-7df9-47c1-9e51-20042b03d699 tempest-VolumesTransfersV355Test-7094821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (098699db-315d-458a-ba03-f0801560e6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:33 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0259d86c-7df9-47c1-9e51-20042b03d699 tempest-VolumesTransfersV355Test-7094821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5889be1-e056-4163-b634-53956deac7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:33 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-0259d86c-7df9-47c1-9e51-20042b03d699 tempest-VolumesTransfersV355Test-7094821 None] Volume a9b1b37a-e56f-418e-9e4a-859d33f7f1f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9b1b37a-e56f-418e-9e4a-859d33f7f1f1', 'volume_size': 1} Jul 07 17:32:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0259d86c-7df9-47c1-9e51-20042b03d699 tempest-VolumesTransfersV355Test-7094821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0259d86c-7df9-47c1-9e51-20042b03d699 tempest-VolumesTransfersV355Test-7094821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:33 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-0259d86c-7df9-47c1-9e51-20042b03d699 tempest-VolumesTransfersV355Test-7094821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1238289956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9b1b37a-e56f-418e-9e4a-859d33f7f1f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='648a140ecf434ded82268779bea72bc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:32:33Z,use_quota=True,user_id='2b6353afd5244b7c8e2cb530af8374db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:32:33 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-0259d86c-7df9-47c1-9e51-20042b03d699 tempest-VolumesTransfersV355Test-7094821 None] Creating volume a9b1b37a-e56f-418e-9e4a-859d33f7f1f1 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:32:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0259d86c-7df9-47c1-9e51-20042b03d699 tempest-VolumesTransfersV355Test-7094821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0259d86c-7df9-47c1-9e51-20042b03d699 tempest-VolumesTransfersV355Test-7094821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:33 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-0259d86c-7df9-47c1-9e51-20042b03d699 tempest-VolumesTransfersV355Test-7094821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:32:33 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-0259d86c-7df9-47c1-9e51-20042b03d699 tempest-VolumesTransfersV355Test-7094821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:32:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0259d86c-7df9-47c1-9e51-20042b03d699 tempest-VolumesTransfersV355Test-7094821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:33 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-0259d86c-7df9-47c1-9e51-20042b03d699 tempest-VolumesTransfersV355Test-7094821 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:32:33 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-0259d86c-7df9-47c1-9e51-20042b03d699 tempest-VolumesTransfersV355Test-7094821 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:32:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0259d86c-7df9-47c1-9e51-20042b03d699 tempest-VolumesTransfersV355Test-7094821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a9b1b37a-e56f-418e-9e4a-859d33f7f1f1 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:33 devstack sudo[100446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a9b1b37a-e56f-418e-9e4a-859d33f7f1f1 1073741824 Jul 07 17:32:33 devstack sudo[100446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:33 devstack sudo[100444]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30d815e6-4186-4838-b636-dc97ee613fdf__i9mbjl5devstack@QuobyteHD" returned: 1 in 0.800s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30d815e6-4186-4838-b636-dc97ee613fdf__i9mbjl5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:32:33 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Temporary image 30d815e6-4186-4838-b636-dc97ee613fdf is fetched for user 144b9d87a10b40328410e40a292b35b4. {{(pid=87233) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 17:32:33 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[55872287-0d0a-46fc-8682-337a248e1c8d]: (4, 'raw') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_30d815e6-4186-4838-b636-dc97ee613fdf__i9mbjl5devstack@QuobyteHD {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:33 devstack sudo[100452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_30d815e6-4186-4838-b636-dc97ee613fdf__i9mbjl5devstack@QuobyteHD Jul 07 17:32:33 devstack sudo[100452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:34 devstack sudo[100446]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0259d86c-7df9-47c1-9e51-20042b03d699 tempest-VolumesTransfersV355Test-7094821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a9b1b37a-e56f-418e-9e4a-859d33f7f1f1 1073741824" returned: 0 in 1.003s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0259d86c-7df9-47c1-9e51-20042b03d699 tempest-VolumesTransfersV355Test-7094821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a9b1b37a-e56f-418e-9e4a-859d33f7f1f1 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:34 devstack sudo[100524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a9b1b37a-e56f-418e-9e4a-859d33f7f1f1 Jul 07 17:32:34 devstack sudo[100524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:34 devstack sudo[100452]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_30d815e6-4186-4838-b636-dc97ee613fdf__i9mbjl5devstack@QuobyteHD" returned: 0 in 0.778s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30d815e6-4186-4838-b636-dc97ee613fdf__i9mbjl5devstack@QuobyteHD {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:34 devstack sudo[100528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30d815e6-4186-4838-b636-dc97ee613fdf__i9mbjl5devstack@QuobyteHD Jul 07 17:32:34 devstack sudo[100528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:34 devstack sudo[100524]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0259d86c-7df9-47c1-9e51-20042b03d699 tempest-VolumesTransfersV355Test-7094821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a9b1b37a-e56f-418e-9e4a-859d33f7f1f1" returned: 0 in 0.706s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:34 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-0259d86c-7df9-47c1-9e51-20042b03d699 tempest-VolumesTransfersV355Test-7094821 None] <== create_volume: return (1760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:32:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0259d86c-7df9-47c1-9e51-20042b03d699 tempest-VolumesTransfersV355Test-7094821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.763s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:35 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0259d86c-7df9-47c1-9e51-20042b03d699 tempest-VolumesTransfersV355Test-7094821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5889be1-e056-4163-b634-53956deac7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9b1b37a-e56f-418e-9e4a-859d33f7f1f1', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:35 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0259d86c-7df9-47c1-9e51-20042b03d699 tempest-VolumesTransfersV355Test-7094821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (002709be-5114-4adf-969b-e91e42502e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:35 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-0259d86c-7df9-47c1-9e51-20042b03d699 tempest-VolumesTransfersV355Test-7094821 None] Volume volume-a9b1b37a-e56f-418e-9e4a-859d33f7f1f1 (a9b1b37a-e56f-418e-9e4a-859d33f7f1f1): created successfully Jul 07 17:32:35 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0259d86c-7df9-47c1-9e51-20042b03d699 tempest-VolumesTransfersV355Test-7094821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (002709be-5114-4adf-969b-e91e42502e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:35 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0259d86c-7df9-47c1-9e51-20042b03d699 tempest-VolumesTransfersV355Test-7094821 None] Flow 'volume_create_manager' (c4ebff65-1f25-4580-b929-4b5ecb5efe8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:32:35 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-0259d86c-7df9-47c1-9e51-20042b03d699 tempest-VolumesTransfersV355Test-7094821 None] Created volume successfully. Jul 07 17:32:35 devstack sudo[100528]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30d815e6-4186-4838-b636-dc97ee613fdf__i9mbjl5devstack@QuobyteHD" returned: 1 in 0.976s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30d815e6-4186-4838-b636-dc97ee613fdf__i9mbjl5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:32:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:35 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:32:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c98eddb-e280-4fd3-8f21-09e0323f563f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54ed1fec21c7495bb6b0db50368e6fc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:32:32Z,use_quota=True,user_id='144b9d87a10b40328410e40a292b35b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d494a966-0539-4316-a05b-4c839e253bf3),volume_type_id=d494a966-0539-4316-a05b-4c839e253bf3)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:32:35 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Creating volume 5c98eddb-e280-4fd3-8f21-09e0323f563f {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:32:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:35 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:32:35 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:32:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:35 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:32:35 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:32:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c98eddb-e280-4fd3-8f21-09e0323f563f 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:35 devstack sudo[100567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c98eddb-e280-4fd3-8f21-09e0323f563f 1073741824 Jul 07 17:32:35 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:35 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ffceab5f-b244-4de9-a861-16b32b60d8f2 tempest-VolumesTransfersV355Test-1186117276 None] Acquiring lock "cinder-a9b1b37a-e56f-418e-9e4a-859d33f7f1f1-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:36 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ffceab5f-b244-4de9-a861-16b32b60d8f2 tempest-VolumesTransfersV355Test-1186117276 None] Lock "cinder-a9b1b37a-e56f-418e-9e4a-859d33f7f1f1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:36 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ffceab5f-b244-4de9-a861-16b32b60d8f2 tempest-VolumesTransfersV355Test-1186117276 None] Acquiring lock "cinder-quobyte-a9b1b37a-e56f-418e-9e4a-859d33f7f1f1" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:36 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ffceab5f-b244-4de9-a861-16b32b60d8f2 tempest-VolumesTransfersV355Test-1186117276 None] Lock "cinder-quobyte-a9b1b37a-e56f-418e-9e4a-859d33f7f1f1" acquired by "delete_volume" :: waited 0.033s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:36 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0487341-e4e2-4895-8ca2-74cef5246125]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ffceab5f-b244-4de9-a861-16b32b60d8f2 tempest-VolumesTransfersV355Test-1186117276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a9b1b37a-e56f-418e-9e4a-859d33f7f1f1 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:36 devstack sudo[100581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a9b1b37a-e56f-418e-9e4a-859d33f7f1f1 Jul 07 17:32:36 devstack sudo[100581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:36 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c98eddb-e280-4fd3-8f21-09e0323f563f 1073741824" returned: 0 in 1.014s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c98eddb-e280-4fd3-8f21-09e0323f563f {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:36 devstack sudo[100588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c98eddb-e280-4fd3-8f21-09e0323f563f Jul 07 17:32:36 devstack sudo[100588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:37 devstack sudo[100581]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ffceab5f-b244-4de9-a861-16b32b60d8f2 tempest-VolumesTransfersV355Test-1186117276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a9b1b37a-e56f-418e-9e4a-859d33f7f1f1" returned: 0 in 0.872s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ffceab5f-b244-4de9-a861-16b32b60d8f2 tempest-VolumesTransfersV355Test-1186117276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a9b1b37a-e56f-418e-9e4a-859d33f7f1f1 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:37 devstack sudo[100916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a9b1b37a-e56f-418e-9e4a-859d33f7f1f1 Jul 07 17:32:37 devstack sudo[100916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:37 devstack sudo[100588]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c98eddb-e280-4fd3-8f21-09e0323f563f" returned: 0 in 0.780s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:37 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] <== create_volume: return (1845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:32:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.848s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:37 devstack cinder-volume[87233]: DEBUG cinder.volume.volume_utils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Attempting download of 30d815e6-4186-4838-b636-dc97ee613fdf ((None, [{'url': 'file:///opt/stack/data/glance/images/30d815e6-4186-4838-b636-dc97ee613fdf', 'metadata': {}}])) to volume 5c98eddb-e280-4fd3-8f21-09e0323f563f. {{(pid=87233) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 17:32:37 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2678303e-2205-4686-a73d-f71bd3099f02]: (4, 'raw') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30d815e6-4186-4838-b636-dc97ee613fdf_pke1wfch {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:37 devstack sudo[100927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30d815e6-4186-4838-b636-dc97ee613fdf_pke1wfch Jul 07 17:32:37 devstack sudo[100927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:37 devstack sudo[100916]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ffceab5f-b244-4de9-a861-16b32b60d8f2 tempest-VolumesTransfersV355Test-1186117276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a9b1b37a-e56f-418e-9e4a-859d33f7f1f1" returned: 0 in 0.814s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:37 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ffceab5f-b244-4de9-a861-16b32b60d8f2 tempest-VolumesTransfersV355Test-1186117276 None] Lock "cinder-quobyte-a9b1b37a-e56f-418e-9e4a-859d33f7f1f1" released by "delete_volume" :: held 1.744s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:37 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-ffceab5f-b244-4de9-a861-16b32b60d8f2 tempest-VolumesTransfersV355Test-1186117276 None] Created reservations ['39846127-3bc7-4104-ba55-c8ca1a4fabe2', '98331763-7553-4353-8330-df1d3aa1db94', '95ebca61-f977-4a3c-923e-70e2b9f859e4', '2dd22c78-4450-4855-9dc0-2c55d4440d0a'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:32:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ffceab5f-b244-4de9-a861-16b32b60d8f2 tempest-VolumesTransfersV355Test-1186117276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ffceab5f-b244-4de9-a861-16b32b60d8f2 tempest-VolumesTransfersV355Test-1186117276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:38 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ffceab5f-b244-4de9-a861-16b32b60d8f2 tempest-VolumesTransfersV355Test-1186117276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:32:38 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ffceab5f-b244-4de9-a861-16b32b60d8f2 tempest-VolumesTransfersV355Test-1186117276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:32:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ffceab5f-b244-4de9-a861-16b32b60d8f2 tempest-VolumesTransfersV355Test-1186117276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ffceab5f-b244-4de9-a861-16b32b60d8f2 tempest-VolumesTransfersV355Test-1186117276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:38 devstack sudo[100930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:32:38 devstack sudo[100930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:38 devstack sudo[100927]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30d815e6-4186-4838-b636-dc97ee613fdf_pke1wfch" returned: 0 in 0.816s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30d815e6-4186-4838-b636-dc97ee613fdf_pke1wfch {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:38 devstack sudo[100936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30d815e6-4186-4838-b636-dc97ee613fdf_pke1wfch Jul 07 17:32:38 devstack sudo[100936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:39 devstack sudo[100930]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ffceab5f-b244-4de9-a861-16b32b60d8f2 tempest-VolumesTransfersV355Test-1186117276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.981s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:39 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-ffceab5f-b244-4de9-a861-16b32b60d8f2 tempest-VolumesTransfersV355Test-1186117276 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:32:39 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-ffceab5f-b244-4de9-a861-16b32b60d8f2 tempest-VolumesTransfersV355Test-1186117276 None] Deleted volume successfully. Jul 07 17:32:39 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ffceab5f-b244-4de9-a861-16b32b60d8f2 tempest-VolumesTransfersV355Test-1186117276 None] Lock "cinder-a9b1b37a-e56f-418e-9e4a-859d33f7f1f1-delete_volume" released by "delete_volume" :: held 3.102s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:39 devstack sudo[100936]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30d815e6-4186-4838-b636-dc97ee613fdf_pke1wfch" returned: 1 in 1.137s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30d815e6-4186-4838-b636-dc97ee613fdf_pke1wfch' failed. Not Retrying. {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:32:39 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6deab8-8f74-488b-ab36-b5b9b0c193c9]: (4, 'raw') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_30d815e6-4186-4838-b636-dc97ee613fdf__i9mbjl5devstack@QuobyteHD {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:39 devstack sudo[100941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_30d815e6-4186-4838-b636-dc97ee613fdf__i9mbjl5devstack@QuobyteHD Jul 07 17:32:39 devstack sudo[100941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:40 devstack sudo[100941]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_30d815e6-4186-4838-b636-dc97ee613fdf__i9mbjl5devstack@QuobyteHD" returned: 0 in 1.070s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30d815e6-4186-4838-b636-dc97ee613fdf__i9mbjl5devstack@QuobyteHD {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:40 devstack sudo[100946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30d815e6-4186-4838-b636-dc97ee613fdf__i9mbjl5devstack@QuobyteHD Jul 07 17:32:40 devstack sudo[100946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:41 devstack sudo[100946]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30d815e6-4186-4838-b636-dc97ee613fdf__i9mbjl5devstack@QuobyteHD" returned: 1 in 0.965s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30d815e6-4186-4838-b636-dc97ee613fdf__i9mbjl5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:32:41 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] 30d815e6-4186-4838-b636-dc97ee613fdf was raw, converting to raw {{(pid=87233) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 17:32:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_30d815e6-4186-4838-b636-dc97ee613fdf__i9mbjl5devstack@QuobyteHD /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c98eddb-e280-4fd3-8f21-09e0323f563f {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:41 devstack sudo[100951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_30d815e6-4186-4838-b636-dc97ee613fdf__i9mbjl5devstack@QuobyteHD /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c98eddb-e280-4fd3-8f21-09e0323f563f Jul 07 17:32:41 devstack sudo[100951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:42 devstack sudo[100951]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_30d815e6-4186-4838-b636-dc97ee613fdf__i9mbjl5devstack@QuobyteHD /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c98eddb-e280-4fd3-8f21-09e0323f563f" returned: 0 in 0.966s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:42 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_30d815e6-4186-4838-b636-dc97ee613fdf__i9mbjl5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c98eddb-e280-4fd3-8f21-09e0323f563f {{(pid=87233) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:32:42 devstack cinder-volume[87233]: INFO cinder.image.image_utils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 17:32:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c98eddb-e280-4fd3-8f21-09e0323f563f 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:42 devstack sudo[100956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c98eddb-e280-4fd3-8f21-09e0323f563f 1G Jul 07 17:32:42 devstack sudo[100956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:43 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:32:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:32:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:32:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:43 devstack sudo[100960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:32:43 devstack sudo[100960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:43 devstack sudo[100956]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c98eddb-e280-4fd3-8f21-09e0323f563f 1G" returned: 0 in 1.128s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:43 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1bb605-1b27-472e-bc19-33ca58ea2951]: (4, 'raw') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c98eddb-e280-4fd3-8f21-09e0323f563f {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:43 devstack sudo[100963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c98eddb-e280-4fd3-8f21-09e0323f563f Jul 07 17:32:43 devstack sudo[100963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:44 devstack sudo[100960]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 1.353s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:44 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:32:44 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:32:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread count: 28 {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:32:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread info: [<_MainThread(MainThread, started 126077716062336)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:32:44 devstack sudo[100963]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c98eddb-e280-4fd3-8f21-09e0323f563f" returned: 0 in 1.281s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c98eddb-e280-4fd3-8f21-09e0323f563f {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:45 devstack sudo[100970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c98eddb-e280-4fd3-8f21-09e0323f563f Jul 07 17:32:45 devstack sudo[100970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:45 devstack sudo[100970]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c98eddb-e280-4fd3-8f21-09e0323f563f" returned: 1 in 0.912s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c98eddb-e280-4fd3-8f21-09e0323f563f' failed. Not Retrying. {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:32:45 devstack cinder-volume[87233]: DEBUG cinder.volume.volume_utils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Downloaded image 30d815e6-4186-4838-b636-dc97ee613fdf ((None, [{'url': 'file:///opt/stack/data/glance/images/30d815e6-4186-4838-b636-dc97ee613fdf', 'metadata': {}}])) to volume 5c98eddb-e280-4fd3-8f21-09e0323f563f successfully. {{(pid=87233) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 17:32:45 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Temporary image 30d815e6-4186-4838-b636-dc97ee613fdf for user 144b9d87a10b40328410e40a292b35b4 is deleted. {{(pid=87233) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 17:32:45 devstack cinder-volume[87233]: DEBUG cinder.volume.volume_utils [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Marking volume 5c98eddb-e280-4fd3-8f21-09e0323f563f as bootable. {{(pid=87233) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 17:32:45 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Copying metadata from image 30d815e6-4186-4838-b636-dc97ee613fdf to 5c98eddb-e280-4fd3-8f21-09e0323f563f. {{(pid=87233) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 17:32:45 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Creating volume glance metadata for volume 5c98eddb-e280-4fd3-8f21-09e0323f563f backed by image 30d815e6-4186-4838-b636-dc97ee613fdf with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '30d815e6-4186-4838-b636-dc97ee613fdf', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '5957d4aef1e7e5ed76226e56dfbb72dd', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87233) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 17:32:46 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58aaaefe-c022-41a8-811e-b489573075ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c98eddb-e280-4fd3-8f21-09e0323f563f', 'volume_size': 1, 'image_id': '30d815e6-4186-4838-b636-dc97ee613fdf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30d815e6-4186-4838-b636-dc97ee613fdf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5957d4aef1e7e5ed76226e56dfbb72dd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '54ed1fec21c7495bb6b0db50368e6fc0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'da93809ad32aa60b4b6524a9845a1f1e5c6a44cda849d327d3e14f274a7904f389077f58b00bfd3c68575f85f6bd863d32f4d615c2f737f2c6b979732bcb0968', 'id': '30d815e6-4186-4838-b636-dc97ee613fdf', 'created_at': datetime.datetime(2026, 7, 7, 15, 32, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 32, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30d815e6-4186-4838-b636-dc97ee613fdf/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:46 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18a7a917-2e0d-46b7-8f67-99f6dd165669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:46 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Volume volume-5c98eddb-e280-4fd3-8f21-09e0323f563f (5c98eddb-e280-4fd3-8f21-09e0323f563f): created successfully Jul 07 17:32:46 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18a7a917-2e0d-46b7-8f67-99f6dd165669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:46 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Flow 'volume_create_manager' (8b93a4a3-ae7d-4409-a8c5-b070f7cbfb3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:32:46 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-e574baea-f853-4306-a7a4-30edccc6d44e tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Created volume successfully. Jul 07 17:32:46 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c7ad34dd-303a-4198-95a1-0ea357225794 tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Acquiring lock "cinder-5c98eddb-e280-4fd3-8f21-09e0323f563f-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:46 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c7ad34dd-303a-4198-95a1-0ea357225794 tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Lock "cinder-5c98eddb-e280-4fd3-8f21-09e0323f563f-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:47 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c7ad34dd-303a-4198-95a1-0ea357225794 tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Acquiring lock "cinder-quobyte-5c98eddb-e280-4fd3-8f21-09e0323f563f" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:47 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c7ad34dd-303a-4198-95a1-0ea357225794 tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Lock "cinder-quobyte-5c98eddb-e280-4fd3-8f21-09e0323f563f" acquired by "delete_volume" :: waited 0.043s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:47 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58182e2-afa1-4c25-ad72-de63eada23e6]: (4, 'raw') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c7ad34dd-303a-4198-95a1-0ea357225794 tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c98eddb-e280-4fd3-8f21-09e0323f563f {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:47 devstack sudo[100975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c98eddb-e280-4fd3-8f21-09e0323f563f Jul 07 17:32:47 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:48 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c7ad34dd-303a-4198-95a1-0ea357225794 tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c98eddb-e280-4fd3-8f21-09e0323f563f" returned: 0 in 1.059s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c7ad34dd-303a-4198-95a1-0ea357225794 tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c98eddb-e280-4fd3-8f21-09e0323f563f {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:48 devstack sudo[100979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c98eddb-e280-4fd3-8f21-09e0323f563f Jul 07 17:32:48 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:49 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:SELECT=90,cinder:UPDATE=98,cinder:INSERT=27,cinder:DELETE=9 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:32:49 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:SELECT=81,cinder:INSERT=36,cinder:UPDATE=68,cinder:DELETE=5 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:32:49 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-a86c874c-511a-4d7f-93f9-0615cae9a86d tempest-VolumesTransfersV357Test-2137223419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:32:49 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a86c874c-511a-4d7f-93f9-0615cae9a86d tempest-VolumesTransfersV357Test-2137223419 None] Flow 'volume_create_manager' (cc73470e-fbba-4292-b2c4-2c2230241c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:32:49 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a86c874c-511a-4d7f-93f9-0615cae9a86d tempest-VolumesTransfersV357Test-2137223419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83a6ba12-6875-4318-b1d3-cf28fde09e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:49 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a86c874c-511a-4d7f-93f9-0615cae9a86d tempest-VolumesTransfersV357Test-2137223419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83a6ba12-6875-4318-b1d3-cf28fde09e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1627037399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e17eb7e2-282b-4232-ac0d-8a7b364fa206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c994d2525cf4d5fb6c4b6be0bee2bf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:32:49Z,use_quota=True,user_id='1428ba5efd594c35a9f9a2c23e290796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:49 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a86c874c-511a-4d7f-93f9-0615cae9a86d tempest-VolumesTransfersV357Test-2137223419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1719ef0b-ddaa-4dc5-87c3-d005bb278985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:49 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a86c874c-511a-4d7f-93f9-0615cae9a86d tempest-VolumesTransfersV357Test-2137223419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1719ef0b-ddaa-4dc5-87c3-d005bb278985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:49 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a86c874c-511a-4d7f-93f9-0615cae9a86d tempest-VolumesTransfersV357Test-2137223419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c00c3ae-297e-4821-8482-ff6c280830f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:49 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a86c874c-511a-4d7f-93f9-0615cae9a86d tempest-VolumesTransfersV357Test-2137223419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c00c3ae-297e-4821-8482-ff6c280830f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e17eb7e2-282b-4232-ac0d-8a7b364fa206', 'volume_name': 'volume-e17eb7e2-282b-4232-ac0d-8a7b364fa206', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:49 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a86c874c-511a-4d7f-93f9-0615cae9a86d tempest-VolumesTransfersV357Test-2137223419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e62e2c9-7d76-4cd8-94a5-4582ce1d96a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:49 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a86c874c-511a-4d7f-93f9-0615cae9a86d tempest-VolumesTransfersV357Test-2137223419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e62e2c9-7d76-4cd8-94a5-4582ce1d96a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:49 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a86c874c-511a-4d7f-93f9-0615cae9a86d tempest-VolumesTransfersV357Test-2137223419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50354b8f-84c8-43f3-81fc-13feb0b669cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:49 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-a86c874c-511a-4d7f-93f9-0615cae9a86d tempest-VolumesTransfersV357Test-2137223419 None] Volume e17eb7e2-282b-4232-ac0d-8a7b364fa206: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e17eb7e2-282b-4232-ac0d-8a7b364fa206', 'volume_size': 1} Jul 07 17:32:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a86c874c-511a-4d7f-93f9-0615cae9a86d tempest-VolumesTransfersV357Test-2137223419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a86c874c-511a-4d7f-93f9-0615cae9a86d tempest-VolumesTransfersV357Test-2137223419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:49 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-a86c874c-511a-4d7f-93f9-0615cae9a86d tempest-VolumesTransfersV357Test-2137223419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1627037399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e17eb7e2-282b-4232-ac0d-8a7b364fa206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c994d2525cf4d5fb6c4b6be0bee2bf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:32:49Z,use_quota=True,user_id='1428ba5efd594c35a9f9a2c23e290796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:32:49 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-a86c874c-511a-4d7f-93f9-0615cae9a86d tempest-VolumesTransfersV357Test-2137223419 None] Creating volume e17eb7e2-282b-4232-ac0d-8a7b364fa206 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:32:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a86c874c-511a-4d7f-93f9-0615cae9a86d tempest-VolumesTransfersV357Test-2137223419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a86c874c-511a-4d7f-93f9-0615cae9a86d tempest-VolumesTransfersV357Test-2137223419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:49 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-a86c874c-511a-4d7f-93f9-0615cae9a86d tempest-VolumesTransfersV357Test-2137223419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:32:49 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-a86c874c-511a-4d7f-93f9-0615cae9a86d tempest-VolumesTransfersV357Test-2137223419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:32:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a86c874c-511a-4d7f-93f9-0615cae9a86d tempest-VolumesTransfersV357Test-2137223419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:49 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-a86c874c-511a-4d7f-93f9-0615cae9a86d tempest-VolumesTransfersV357Test-2137223419 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:32:49 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-a86c874c-511a-4d7f-93f9-0615cae9a86d tempest-VolumesTransfersV357Test-2137223419 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:32:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a86c874c-511a-4d7f-93f9-0615cae9a86d tempest-VolumesTransfersV357Test-2137223419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e17eb7e2-282b-4232-ac0d-8a7b364fa206 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:49 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c7ad34dd-303a-4198-95a1-0ea357225794 tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c98eddb-e280-4fd3-8f21-09e0323f563f" returned: 1 in 1.045s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c7ad34dd-303a-4198-95a1-0ea357225794 tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c98eddb-e280-4fd3-8f21-09e0323f563f' failed. Not Retrying. {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:32:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c7ad34dd-303a-4198-95a1-0ea357225794 tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c98eddb-e280-4fd3-8f21-09e0323f563f {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:49 devstack sudo[100984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e17eb7e2-282b-4232-ac0d-8a7b364fa206 1073741824 Jul 07 17:32:49 devstack sudo[100984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:49 devstack sudo[100985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c98eddb-e280-4fd3-8f21-09e0323f563f Jul 07 17:32:49 devstack sudo[100985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:50 devstack sudo[100985]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c7ad34dd-303a-4198-95a1-0ea357225794 tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c98eddb-e280-4fd3-8f21-09e0323f563f" returned: 0 in 0.792s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:50 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c7ad34dd-303a-4198-95a1-0ea357225794 tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Lock "cinder-quobyte-5c98eddb-e280-4fd3-8f21-09e0323f563f" released by "delete_volume" :: held 2.999s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:50 devstack cinder-volume[87233]: WARNING cinder.quota [None req-c7ad34dd-303a-4198-95a1-0ea357225794 tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:32:50 devstack cinder-volume[87233]: WARNING cinder.quota [None req-c7ad34dd-303a-4198-95a1-0ea357225794 tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:32:50 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-c7ad34dd-303a-4198-95a1-0ea357225794 tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Created reservations ['addc3be2-b5a4-4f99-ba80-7e1bb349af69', '8566e574-7ff0-44a9-bfec-68b937c3cd4b', 'cefcde64-3239-4ddd-b78a-ade19823dc7a', '9ba5788a-1e13-4c50-b6e6-2cada0b0dbfe'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:32:50 devstack sudo[100984]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a86c874c-511a-4d7f-93f9-0615cae9a86d tempest-VolumesTransfersV357Test-2137223419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e17eb7e2-282b-4232-ac0d-8a7b364fa206 1073741824" returned: 0 in 0.994s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c7ad34dd-303a-4198-95a1-0ea357225794 tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c7ad34dd-303a-4198-95a1-0ea357225794 tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:50 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c7ad34dd-303a-4198-95a1-0ea357225794 tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:32:50 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c7ad34dd-303a-4198-95a1-0ea357225794 tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:32:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c7ad34dd-303a-4198-95a1-0ea357225794 tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c7ad34dd-303a-4198-95a1-0ea357225794 tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a86c874c-511a-4d7f-93f9-0615cae9a86d tempest-VolumesTransfersV357Test-2137223419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e17eb7e2-282b-4232-ac0d-8a7b364fa206 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:50 devstack sudo[100993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:32:50 devstack sudo[100993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:50 devstack sudo[100996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e17eb7e2-282b-4232-ac0d-8a7b364fa206 Jul 07 17:32:50 devstack sudo[100996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:51 devstack sudo[100996]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a86c874c-511a-4d7f-93f9-0615cae9a86d tempest-VolumesTransfersV357Test-2137223419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e17eb7e2-282b-4232-ac0d-8a7b364fa206" returned: 0 in 0.739s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:51 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-a86c874c-511a-4d7f-93f9-0615cae9a86d tempest-VolumesTransfersV357Test-2137223419 None] <== create_volume: return (1833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:32:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a86c874c-511a-4d7f-93f9-0615cae9a86d tempest-VolumesTransfersV357Test-2137223419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.841s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a86c874c-511a-4d7f-93f9-0615cae9a86d tempest-VolumesTransfersV357Test-2137223419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50354b8f-84c8-43f3-81fc-13feb0b669cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e17eb7e2-282b-4232-ac0d-8a7b364fa206', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a86c874c-511a-4d7f-93f9-0615cae9a86d tempest-VolumesTransfersV357Test-2137223419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98ec741f-8f3f-4b99-a5ca-102b00a2e52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:51 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-a86c874c-511a-4d7f-93f9-0615cae9a86d tempest-VolumesTransfersV357Test-2137223419 None] Volume volume-e17eb7e2-282b-4232-ac0d-8a7b364fa206 (e17eb7e2-282b-4232-ac0d-8a7b364fa206): created successfully Jul 07 17:32:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a86c874c-511a-4d7f-93f9-0615cae9a86d tempest-VolumesTransfersV357Test-2137223419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98ec741f-8f3f-4b99-a5ca-102b00a2e52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a86c874c-511a-4d7f-93f9-0615cae9a86d tempest-VolumesTransfersV357Test-2137223419 None] Flow 'volume_create_manager' (cc73470e-fbba-4292-b2c4-2c2230241c64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:32:51 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-a86c874c-511a-4d7f-93f9-0615cae9a86d tempest-VolumesTransfersV357Test-2137223419 None] Created volume successfully. Jul 07 17:32:51 devstack sudo[100993]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c7ad34dd-303a-4198-95a1-0ea357225794 tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 1.198s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:51 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-c7ad34dd-303a-4198-95a1-0ea357225794 tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:32:51 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-c7ad34dd-303a-4198-95a1-0ea357225794 tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Deleted volume successfully. Jul 07 17:32:51 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c7ad34dd-303a-4198-95a1-0ea357225794 tempest-VolumeAndVolumeTypeFromImageTest-1738272068 None] Lock "cinder-5c98eddb-e280-4fd3-8f21-09e0323f563f-delete_volume" released by "delete_volume" :: held 4.588s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:53 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-c53da81d-f2f6-47f2-86d8-8f09eef466f8 tempest-VolumesTransfersV357Test-1588336027 None] Transfer volume completed successfully. Jul 07 17:32:54 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3859e5e4-45b9-4bcd-be96-746d913c3d5c tempest-VolumesTransfersV357Test-1044392109 None] Acquiring lock "cinder-e17eb7e2-282b-4232-ac0d-8a7b364fa206-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:54 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3859e5e4-45b9-4bcd-be96-746d913c3d5c tempest-VolumesTransfersV357Test-1044392109 None] Lock "cinder-e17eb7e2-282b-4232-ac0d-8a7b364fa206-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:54 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3859e5e4-45b9-4bcd-be96-746d913c3d5c tempest-VolumesTransfersV357Test-1044392109 None] Acquiring lock "cinder-quobyte-e17eb7e2-282b-4232-ac0d-8a7b364fa206" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:54 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3859e5e4-45b9-4bcd-be96-746d913c3d5c tempest-VolumesTransfersV357Test-1044392109 None] Lock "cinder-quobyte-e17eb7e2-282b-4232-ac0d-8a7b364fa206" acquired by "delete_volume" :: waited 0.028s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:54 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b727ddbc-5528-44d4-bfff-86dac96d76b1]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3859e5e4-45b9-4bcd-be96-746d913c3d5c tempest-VolumesTransfersV357Test-1044392109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e17eb7e2-282b-4232-ac0d-8a7b364fa206 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:54 devstack sudo[101103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e17eb7e2-282b-4232-ac0d-8a7b364fa206 Jul 07 17:32:54 devstack sudo[101103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:55 devstack sudo[101103]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3859e5e4-45b9-4bcd-be96-746d913c3d5c tempest-VolumesTransfersV357Test-1044392109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e17eb7e2-282b-4232-ac0d-8a7b364fa206" returned: 0 in 0.999s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3859e5e4-45b9-4bcd-be96-746d913c3d5c tempest-VolumesTransfersV357Test-1044392109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e17eb7e2-282b-4232-ac0d-8a7b364fa206 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:55 devstack sudo[101109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e17eb7e2-282b-4232-ac0d-8a7b364fa206 Jul 07 17:32:55 devstack sudo[101109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:56 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-f04537ff-78dc-4654-8ff9-fdbe61e7d8c3 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:32:56 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f04537ff-78dc-4654-8ff9-fdbe61e7d8c3 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Flow 'volume_create_manager' (f97d1e60-b437-48a9-867e-a90dc4769250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:32:56 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f04537ff-78dc-4654-8ff9-fdbe61e7d8c3 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4da284da-f481-4dde-afc4-4dac63af9683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:56 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f04537ff-78dc-4654-8ff9-fdbe61e7d8c3 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4da284da-f481-4dde-afc4-4dac63af9683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1909287633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eacad06f-7120-4759-8c99-dbf38b540235,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0264c576dfde4bd0839958f86a973e2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:32:56Z,use_quota=True,user_id='1aac94acc53d45a4a2960066bfe834d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:56 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f04537ff-78dc-4654-8ff9-fdbe61e7d8c3 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c01ceeb9-c7b4-443d-9140-eb46ceb8a22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:56 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f04537ff-78dc-4654-8ff9-fdbe61e7d8c3 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c01ceeb9-c7b4-443d-9140-eb46ceb8a22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:56 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f04537ff-78dc-4654-8ff9-fdbe61e7d8c3 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2426171-bd3c-4c0b-a080-c8741ff28fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:56 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f04537ff-78dc-4654-8ff9-fdbe61e7d8c3 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2426171-bd3c-4c0b-a080-c8741ff28fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eacad06f-7120-4759-8c99-dbf38b540235', 'volume_name': 'volume-eacad06f-7120-4759-8c99-dbf38b540235', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:56 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f04537ff-78dc-4654-8ff9-fdbe61e7d8c3 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acdc3152-059c-41ca-8b21-f916c67d94fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:56 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f04537ff-78dc-4654-8ff9-fdbe61e7d8c3 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acdc3152-059c-41ca-8b21-f916c67d94fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:56 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f04537ff-78dc-4654-8ff9-fdbe61e7d8c3 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3da5b39-db30-4c2b-aedf-116f87785498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:56 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-f04537ff-78dc-4654-8ff9-fdbe61e7d8c3 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Volume eacad06f-7120-4759-8c99-dbf38b540235: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eacad06f-7120-4759-8c99-dbf38b540235', 'volume_size': 1} Jul 07 17:32:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f04537ff-78dc-4654-8ff9-fdbe61e7d8c3 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f04537ff-78dc-4654-8ff9-fdbe61e7d8c3 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:56 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-f04537ff-78dc-4654-8ff9-fdbe61e7d8c3 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1909287633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eacad06f-7120-4759-8c99-dbf38b540235,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0264c576dfde4bd0839958f86a973e2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:32:56Z,use_quota=True,user_id='1aac94acc53d45a4a2960066bfe834d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:32:56 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-f04537ff-78dc-4654-8ff9-fdbe61e7d8c3 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Creating volume eacad06f-7120-4759-8c99-dbf38b540235 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:32:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f04537ff-78dc-4654-8ff9-fdbe61e7d8c3 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f04537ff-78dc-4654-8ff9-fdbe61e7d8c3 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:56 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-f04537ff-78dc-4654-8ff9-fdbe61e7d8c3 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:32:56 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-f04537ff-78dc-4654-8ff9-fdbe61e7d8c3 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:32:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f04537ff-78dc-4654-8ff9-fdbe61e7d8c3 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:56 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-f04537ff-78dc-4654-8ff9-fdbe61e7d8c3 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:32:56 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-f04537ff-78dc-4654-8ff9-fdbe61e7d8c3 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:32:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f04537ff-78dc-4654-8ff9-fdbe61e7d8c3 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-eacad06f-7120-4759-8c99-dbf38b540235 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:56 devstack sudo[101111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-eacad06f-7120-4759-8c99-dbf38b540235 1073741824 Jul 07 17:32:56 devstack sudo[101111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:56 devstack sudo[101109]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3859e5e4-45b9-4bcd-be96-746d913c3d5c tempest-VolumesTransfersV357Test-1044392109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e17eb7e2-282b-4232-ac0d-8a7b364fa206" returned: 0 in 0.723s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:56 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3859e5e4-45b9-4bcd-be96-746d913c3d5c tempest-VolumesTransfersV357Test-1044392109 None] Lock "cinder-quobyte-e17eb7e2-282b-4232-ac0d-8a7b364fa206" released by "delete_volume" :: held 1.777s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:56 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-3859e5e4-45b9-4bcd-be96-746d913c3d5c tempest-VolumesTransfersV357Test-1044392109 None] Created reservations ['1bb3d254-4c2d-4e29-922a-40ba7d07ddab', '90b540c0-987a-4cfe-b3ee-7d5e6676a525', '3df7ba16-a364-43e2-9ff7-51e06f0dcfe9', 'f56653af-1b27-4658-a737-76501feb9b81'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:32:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-3859e5e4-45b9-4bcd-be96-746d913c3d5c tempest-VolumesTransfersV357Test-1044392109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-3859e5e4-45b9-4bcd-be96-746d913c3d5c tempest-VolumesTransfersV357Test-1044392109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:56 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-3859e5e4-45b9-4bcd-be96-746d913c3d5c tempest-VolumesTransfersV357Test-1044392109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:32:56 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-3859e5e4-45b9-4bcd-be96-746d913c3d5c tempest-VolumesTransfersV357Test-1044392109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:32:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-3859e5e4-45b9-4bcd-be96-746d913c3d5c tempest-VolumesTransfersV357Test-1044392109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3859e5e4-45b9-4bcd-be96-746d913c3d5c tempest-VolumesTransfersV357Test-1044392109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:56 devstack sudo[101114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:32:56 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:57 devstack sudo[101111]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f04537ff-78dc-4654-8ff9-fdbe61e7d8c3 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-eacad06f-7120-4759-8c99-dbf38b540235 1073741824" returned: 0 in 0.943s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f04537ff-78dc-4654-8ff9-fdbe61e7d8c3 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-eacad06f-7120-4759-8c99-dbf38b540235 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:57 devstack sudo[101120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-eacad06f-7120-4759-8c99-dbf38b540235 Jul 07 17:32:57 devstack sudo[101120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:57 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3859e5e4-45b9-4bcd-be96-746d913c3d5c tempest-VolumesTransfersV357Test-1044392109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.717s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:57 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-3859e5e4-45b9-4bcd-be96-746d913c3d5c tempest-VolumesTransfersV357Test-1044392109 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:32:57 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-3859e5e4-45b9-4bcd-be96-746d913c3d5c tempest-VolumesTransfersV357Test-1044392109 None] Deleted volume successfully. Jul 07 17:32:57 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3859e5e4-45b9-4bcd-be96-746d913c3d5c tempest-VolumesTransfersV357Test-1044392109 None] Lock "cinder-e17eb7e2-282b-4232-ac0d-8a7b364fa206-delete_volume" released by "delete_volume" :: held 2.731s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:57 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-538f041a-be0e-4ffc-a865-afcf4f7d6031 tempest-VolumesTransfersV357Test-2137223419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:32:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-538f041a-be0e-4ffc-a865-afcf4f7d6031 tempest-VolumesTransfersV357Test-2137223419 None] Flow 'volume_create_manager' (68de787e-54fc-4403-a84a-d544b5bb1ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:32:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-538f041a-be0e-4ffc-a865-afcf4f7d6031 tempest-VolumesTransfersV357Test-2137223419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24483e46-d193-46f6-917d-b5569b4c73c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-538f041a-be0e-4ffc-a865-afcf4f7d6031 tempest-VolumesTransfersV357Test-2137223419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24483e46-d193-46f6-917d-b5569b4c73c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1304589241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88a8b73a-e97a-4f18-b4e0-9bb524d2164b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c994d2525cf4d5fb6c4b6be0bee2bf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:32:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:32:58Z,use_quota=True,user_id='1428ba5efd594c35a9f9a2c23e290796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-538f041a-be0e-4ffc-a865-afcf4f7d6031 tempest-VolumesTransfersV357Test-2137223419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efea9445-0d4d-45df-b487-181ee6c83473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-538f041a-be0e-4ffc-a865-afcf4f7d6031 tempest-VolumesTransfersV357Test-2137223419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efea9445-0d4d-45df-b487-181ee6c83473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-538f041a-be0e-4ffc-a865-afcf4f7d6031 tempest-VolumesTransfersV357Test-2137223419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a6fe99e-03b5-41cd-9816-da18e770294d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-538f041a-be0e-4ffc-a865-afcf4f7d6031 tempest-VolumesTransfersV357Test-2137223419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a6fe99e-03b5-41cd-9816-da18e770294d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88a8b73a-e97a-4f18-b4e0-9bb524d2164b', 'volume_name': 'volume-88a8b73a-e97a-4f18-b4e0-9bb524d2164b', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-538f041a-be0e-4ffc-a865-afcf4f7d6031 tempest-VolumesTransfersV357Test-2137223419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0037649e-08bd-46b9-803d-b9e4b99f5edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-538f041a-be0e-4ffc-a865-afcf4f7d6031 tempest-VolumesTransfersV357Test-2137223419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0037649e-08bd-46b9-803d-b9e4b99f5edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-538f041a-be0e-4ffc-a865-afcf4f7d6031 tempest-VolumesTransfersV357Test-2137223419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d543f978-ee22-49fc-8d08-c63a25f84943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:57 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-538f041a-be0e-4ffc-a865-afcf4f7d6031 tempest-VolumesTransfersV357Test-2137223419 None] Volume 88a8b73a-e97a-4f18-b4e0-9bb524d2164b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88a8b73a-e97a-4f18-b4e0-9bb524d2164b', 'volume_size': 1} Jul 07 17:32:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-538f041a-be0e-4ffc-a865-afcf4f7d6031 tempest-VolumesTransfersV357Test-2137223419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:57 devstack sudo[101120]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f04537ff-78dc-4654-8ff9-fdbe61e7d8c3 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-eacad06f-7120-4759-8c99-dbf38b540235" returned: 0 in 0.683s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:57 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-f04537ff-78dc-4654-8ff9-fdbe61e7d8c3 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:32:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f04537ff-78dc-4654-8ff9-fdbe61e7d8c3 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.682s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-538f041a-be0e-4ffc-a865-afcf4f7d6031 tempest-VolumesTransfersV357Test-2137223419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.251s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:57 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-538f041a-be0e-4ffc-a865-afcf4f7d6031 tempest-VolumesTransfersV357Test-2137223419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1304589241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88a8b73a-e97a-4f18-b4e0-9bb524d2164b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c994d2525cf4d5fb6c4b6be0bee2bf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:32:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:32:58Z,use_quota=True,user_id='1428ba5efd594c35a9f9a2c23e290796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:32:57 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-538f041a-be0e-4ffc-a865-afcf4f7d6031 tempest-VolumesTransfersV357Test-2137223419 None] Creating volume 88a8b73a-e97a-4f18-b4e0-9bb524d2164b {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:32:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-538f041a-be0e-4ffc-a865-afcf4f7d6031 tempest-VolumesTransfersV357Test-2137223419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-538f041a-be0e-4ffc-a865-afcf4f7d6031 tempest-VolumesTransfersV357Test-2137223419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:57 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-538f041a-be0e-4ffc-a865-afcf4f7d6031 tempest-VolumesTransfersV357Test-2137223419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:32:57 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-538f041a-be0e-4ffc-a865-afcf4f7d6031 tempest-VolumesTransfersV357Test-2137223419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:32:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-538f041a-be0e-4ffc-a865-afcf4f7d6031 tempest-VolumesTransfersV357Test-2137223419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:57 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-538f041a-be0e-4ffc-a865-afcf4f7d6031 tempest-VolumesTransfersV357Test-2137223419 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:32:57 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-538f041a-be0e-4ffc-a865-afcf4f7d6031 tempest-VolumesTransfersV357Test-2137223419 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:32:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-538f041a-be0e-4ffc-a865-afcf4f7d6031 tempest-VolumesTransfersV357Test-2137223419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-88a8b73a-e97a-4f18-b4e0-9bb524d2164b 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:57 devstack sudo[101124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-88a8b73a-e97a-4f18-b4e0-9bb524d2164b 1073741824 Jul 07 17:32:57 devstack sudo[101124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f04537ff-78dc-4654-8ff9-fdbe61e7d8c3 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3da5b39-db30-4c2b-aedf-116f87785498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eacad06f-7120-4759-8c99-dbf38b540235', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f04537ff-78dc-4654-8ff9-fdbe61e7d8c3 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10e181ff-5242-47bc-8735-4d8e017053f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:58 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-f04537ff-78dc-4654-8ff9-fdbe61e7d8c3 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Volume volume-eacad06f-7120-4759-8c99-dbf38b540235 (eacad06f-7120-4759-8c99-dbf38b540235): created successfully Jul 07 17:32:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f04537ff-78dc-4654-8ff9-fdbe61e7d8c3 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10e181ff-5242-47bc-8735-4d8e017053f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f04537ff-78dc-4654-8ff9-fdbe61e7d8c3 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Flow 'volume_create_manager' (f97d1e60-b437-48a9-867e-a90dc4769250) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:32:58 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-f04537ff-78dc-4654-8ff9-fdbe61e7d8c3 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Created volume successfully. Jul 07 17:32:58 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-51da99a8-47ae-4a64-b800-9fdaf8b8b937 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:32:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-51da99a8-47ae-4a64-b800-9fdaf8b8b937 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Flow 'volume_create_manager' (f87e26ed-aa12-4c30-a569-a0f161ddcd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:32:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-51da99a8-47ae-4a64-b800-9fdaf8b8b937 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ca320c5-c98a-49c6-a8fa-93e7e56683d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-51da99a8-47ae-4a64-b800-9fdaf8b8b937 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ca320c5-c98a-49c6-a8fa-93e7e56683d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:32:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2009028146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8975f881-e8c4-442e-8017-d35cae32959f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0264c576dfde4bd0839958f86a973e2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:32:59Z,use_quota=True,user_id='1aac94acc53d45a4a2960066bfe834d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-51da99a8-47ae-4a64-b800-9fdaf8b8b937 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a64e365-5f88-4f3c-9361-6b4fae2b2031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-51da99a8-47ae-4a64-b800-9fdaf8b8b937 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a64e365-5f88-4f3c-9361-6b4fae2b2031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-51da99a8-47ae-4a64-b800-9fdaf8b8b937 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f553fb6-0c72-43da-b44a-4c51bb885a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-51da99a8-47ae-4a64-b800-9fdaf8b8b937 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f553fb6-0c72-43da-b44a-4c51bb885a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8975f881-e8c4-442e-8017-d35cae32959f', 'volume_name': 'volume-8975f881-e8c4-442e-8017-d35cae32959f', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-51da99a8-47ae-4a64-b800-9fdaf8b8b937 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c123ad39-e3f1-4f95-9918-46cf1b057e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-51da99a8-47ae-4a64-b800-9fdaf8b8b937 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c123ad39-e3f1-4f95-9918-46cf1b057e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-51da99a8-47ae-4a64-b800-9fdaf8b8b937 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88a4fd5e-8cbc-4f2e-8f0c-d4214ea027b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:58 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-51da99a8-47ae-4a64-b800-9fdaf8b8b937 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Volume 8975f881-e8c4-442e-8017-d35cae32959f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8975f881-e8c4-442e-8017-d35cae32959f', 'volume_size': 1} Jul 07 17:32:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-51da99a8-47ae-4a64-b800-9fdaf8b8b937 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:58 devstack sudo[101124]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-538f041a-be0e-4ffc-a865-afcf4f7d6031 tempest-VolumesTransfersV357Test-2137223419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-88a8b73a-e97a-4f18-b4e0-9bb524d2164b 1073741824" returned: 0 in 0.897s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-538f041a-be0e-4ffc-a865-afcf4f7d6031 tempest-VolumesTransfersV357Test-2137223419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-88a8b73a-e97a-4f18-b4e0-9bb524d2164b {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:58 devstack sudo[101130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-88a8b73a-e97a-4f18-b4e0-9bb524d2164b Jul 07 17:32:58 devstack sudo[101130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-18fdd43e-53a8-45ad-989b-9011804bfddf tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-18fdd43e-53a8-45ad-989b-9011804bfddf tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Flow 'volume_create_manager' (bd42f75e-9704-4e44-bb7a-fc3d68cfe8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-18fdd43e-53a8-45ad-989b-9011804bfddf tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a4d2bbf-6e0d-4936-97f8-5ecb4c38a078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-18fdd43e-53a8-45ad-989b-9011804bfddf tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a4d2bbf-6e0d-4936-97f8-5ecb4c38a078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1573578256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd014857-4ba4-4b82-8780-e41680aa6046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0264c576dfde4bd0839958f86a973e2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:32:59Z,use_quota=True,user_id='1aac94acc53d45a4a2960066bfe834d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-18fdd43e-53a8-45ad-989b-9011804bfddf tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2c64b41-8cdc-4783-8c3a-d3b4cbdeb007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-18fdd43e-53a8-45ad-989b-9011804bfddf tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2c64b41-8cdc-4783-8c3a-d3b4cbdeb007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-18fdd43e-53a8-45ad-989b-9011804bfddf tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdeceaf4-ffb3-4bc5-8763-26099ead45af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-18fdd43e-53a8-45ad-989b-9011804bfddf tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdeceaf4-ffb3-4bc5-8763-26099ead45af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd014857-4ba4-4b82-8780-e41680aa6046', 'volume_name': 'volume-fd014857-4ba4-4b82-8780-e41680aa6046', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-18fdd43e-53a8-45ad-989b-9011804bfddf tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (817ae471-7170-47ac-8714-267be96f1aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-18fdd43e-53a8-45ad-989b-9011804bfddf tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (817ae471-7170-47ac-8714-267be96f1aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-18fdd43e-53a8-45ad-989b-9011804bfddf tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23fc420f-08cf-4f37-981b-fa431eb4f079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:59 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-18fdd43e-53a8-45ad-989b-9011804bfddf tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Volume fd014857-4ba4-4b82-8780-e41680aa6046: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd014857-4ba4-4b82-8780-e41680aa6046', 'volume_size': 1} Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-18fdd43e-53a8-45ad-989b-9011804bfddf tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-f89d9a40-0d4b-4da2-b3ca-8e0706e8e71c tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f89d9a40-0d4b-4da2-b3ca-8e0706e8e71c tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Flow 'volume_create_manager' (a5be2887-0ea1-46f2-9c7c-912c6d2de027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f89d9a40-0d4b-4da2-b3ca-8e0706e8e71c tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba39bd8c-0235-4b0d-8dba-e33fa0017c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f89d9a40-0d4b-4da2-b3ca-8e0706e8e71c tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba39bd8c-0235-4b0d-8dba-e33fa0017c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1218872689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a650ab2-f606-47bf-9ce5-f4b8537f4145,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0264c576dfde4bd0839958f86a973e2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:32:59Z,use_quota=True,user_id='1aac94acc53d45a4a2960066bfe834d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f89d9a40-0d4b-4da2-b3ca-8e0706e8e71c tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abae8b2a-6ff7-4886-a84b-ff18ccd9a903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f89d9a40-0d4b-4da2-b3ca-8e0706e8e71c tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abae8b2a-6ff7-4886-a84b-ff18ccd9a903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f89d9a40-0d4b-4da2-b3ca-8e0706e8e71c tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f833af7-81a1-417c-a53c-c1c51218d885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f89d9a40-0d4b-4da2-b3ca-8e0706e8e71c tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f833af7-81a1-417c-a53c-c1c51218d885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a650ab2-f606-47bf-9ce5-f4b8537f4145', 'volume_name': 'volume-9a650ab2-f606-47bf-9ce5-f4b8537f4145', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f89d9a40-0d4b-4da2-b3ca-8e0706e8e71c tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d40f213-44c8-45d9-9da9-da2253ba793f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f89d9a40-0d4b-4da2-b3ca-8e0706e8e71c tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d40f213-44c8-45d9-9da9-da2253ba793f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f89d9a40-0d4b-4da2-b3ca-8e0706e8e71c tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46083019-a25d-4fa9-b808-2d7462b112e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:59 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-f89d9a40-0d4b-4da2-b3ca-8e0706e8e71c tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Volume 9a650ab2-f606-47bf-9ce5-f4b8537f4145: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a650ab2-f606-47bf-9ce5-f4b8537f4145', 'volume_size': 1} Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f89d9a40-0d4b-4da2-b3ca-8e0706e8e71c tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:59 devstack sudo[101130]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-538f041a-be0e-4ffc-a865-afcf4f7d6031 tempest-VolumesTransfersV357Test-2137223419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-88a8b73a-e97a-4f18-b4e0-9bb524d2164b" returned: 0 in 0.661s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-538f041a-be0e-4ffc-a865-afcf4f7d6031 tempest-VolumesTransfersV357Test-2137223419 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-538f041a-be0e-4ffc-a865-afcf4f7d6031 tempest-VolumesTransfersV357Test-2137223419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-51da99a8-47ae-4a64-b800-9fdaf8b8b937 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.792s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-51da99a8-47ae-4a64-b800-9fdaf8b8b937 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:32:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2009028146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8975f881-e8c4-442e-8017-d35cae32959f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0264c576dfde4bd0839958f86a973e2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:32:59Z,use_quota=True,user_id='1aac94acc53d45a4a2960066bfe834d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-51da99a8-47ae-4a64-b800-9fdaf8b8b937 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Creating volume 8975f881-e8c4-442e-8017-d35cae32959f {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-51da99a8-47ae-4a64-b800-9fdaf8b8b937 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-51da99a8-47ae-4a64-b800-9fdaf8b8b937 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-51da99a8-47ae-4a64-b800-9fdaf8b8b937 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-51da99a8-47ae-4a64-b800-9fdaf8b8b937 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-51da99a8-47ae-4a64-b800-9fdaf8b8b937 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-51da99a8-47ae-4a64-b800-9fdaf8b8b937 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:32:59 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-51da99a8-47ae-4a64-b800-9fdaf8b8b937 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-51da99a8-47ae-4a64-b800-9fdaf8b8b937 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8975f881-e8c4-442e-8017-d35cae32959f 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-538f041a-be0e-4ffc-a865-afcf4f7d6031 tempest-VolumesTransfersV357Test-2137223419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d543f978-ee22-49fc-8d08-c63a25f84943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88a8b73a-e97a-4f18-b4e0-9bb524d2164b', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-538f041a-be0e-4ffc-a865-afcf4f7d6031 tempest-VolumesTransfersV357Test-2137223419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64903e81-84f2-4092-8ec7-093d93827b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:59 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-538f041a-be0e-4ffc-a865-afcf4f7d6031 tempest-VolumesTransfersV357Test-2137223419 None] Volume volume-88a8b73a-e97a-4f18-b4e0-9bb524d2164b (88a8b73a-e97a-4f18-b4e0-9bb524d2164b): created successfully Jul 07 17:32:59 devstack sudo[101133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8975f881-e8c4-442e-8017-d35cae32959f 1073741824 Jul 07 17:32:59 devstack sudo[101133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-538f041a-be0e-4ffc-a865-afcf4f7d6031 tempest-VolumesTransfersV357Test-2137223419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64903e81-84f2-4092-8ec7-093d93827b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-538f041a-be0e-4ffc-a865-afcf4f7d6031 tempest-VolumesTransfersV357Test-2137223419 None] Flow 'volume_create_manager' (68de787e-54fc-4403-a84a-d544b5bb1ac2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:32:59 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-538f041a-be0e-4ffc-a865-afcf4f7d6031 tempest-VolumesTransfersV357Test-2137223419 None] Created volume successfully. Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-b56aa245-59ce-41ac-98c6-8fdad2de00a5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b56aa245-59ce-41ac-98c6-8fdad2de00a5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Flow 'volume_create_manager' (d4d7b110-de2a-4900-9ac9-91cac4b4159a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b56aa245-59ce-41ac-98c6-8fdad2de00a5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55483aaa-b9db-46e5-9084-2149ae50c414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b56aa245-59ce-41ac-98c6-8fdad2de00a5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55483aaa-b9db-46e5-9084-2149ae50c414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-950827178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c32a4496-6a05-457e-a9c2-9da337457898,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0264c576dfde4bd0839958f86a973e2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:00Z,use_quota=True,user_id='1aac94acc53d45a4a2960066bfe834d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b56aa245-59ce-41ac-98c6-8fdad2de00a5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c2b41dc-61b0-4345-a44f-dc94a797413e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b56aa245-59ce-41ac-98c6-8fdad2de00a5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c2b41dc-61b0-4345-a44f-dc94a797413e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b56aa245-59ce-41ac-98c6-8fdad2de00a5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6958fad7-afaa-4dd7-9580-8a0e974e9c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b56aa245-59ce-41ac-98c6-8fdad2de00a5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6958fad7-afaa-4dd7-9580-8a0e974e9c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c32a4496-6a05-457e-a9c2-9da337457898', 'volume_name': 'volume-c32a4496-6a05-457e-a9c2-9da337457898', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b56aa245-59ce-41ac-98c6-8fdad2de00a5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02b10177-69c1-46be-b84b-c27acdbdcd59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b56aa245-59ce-41ac-98c6-8fdad2de00a5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02b10177-69c1-46be-b84b-c27acdbdcd59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b56aa245-59ce-41ac-98c6-8fdad2de00a5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf8b451a-43ee-4394-a10f-c179a714af0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:59 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-b56aa245-59ce-41ac-98c6-8fdad2de00a5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Volume c32a4496-6a05-457e-a9c2-9da337457898: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c32a4496-6a05-457e-a9c2-9da337457898', 'volume_size': 1} Jul 07 17:32:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b56aa245-59ce-41ac-98c6-8fdad2de00a5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:00 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-093a76df-c62f-4491-b797-1b66ed443166 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:33:00 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-093a76df-c62f-4491-b797-1b66ed443166 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Flow 'volume_create_manager' (ee4bedd9-a742-4cc9-a555-7fedab2aa2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:00 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-093a76df-c62f-4491-b797-1b66ed443166 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dc36097-e540-4a12-860c-fb2905be1c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:00 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-093a76df-c62f-4491-b797-1b66ed443166 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dc36097-e540-4a12-860c-fb2905be1c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:33:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1974851165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d4bf9f-97c5-491e-be39-f878bc62d476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0264c576dfde4bd0839958f86a973e2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:00Z,use_quota=True,user_id='1aac94acc53d45a4a2960066bfe834d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:00 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-093a76df-c62f-4491-b797-1b66ed443166 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f982fb5-8cad-4364-9d16-9ebcd34b769d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:00 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-093a76df-c62f-4491-b797-1b66ed443166 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f982fb5-8cad-4364-9d16-9ebcd34b769d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:00 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-093a76df-c62f-4491-b797-1b66ed443166 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cc9b0ba-7218-4475-a948-47fb63a40885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:00 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-093a76df-c62f-4491-b797-1b66ed443166 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cc9b0ba-7218-4475-a948-47fb63a40885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05d4bf9f-97c5-491e-be39-f878bc62d476', 'volume_name': 'volume-05d4bf9f-97c5-491e-be39-f878bc62d476', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:00 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-093a76df-c62f-4491-b797-1b66ed443166 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b830edb5-e6be-4ffd-b97e-e82bc83bc191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:00 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-093a76df-c62f-4491-b797-1b66ed443166 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b830edb5-e6be-4ffd-b97e-e82bc83bc191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:00 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-093a76df-c62f-4491-b797-1b66ed443166 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a3419f4-93bb-4f5b-a276-b83f17c23ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:00 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-093a76df-c62f-4491-b797-1b66ed443166 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Volume 05d4bf9f-97c5-491e-be39-f878bc62d476: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05d4bf9f-97c5-491e-be39-f878bc62d476', 'volume_size': 1} Jul 07 17:33:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-093a76df-c62f-4491-b797-1b66ed443166 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:00 devstack sudo[101133]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-51da99a8-47ae-4a64-b800-9fdaf8b8b937 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8975f881-e8c4-442e-8017-d35cae32959f 1073741824" returned: 0 in 0.975s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-51da99a8-47ae-4a64-b800-9fdaf8b8b937 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8975f881-e8c4-442e-8017-d35cae32959f {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:00 devstack sudo[101139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8975f881-e8c4-442e-8017-d35cae32959f Jul 07 17:33:00 devstack sudo[101139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:01 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5cb5def5-54eb-44c6-b94f-bac8930e12fa tempest-VolumesTransfersV357Test-1044392109 None] Acquiring lock "cinder-88a8b73a-e97a-4f18-b4e0-9bb524d2164b-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:01 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5cb5def5-54eb-44c6-b94f-bac8930e12fa tempest-VolumesTransfersV357Test-1044392109 None] Lock "cinder-88a8b73a-e97a-4f18-b4e0-9bb524d2164b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:01 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5cb5def5-54eb-44c6-b94f-bac8930e12fa tempest-VolumesTransfersV357Test-1044392109 None] Acquiring lock "cinder-quobyte-88a8b73a-e97a-4f18-b4e0-9bb524d2164b" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:01 devstack sudo[101139]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-51da99a8-47ae-4a64-b800-9fdaf8b8b937 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8975f881-e8c4-442e-8017-d35cae32959f" returned: 0 in 0.673s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:01 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-51da99a8-47ae-4a64-b800-9fdaf8b8b937 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] <== create_volume: return (1691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:33:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-51da99a8-47ae-4a64-b800-9fdaf8b8b937 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.695s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:01 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5cb5def5-54eb-44c6-b94f-bac8930e12fa tempest-VolumesTransfersV357Test-1044392109 None] Lock "cinder-quobyte-88a8b73a-e97a-4f18-b4e0-9bb524d2164b" acquired by "delete_volume" :: waited 0.021s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-18fdd43e-53a8-45ad-989b-9011804bfddf tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.164s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:01 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-18fdd43e-53a8-45ad-989b-9011804bfddf tempest-CreateVolumesFromSourceVolumeTest-999225787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1573578256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd014857-4ba4-4b82-8780-e41680aa6046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0264c576dfde4bd0839958f86a973e2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:32:59Z,use_quota=True,user_id='1aac94acc53d45a4a2960066bfe834d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:33:01 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-18fdd43e-53a8-45ad-989b-9011804bfddf tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Creating volume fd014857-4ba4-4b82-8780-e41680aa6046 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:33:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-18fdd43e-53a8-45ad-989b-9011804bfddf tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-18fdd43e-53a8-45ad-989b-9011804bfddf tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:01 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-18fdd43e-53a8-45ad-989b-9011804bfddf tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:01 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-18fdd43e-53a8-45ad-989b-9011804bfddf tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-18fdd43e-53a8-45ad-989b-9011804bfddf tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:01 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-18fdd43e-53a8-45ad-989b-9011804bfddf tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:33:01 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-18fdd43e-53a8-45ad-989b-9011804bfddf tempest-CreateVolumesFromSourceVolumeTest-999225787 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:33:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-18fdd43e-53a8-45ad-989b-9011804bfddf tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fd014857-4ba4-4b82-8780-e41680aa6046 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:01 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4b8e0d-75b1-41d2-b8b1-73d80f817ee8]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5cb5def5-54eb-44c6-b94f-bac8930e12fa tempest-VolumesTransfersV357Test-1044392109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-88a8b73a-e97a-4f18-b4e0-9bb524d2164b {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:01 devstack sudo[101142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fd014857-4ba4-4b82-8780-e41680aa6046 1073741824 Jul 07 17:33:01 devstack sudo[101142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:01 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-51da99a8-47ae-4a64-b800-9fdaf8b8b937 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88a4fd5e-8cbc-4f2e-8f0c-d4214ea027b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8975f881-e8c4-442e-8017-d35cae32959f', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:01 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-51da99a8-47ae-4a64-b800-9fdaf8b8b937 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b84e4fa3-8667-481b-b86f-2f4d43b81788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:01 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-51da99a8-47ae-4a64-b800-9fdaf8b8b937 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Volume volume-8975f881-e8c4-442e-8017-d35cae32959f (8975f881-e8c4-442e-8017-d35cae32959f): created successfully Jul 07 17:33:01 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-51da99a8-47ae-4a64-b800-9fdaf8b8b937 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b84e4fa3-8667-481b-b86f-2f4d43b81788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:01 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-51da99a8-47ae-4a64-b800-9fdaf8b8b937 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Flow 'volume_create_manager' (f87e26ed-aa12-4c30-a569-a0f161ddcd18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:01 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-51da99a8-47ae-4a64-b800-9fdaf8b8b937 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Created volume successfully. Jul 07 17:33:01 devstack sudo[101143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-88a8b73a-e97a-4f18-b4e0-9bb524d2164b Jul 07 17:33:01 devstack sudo[101143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:02 devstack sudo[101143]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5cb5def5-54eb-44c6-b94f-bac8930e12fa tempest-VolumesTransfersV357Test-1044392109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-88a8b73a-e97a-4f18-b4e0-9bb524d2164b" returned: 0 in 0.873s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5cb5def5-54eb-44c6-b94f-bac8930e12fa tempest-VolumesTransfersV357Test-1044392109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-88a8b73a-e97a-4f18-b4e0-9bb524d2164b {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:02 devstack sudo[101153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-88a8b73a-e97a-4f18-b4e0-9bb524d2164b Jul 07 17:33:02 devstack sudo[101153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:02 devstack sudo[101142]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-18fdd43e-53a8-45ad-989b-9011804bfddf tempest-CreateVolumesFromSourceVolumeTest-999225787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fd014857-4ba4-4b82-8780-e41680aa6046 1073741824" returned: 0 in 1.101s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-18fdd43e-53a8-45ad-989b-9011804bfddf tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fd014857-4ba4-4b82-8780-e41680aa6046 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:02 devstack sudo[101155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fd014857-4ba4-4b82-8780-e41680aa6046 Jul 07 17:33:02 devstack sudo[101155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:02 devstack sudo[101153]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5cb5def5-54eb-44c6-b94f-bac8930e12fa tempest-VolumesTransfersV357Test-1044392109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-88a8b73a-e97a-4f18-b4e0-9bb524d2164b" returned: 0 in 0.770s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:02 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5cb5def5-54eb-44c6-b94f-bac8930e12fa tempest-VolumesTransfersV357Test-1044392109 None] Lock "cinder-quobyte-88a8b73a-e97a-4f18-b4e0-9bb524d2164b" released by "delete_volume" :: held 1.697s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:03 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-5cb5def5-54eb-44c6-b94f-bac8930e12fa tempest-VolumesTransfersV357Test-1044392109 None] Created reservations ['fd5e74b3-7f9d-4ba2-8cee-e82fc86a67d1', '7998d6cb-0c09-4a0a-af34-1ea18b49fa6e', '07fda55e-cac3-47be-aef9-905629df8b5f', '8fca5d6c-49e7-4741-9d55-4b65061ea4e6'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:33:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-5cb5def5-54eb-44c6-b94f-bac8930e12fa tempest-VolumesTransfersV357Test-1044392109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-5cb5def5-54eb-44c6-b94f-bac8930e12fa tempest-VolumesTransfersV357Test-1044392109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:03 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-5cb5def5-54eb-44c6-b94f-bac8930e12fa tempest-VolumesTransfersV357Test-1044392109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:03 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-5cb5def5-54eb-44c6-b94f-bac8930e12fa tempest-VolumesTransfersV357Test-1044392109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-5cb5def5-54eb-44c6-b94f-bac8930e12fa tempest-VolumesTransfersV357Test-1044392109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5cb5def5-54eb-44c6-b94f-bac8930e12fa tempest-VolumesTransfersV357Test-1044392109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:03 devstack sudo[101159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:33:03 devstack sudo[101159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:03 devstack sudo[101155]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-18fdd43e-53a8-45ad-989b-9011804bfddf tempest-CreateVolumesFromSourceVolumeTest-999225787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fd014857-4ba4-4b82-8780-e41680aa6046" returned: 0 in 0.697s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:03 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-18fdd43e-53a8-45ad-989b-9011804bfddf tempest-CreateVolumesFromSourceVolumeTest-999225787 None] <== create_volume: return (1854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:33:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-18fdd43e-53a8-45ad-989b-9011804bfddf tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.859s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f89d9a40-0d4b-4da2-b3ca-8e0706e8e71c tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.682s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:03 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-f89d9a40-0d4b-4da2-b3ca-8e0706e8e71c tempest-CreateVolumesFromSourceVolumeTest-999225787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1218872689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a650ab2-f606-47bf-9ce5-f4b8537f4145,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0264c576dfde4bd0839958f86a973e2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:32:59Z,use_quota=True,user_id='1aac94acc53d45a4a2960066bfe834d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:33:03 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-f89d9a40-0d4b-4da2-b3ca-8e0706e8e71c tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Creating volume 9a650ab2-f606-47bf-9ce5-f4b8537f4145 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:33:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f89d9a40-0d4b-4da2-b3ca-8e0706e8e71c tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f89d9a40-0d4b-4da2-b3ca-8e0706e8e71c tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:03 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-f89d9a40-0d4b-4da2-b3ca-8e0706e8e71c tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:03 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-f89d9a40-0d4b-4da2-b3ca-8e0706e8e71c tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f89d9a40-0d4b-4da2-b3ca-8e0706e8e71c tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:03 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-f89d9a40-0d4b-4da2-b3ca-8e0706e8e71c tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:33:03 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-f89d9a40-0d4b-4da2-b3ca-8e0706e8e71c tempest-CreateVolumesFromSourceVolumeTest-999225787 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:33:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f89d9a40-0d4b-4da2-b3ca-8e0706e8e71c tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-9a650ab2-f606-47bf-9ce5-f4b8537f4145 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:03 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-18fdd43e-53a8-45ad-989b-9011804bfddf tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23fc420f-08cf-4f37-981b-fa431eb4f079) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd014857-4ba4-4b82-8780-e41680aa6046', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:03 devstack sudo[101161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-9a650ab2-f606-47bf-9ce5-f4b8537f4145 1073741824 Jul 07 17:33:03 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-18fdd43e-53a8-45ad-989b-9011804bfddf tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18364359-bc8f-4bc5-9804-392f625cdaba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:03 devstack sudo[101161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:03 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-18fdd43e-53a8-45ad-989b-9011804bfddf tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Volume volume-fd014857-4ba4-4b82-8780-e41680aa6046 (fd014857-4ba4-4b82-8780-e41680aa6046): created successfully Jul 07 17:33:03 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-18fdd43e-53a8-45ad-989b-9011804bfddf tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18364359-bc8f-4bc5-9804-392f625cdaba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:03 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-18fdd43e-53a8-45ad-989b-9011804bfddf tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Flow 'volume_create_manager' (bd42f75e-9704-4e44-bb7a-fc3d68cfe8e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:03 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-18fdd43e-53a8-45ad-989b-9011804bfddf tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Created volume successfully. Jul 07 17:33:03 devstack sudo[101159]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5cb5def5-54eb-44c6-b94f-bac8930e12fa tempest-VolumesTransfersV357Test-1044392109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.725s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:03 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-5cb5def5-54eb-44c6-b94f-bac8930e12fa tempest-VolumesTransfersV357Test-1044392109 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:33:03 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-5cb5def5-54eb-44c6-b94f-bac8930e12fa tempest-VolumesTransfersV357Test-1044392109 None] Deleted volume successfully. Jul 07 17:33:03 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5cb5def5-54eb-44c6-b94f-bac8930e12fa tempest-VolumesTransfersV357Test-1044392109 None] Lock "cinder-88a8b73a-e97a-4f18-b4e0-9bb524d2164b-delete_volume" released by "delete_volume" :: held 2.663s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:04 devstack sudo[101161]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f89d9a40-0d4b-4da2-b3ca-8e0706e8e71c tempest-CreateVolumesFromSourceVolumeTest-999225787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-9a650ab2-f606-47bf-9ce5-f4b8537f4145 1073741824" returned: 0 in 1.061s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f89d9a40-0d4b-4da2-b3ca-8e0706e8e71c tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-9a650ab2-f606-47bf-9ce5-f4b8537f4145 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:04 devstack sudo[101169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-9a650ab2-f606-47bf-9ce5-f4b8537f4145 Jul 07 17:33:04 devstack sudo[101169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:05 devstack sudo[101169]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f89d9a40-0d4b-4da2-b3ca-8e0706e8e71c tempest-CreateVolumesFromSourceVolumeTest-999225787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-9a650ab2-f606-47bf-9ce5-f4b8537f4145" returned: 0 in 0.818s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:05 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-f89d9a40-0d4b-4da2-b3ca-8e0706e8e71c tempest-CreateVolumesFromSourceVolumeTest-999225787 None] <== create_volume: return (1940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:33:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f89d9a40-0d4b-4da2-b3ca-8e0706e8e71c tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.944s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b56aa245-59ce-41ac-98c6-8fdad2de00a5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.206s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:05 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b56aa245-59ce-41ac-98c6-8fdad2de00a5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-950827178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c32a4496-6a05-457e-a9c2-9da337457898,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0264c576dfde4bd0839958f86a973e2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:00Z,use_quota=True,user_id='1aac94acc53d45a4a2960066bfe834d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:33:05 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-b56aa245-59ce-41ac-98c6-8fdad2de00a5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Creating volume c32a4496-6a05-457e-a9c2-9da337457898 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:33:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b56aa245-59ce-41ac-98c6-8fdad2de00a5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b56aa245-59ce-41ac-98c6-8fdad2de00a5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:05 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b56aa245-59ce-41ac-98c6-8fdad2de00a5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:05 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b56aa245-59ce-41ac-98c6-8fdad2de00a5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b56aa245-59ce-41ac-98c6-8fdad2de00a5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:05 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b56aa245-59ce-41ac-98c6-8fdad2de00a5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:33:05 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-b56aa245-59ce-41ac-98c6-8fdad2de00a5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:33:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b56aa245-59ce-41ac-98c6-8fdad2de00a5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c32a4496-6a05-457e-a9c2-9da337457898 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f89d9a40-0d4b-4da2-b3ca-8e0706e8e71c tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46083019-a25d-4fa9-b808-2d7462b112e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a650ab2-f606-47bf-9ce5-f4b8537f4145', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f89d9a40-0d4b-4da2-b3ca-8e0706e8e71c tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25525d35-e8d0-4d78-ba72-07b6886271be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:05 devstack sudo[101179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c32a4496-6a05-457e-a9c2-9da337457898 1073741824 Jul 07 17:33:05 devstack sudo[101179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:05 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-f89d9a40-0d4b-4da2-b3ca-8e0706e8e71c tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Volume volume-9a650ab2-f606-47bf-9ce5-f4b8537f4145 (9a650ab2-f606-47bf-9ce5-f4b8537f4145): created successfully Jul 07 17:33:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f89d9a40-0d4b-4da2-b3ca-8e0706e8e71c tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25525d35-e8d0-4d78-ba72-07b6886271be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f89d9a40-0d4b-4da2-b3ca-8e0706e8e71c tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Flow 'volume_create_manager' (a5be2887-0ea1-46f2-9c7c-912c6d2de027) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:05 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-f89d9a40-0d4b-4da2-b3ca-8e0706e8e71c tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Created volume successfully. Jul 07 17:33:06 devstack sudo[101179]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b56aa245-59ce-41ac-98c6-8fdad2de00a5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c32a4496-6a05-457e-a9c2-9da337457898 1073741824" returned: 0 in 1.097s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b56aa245-59ce-41ac-98c6-8fdad2de00a5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c32a4496-6a05-457e-a9c2-9da337457898 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:06 devstack sudo[101186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c32a4496-6a05-457e-a9c2-9da337457898 Jul 07 17:33:06 devstack sudo[101186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:07 devstack sudo[101186]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b56aa245-59ce-41ac-98c6-8fdad2de00a5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c32a4496-6a05-457e-a9c2-9da337457898" returned: 0 in 0.782s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:07 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b56aa245-59ce-41ac-98c6-8fdad2de00a5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] <== create_volume: return (1931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:33:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b56aa245-59ce-41ac-98c6-8fdad2de00a5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.936s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-093a76df-c62f-4491-b797-1b66ed443166 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.759s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:07 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-093a76df-c62f-4491-b797-1b66ed443166 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:33:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1974851165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d4bf9f-97c5-491e-be39-f878bc62d476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0264c576dfde4bd0839958f86a973e2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:00Z,use_quota=True,user_id='1aac94acc53d45a4a2960066bfe834d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:33:07 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-093a76df-c62f-4491-b797-1b66ed443166 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Creating volume 05d4bf9f-97c5-491e-be39-f878bc62d476 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:33:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-093a76df-c62f-4491-b797-1b66ed443166 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-093a76df-c62f-4491-b797-1b66ed443166 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:07 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-093a76df-c62f-4491-b797-1b66ed443166 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:07 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-093a76df-c62f-4491-b797-1b66ed443166 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-093a76df-c62f-4491-b797-1b66ed443166 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:07 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-093a76df-c62f-4491-b797-1b66ed443166 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:33:07 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-093a76df-c62f-4491-b797-1b66ed443166 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:33:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-093a76df-c62f-4491-b797-1b66ed443166 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-05d4bf9f-97c5-491e-be39-f878bc62d476 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:07 devstack sudo[101193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-05d4bf9f-97c5-491e-be39-f878bc62d476 1073741824 Jul 07 17:33:07 devstack sudo[101193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:07 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b56aa245-59ce-41ac-98c6-8fdad2de00a5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf8b451a-43ee-4394-a10f-c179a714af0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c32a4496-6a05-457e-a9c2-9da337457898', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:07 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b56aa245-59ce-41ac-98c6-8fdad2de00a5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75875ecd-4a18-4bf3-8f72-8935caf9935b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:07 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-b56aa245-59ce-41ac-98c6-8fdad2de00a5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Volume volume-c32a4496-6a05-457e-a9c2-9da337457898 (c32a4496-6a05-457e-a9c2-9da337457898): created successfully Jul 07 17:33:07 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b56aa245-59ce-41ac-98c6-8fdad2de00a5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75875ecd-4a18-4bf3-8f72-8935caf9935b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:07 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b56aa245-59ce-41ac-98c6-8fdad2de00a5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Flow 'volume_create_manager' (d4d7b110-de2a-4900-9ac9-91cac4b4159a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:07 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-b56aa245-59ce-41ac-98c6-8fdad2de00a5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Created volume successfully. Jul 07 17:33:07 devstack sudo[101193]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-093a76df-c62f-4491-b797-1b66ed443166 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-05d4bf9f-97c5-491e-be39-f878bc62d476 1073741824" returned: 0 in 0.912s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-093a76df-c62f-4491-b797-1b66ed443166 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-05d4bf9f-97c5-491e-be39-f878bc62d476 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:08 devstack sudo[101199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-05d4bf9f-97c5-491e-be39-f878bc62d476 Jul 07 17:33:08 devstack sudo[101199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:08 devstack sudo[101199]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-093a76df-c62f-4491-b797-1b66ed443166 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-05d4bf9f-97c5-491e-be39-f878bc62d476" returned: 0 in 0.758s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:08 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-093a76df-c62f-4491-b797-1b66ed443166 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] <== create_volume: return (1724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:33:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-093a76df-c62f-4491-b797-1b66ed443166 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.730s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:08 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-093a76df-c62f-4491-b797-1b66ed443166 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a3419f4-93bb-4f5b-a276-b83f17c23ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05d4bf9f-97c5-491e-be39-f878bc62d476', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:08 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-093a76df-c62f-4491-b797-1b66ed443166 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e73f918-aa07-418d-829c-f8f2a4029f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:08 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-093a76df-c62f-4491-b797-1b66ed443166 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Volume volume-05d4bf9f-97c5-491e-be39-f878bc62d476 (05d4bf9f-97c5-491e-be39-f878bc62d476): created successfully Jul 07 17:33:08 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-093a76df-c62f-4491-b797-1b66ed443166 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e73f918-aa07-418d-829c-f8f2a4029f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:08 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-093a76df-c62f-4491-b797-1b66ed443166 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Flow 'volume_create_manager' (ee4bedd9-a742-4cc9-a555-7fedab2aa2b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:08 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-093a76df-c62f-4491-b797-1b66ed443166 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Created volume successfully. Jul 07 17:33:09 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6bc0c7ad-5585-4834-a790-f1800f968eb5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Acquiring lock "cinder-05d4bf9f-97c5-491e-be39-f878bc62d476-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:09 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6bc0c7ad-5585-4834-a790-f1800f968eb5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "cinder-05d4bf9f-97c5-491e-be39-f878bc62d476-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:09 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6bc0c7ad-5585-4834-a790-f1800f968eb5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Acquiring lock "cinder-quobyte-05d4bf9f-97c5-491e-be39-f878bc62d476" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:09 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6bc0c7ad-5585-4834-a790-f1800f968eb5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "cinder-quobyte-05d4bf9f-97c5-491e-be39-f878bc62d476" acquired by "delete_volume" :: waited 0.018s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:09 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ca54ec-c1e9-43e8-b1fe-b6c21f182ada]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6bc0c7ad-5585-4834-a790-f1800f968eb5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-05d4bf9f-97c5-491e-be39-f878bc62d476 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:09 devstack sudo[101202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-05d4bf9f-97c5-491e-be39-f878bc62d476 Jul 07 17:33:09 devstack sudo[101202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:10 devstack sudo[101202]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6bc0c7ad-5585-4834-a790-f1800f968eb5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-05d4bf9f-97c5-491e-be39-f878bc62d476" returned: 0 in 0.914s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6bc0c7ad-5585-4834-a790-f1800f968eb5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-05d4bf9f-97c5-491e-be39-f878bc62d476 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:10 devstack sudo[101208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-05d4bf9f-97c5-491e-be39-f878bc62d476 Jul 07 17:33:10 devstack sudo[101208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:10 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-46a81e97-d4c7-4dc1-860f-7b91cb6c8cca tempest-VolumesGetTest-702217890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:33:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-46a81e97-d4c7-4dc1-860f-7b91cb6c8cca tempest-VolumesGetTest-702217890 None] Flow 'volume_create_manager' (6d9508b9-e5d6-4251-b4c1-7bb832f97371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-46a81e97-d4c7-4dc1-860f-7b91cb6c8cca tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26770a87-988a-4d3a-8034-6e84fe770cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-46a81e97-d4c7-4dc1-860f-7b91cb6c8cca tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26770a87-988a-4d3a-8034-6e84fe770cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1468113149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a453c894-f60e-40bb-8ab2-48946368b89d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f9fcad01754d4605a8996d83455e0bf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:10Z,use_quota=True,user_id='e9e20ab6b3574245816d4bd7e981e344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-46a81e97-d4c7-4dc1-860f-7b91cb6c8cca tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44650e44-aa8f-4eb3-9b4c-e386a27ce20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-46a81e97-d4c7-4dc1-860f-7b91cb6c8cca tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44650e44-aa8f-4eb3-9b4c-e386a27ce20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-46a81e97-d4c7-4dc1-860f-7b91cb6c8cca tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ead7b30-9a81-4ad5-ad80-56abaffe99c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-46a81e97-d4c7-4dc1-860f-7b91cb6c8cca tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ead7b30-9a81-4ad5-ad80-56abaffe99c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a453c894-f60e-40bb-8ab2-48946368b89d', 'volume_name': 'volume-a453c894-f60e-40bb-8ab2-48946368b89d', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-46a81e97-d4c7-4dc1-860f-7b91cb6c8cca tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (353f504f-a51c-43a2-9e65-48d9ea0e6c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-46a81e97-d4c7-4dc1-860f-7b91cb6c8cca tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (353f504f-a51c-43a2-9e65-48d9ea0e6c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-46a81e97-d4c7-4dc1-860f-7b91cb6c8cca tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b3a1fac-53d6-41cf-a3f2-d0698aeaa3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:10 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-46a81e97-d4c7-4dc1-860f-7b91cb6c8cca tempest-VolumesGetTest-702217890 None] Volume a453c894-f60e-40bb-8ab2-48946368b89d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a453c894-f60e-40bb-8ab2-48946368b89d', 'volume_size': 1} Jul 07 17:33:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-46a81e97-d4c7-4dc1-860f-7b91cb6c8cca tempest-VolumesGetTest-702217890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-46a81e97-d4c7-4dc1-860f-7b91cb6c8cca tempest-VolumesGetTest-702217890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:10 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-46a81e97-d4c7-4dc1-860f-7b91cb6c8cca tempest-VolumesGetTest-702217890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1468113149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a453c894-f60e-40bb-8ab2-48946368b89d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f9fcad01754d4605a8996d83455e0bf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:10Z,use_quota=True,user_id='e9e20ab6b3574245816d4bd7e981e344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:33:10 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-46a81e97-d4c7-4dc1-860f-7b91cb6c8cca tempest-VolumesGetTest-702217890 None] Creating volume a453c894-f60e-40bb-8ab2-48946368b89d {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:33:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-46a81e97-d4c7-4dc1-860f-7b91cb6c8cca tempest-VolumesGetTest-702217890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-46a81e97-d4c7-4dc1-860f-7b91cb6c8cca tempest-VolumesGetTest-702217890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:10 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-46a81e97-d4c7-4dc1-860f-7b91cb6c8cca tempest-VolumesGetTest-702217890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:10 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-46a81e97-d4c7-4dc1-860f-7b91cb6c8cca tempest-VolumesGetTest-702217890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-46a81e97-d4c7-4dc1-860f-7b91cb6c8cca tempest-VolumesGetTest-702217890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:10 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-46a81e97-d4c7-4dc1-860f-7b91cb6c8cca tempest-VolumesGetTest-702217890 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:33:10 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-46a81e97-d4c7-4dc1-860f-7b91cb6c8cca tempest-VolumesGetTest-702217890 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:33:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-46a81e97-d4c7-4dc1-860f-7b91cb6c8cca tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a453c894-f60e-40bb-8ab2-48946368b89d 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:10 devstack sudo[101213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a453c894-f60e-40bb-8ab2-48946368b89d 1073741824 Jul 07 17:33:10 devstack sudo[101213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:10 devstack sudo[101208]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6bc0c7ad-5585-4834-a790-f1800f968eb5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-05d4bf9f-97c5-491e-be39-f878bc62d476" returned: 0 in 0.881s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:10 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6bc0c7ad-5585-4834-a790-f1800f968eb5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "cinder-quobyte-05d4bf9f-97c5-491e-be39-f878bc62d476" released by "delete_volume" :: held 1.850s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:11 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-6bc0c7ad-5585-4834-a790-f1800f968eb5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Created reservations ['82d6f29d-478e-4dbd-aec2-afd8316ed722', '625eac4a-3b0d-4814-a8c4-52d810980819', 'a6de9a33-706e-4f77-a043-ae36951507c7', 'cd63ca10-4749-47f3-a750-b2e1402a4dee'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:33:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-6bc0c7ad-5585-4834-a790-f1800f968eb5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-6bc0c7ad-5585-4834-a790-f1800f968eb5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:11 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-6bc0c7ad-5585-4834-a790-f1800f968eb5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:11 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-6bc0c7ad-5585-4834-a790-f1800f968eb5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-6bc0c7ad-5585-4834-a790-f1800f968eb5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6bc0c7ad-5585-4834-a790-f1800f968eb5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:11 devstack sudo[101234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:33:11 devstack sudo[101234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:11 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-2fb41e82-8e7b-4e27-a143-ef1b0729a001 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Acquiring lock "cinder-c32a4496-6a05-457e-a9c2-9da337457898-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:11 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-2fb41e82-8e7b-4e27-a143-ef1b0729a001 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "cinder-c32a4496-6a05-457e-a9c2-9da337457898-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:11 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-2fb41e82-8e7b-4e27-a143-ef1b0729a001 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Acquiring lock "cinder-quobyte-c32a4496-6a05-457e-a9c2-9da337457898" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:11 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-2fb41e82-8e7b-4e27-a143-ef1b0729a001 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "cinder-quobyte-c32a4496-6a05-457e-a9c2-9da337457898" acquired by "delete_volume" :: waited 0.018s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:11 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[40095fd0-5b8e-4023-b371-fe5686ceb6da]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2fb41e82-8e7b-4e27-a143-ef1b0729a001 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c32a4496-6a05-457e-a9c2-9da337457898 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:11 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-addd0ad0-7068-4168-8bd4-37cf2a63f94b req-bb81f92e-bcb8-4765-b88e-9be7340ac1cc tempest-TestShelveInstance-1988315190 None] Terminate volume connection completed successfully. Jul 07 17:33:11 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-addd0ad0-7068-4168-8bd4-37cf2a63f94b req-bb81f92e-bcb8-4765-b88e-9be7340ac1cc tempest-TestShelveInstance-1988315190 None] Deleting attachment 2f00a48d-d1e3-408c-a169-4cba6f19ca92. {{(pid=87233) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:33:11 devstack sudo[101240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c32a4496-6a05-457e-a9c2-9da337457898 Jul 07 17:33:11 devstack sudo[101240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:11 devstack sudo[101213]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-46a81e97-d4c7-4dc1-860f-7b91cb6c8cca tempest-VolumesGetTest-702217890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a453c894-f60e-40bb-8ab2-48946368b89d 1073741824" returned: 0 in 1.157s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-46a81e97-d4c7-4dc1-860f-7b91cb6c8cca tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a453c894-f60e-40bb-8ab2-48946368b89d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:11 devstack sudo[101242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a453c894-f60e-40bb-8ab2-48946368b89d Jul 07 17:33:11 devstack sudo[101242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:11 devstack sudo[101234]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6bc0c7ad-5585-4834-a790-f1800f968eb5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.745s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:11 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-6bc0c7ad-5585-4834-a790-f1800f968eb5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:33:11 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-6bc0c7ad-5585-4834-a790-f1800f968eb5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Deleted volume successfully. Jul 07 17:33:11 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6bc0c7ad-5585-4834-a790-f1800f968eb5 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "cinder-05d4bf9f-97c5-491e-be39-f878bc62d476-delete_volume" released by "delete_volume" :: held 2.849s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:12 devstack sudo[101240]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2fb41e82-8e7b-4e27-a143-ef1b0729a001 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c32a4496-6a05-457e-a9c2-9da337457898" returned: 0 in 0.850s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2fb41e82-8e7b-4e27-a143-ef1b0729a001 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c32a4496-6a05-457e-a9c2-9da337457898 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:12 devstack sudo[101249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c32a4496-6a05-457e-a9c2-9da337457898 Jul 07 17:33:12 devstack sudo[101249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:12 devstack sudo[101242]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-46a81e97-d4c7-4dc1-860f-7b91cb6c8cca tempest-VolumesGetTest-702217890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a453c894-f60e-40bb-8ab2-48946368b89d" returned: 0 in 0.789s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:12 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-46a81e97-d4c7-4dc1-860f-7b91cb6c8cca tempest-VolumesGetTest-702217890 None] <== create_volume: return (1992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:33:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-46a81e97-d4c7-4dc1-860f-7b91cb6c8cca tempest-VolumesGetTest-702217890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.996s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:12 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-46a81e97-d4c7-4dc1-860f-7b91cb6c8cca tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b3a1fac-53d6-41cf-a3f2-d0698aeaa3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a453c894-f60e-40bb-8ab2-48946368b89d', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:12 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-46a81e97-d4c7-4dc1-860f-7b91cb6c8cca tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6009739c-64e7-4365-bfc9-99bc9e1e6646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:12 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-46a81e97-d4c7-4dc1-860f-7b91cb6c8cca tempest-VolumesGetTest-702217890 None] Volume volume-a453c894-f60e-40bb-8ab2-48946368b89d (a453c894-f60e-40bb-8ab2-48946368b89d): created successfully Jul 07 17:33:12 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-46a81e97-d4c7-4dc1-860f-7b91cb6c8cca tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6009739c-64e7-4365-bfc9-99bc9e1e6646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:12 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-46a81e97-d4c7-4dc1-860f-7b91cb6c8cca tempest-VolumesGetTest-702217890 None] Flow 'volume_create_manager' (6d9508b9-e5d6-4251-b4c1-7bb832f97371) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:12 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-46a81e97-d4c7-4dc1-860f-7b91cb6c8cca tempest-VolumesGetTest-702217890 None] Created volume successfully. Jul 07 17:33:13 devstack sudo[101249]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2fb41e82-8e7b-4e27-a143-ef1b0729a001 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c32a4496-6a05-457e-a9c2-9da337457898" returned: 0 in 0.772s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:13 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-2fb41e82-8e7b-4e27-a143-ef1b0729a001 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "cinder-quobyte-c32a4496-6a05-457e-a9c2-9da337457898" released by "delete_volume" :: held 1.665s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:13 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-2fb41e82-8e7b-4e27-a143-ef1b0729a001 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Created reservations ['2e586e5d-d3c3-49bd-a726-32d3c59f97f6', 'bd678973-f1c9-4408-8b21-29d4163496ae', 'fc91eacf-0013-4e9b-abda-2419d4b5a751', 'bc2c7d8b-b925-45d5-85cf-04c9b25ebbd5'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:33:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-2fb41e82-8e7b-4e27-a143-ef1b0729a001 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-2fb41e82-8e7b-4e27-a143-ef1b0729a001 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:13 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-2fb41e82-8e7b-4e27-a143-ef1b0729a001 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:13 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-2fb41e82-8e7b-4e27-a143-ef1b0729a001 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-2fb41e82-8e7b-4e27-a143-ef1b0729a001 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2fb41e82-8e7b-4e27-a143-ef1b0729a001 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:13 devstack sudo[101252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:33:13 devstack sudo[101252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:13 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5bea76aa-26fa-4377-b766-3434272427b6 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Acquiring lock "cinder-9a650ab2-f606-47bf-9ce5-f4b8537f4145-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:13 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5bea76aa-26fa-4377-b766-3434272427b6 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "cinder-9a650ab2-f606-47bf-9ce5-f4b8537f4145-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:13 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5bea76aa-26fa-4377-b766-3434272427b6 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Acquiring lock "cinder-quobyte-9a650ab2-f606-47bf-9ce5-f4b8537f4145" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:13 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5bea76aa-26fa-4377-b766-3434272427b6 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "cinder-quobyte-9a650ab2-f606-47bf-9ce5-f4b8537f4145" acquired by "delete_volume" :: waited 0.017s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:13 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3662be22-b179-42eb-bee3-139624dced99]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5bea76aa-26fa-4377-b766-3434272427b6 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-9a650ab2-f606-47bf-9ce5-f4b8537f4145 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:13 devstack sudo[101254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-9a650ab2-f606-47bf-9ce5-f4b8537f4145 Jul 07 17:33:13 devstack sudo[101254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:14 devstack sudo[101252]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2fb41e82-8e7b-4e27-a143-ef1b0729a001 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.851s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:14 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-2fb41e82-8e7b-4e27-a143-ef1b0729a001 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:33:14 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-2fb41e82-8e7b-4e27-a143-ef1b0729a001 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Deleted volume successfully. Jul 07 17:33:14 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-2fb41e82-8e7b-4e27-a143-ef1b0729a001 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "cinder-c32a4496-6a05-457e-a9c2-9da337457898-delete_volume" released by "delete_volume" :: held 2.818s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:14 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-da6ad3e3-845f-436a-98c4-e6d0ef081c2d tempest-VolumesGetTest-702217890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:33:14 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-da6ad3e3-845f-436a-98c4-e6d0ef081c2d tempest-VolumesGetTest-702217890 None] Flow 'volume_create_manager' (b46c3df1-61cf-458f-977c-db7ba178dc08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:14 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-da6ad3e3-845f-436a-98c4-e6d0ef081c2d tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cdff036-327e-4a49-9200-ac517167a9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:14 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-da6ad3e3-845f-436a-98c4-e6d0ef081c2d tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cdff036-327e-4a49-9200-ac517167a9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:33:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-690714983',display_name='tempest-VolumesGetTest-Volume-1748818642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8814ca3a-aa2c-4b6e-bb05-685b3544c628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9fcad01754d4605a8996d83455e0bf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:14Z,use_quota=True,user_id='e9e20ab6b3574245816d4bd7e981e344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:14 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-da6ad3e3-845f-436a-98c4-e6d0ef081c2d tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df7716bc-1ef5-4342-954e-f1c02ad00330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:14 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-da6ad3e3-845f-436a-98c4-e6d0ef081c2d tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df7716bc-1ef5-4342-954e-f1c02ad00330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:14 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-da6ad3e3-845f-436a-98c4-e6d0ef081c2d tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49d6269b-6c6f-4fd6-93a1-325e0e6bf9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:14 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-da6ad3e3-845f-436a-98c4-e6d0ef081c2d tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49d6269b-6c6f-4fd6-93a1-325e0e6bf9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8814ca3a-aa2c-4b6e-bb05-685b3544c628', 'volume_name': 'volume-8814ca3a-aa2c-4b6e-bb05-685b3544c628', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:14 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-da6ad3e3-845f-436a-98c4-e6d0ef081c2d tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cb8f299-d0d1-4efe-9609-267c558a263b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:14 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-da6ad3e3-845f-436a-98c4-e6d0ef081c2d tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cb8f299-d0d1-4efe-9609-267c558a263b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:14 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-da6ad3e3-845f-436a-98c4-e6d0ef081c2d tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e068a3a6-142a-4872-99bd-501f9eef39b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:14 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-da6ad3e3-845f-436a-98c4-e6d0ef081c2d tempest-VolumesGetTest-702217890 None] Volume 8814ca3a-aa2c-4b6e-bb05-685b3544c628: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8814ca3a-aa2c-4b6e-bb05-685b3544c628', 'volume_size': 1} Jul 07 17:33:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-da6ad3e3-845f-436a-98c4-e6d0ef081c2d tempest-VolumesGetTest-702217890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-da6ad3e3-845f-436a-98c4-e6d0ef081c2d tempest-VolumesGetTest-702217890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:14 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-da6ad3e3-845f-436a-98c4-e6d0ef081c2d tempest-VolumesGetTest-702217890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:33:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-690714983',display_name='tempest-VolumesGetTest-Volume-1748818642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8814ca3a-aa2c-4b6e-bb05-685b3544c628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9fcad01754d4605a8996d83455e0bf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:14Z,use_quota=True,user_id='e9e20ab6b3574245816d4bd7e981e344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:33:14 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-da6ad3e3-845f-436a-98c4-e6d0ef081c2d tempest-VolumesGetTest-702217890 None] Creating volume 8814ca3a-aa2c-4b6e-bb05-685b3544c628 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:33:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-da6ad3e3-845f-436a-98c4-e6d0ef081c2d tempest-VolumesGetTest-702217890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-da6ad3e3-845f-436a-98c4-e6d0ef081c2d tempest-VolumesGetTest-702217890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:14 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-da6ad3e3-845f-436a-98c4-e6d0ef081c2d tempest-VolumesGetTest-702217890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:14 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-da6ad3e3-845f-436a-98c4-e6d0ef081c2d tempest-VolumesGetTest-702217890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-da6ad3e3-845f-436a-98c4-e6d0ef081c2d tempest-VolumesGetTest-702217890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:14 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-da6ad3e3-845f-436a-98c4-e6d0ef081c2d tempest-VolumesGetTest-702217890 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:33:14 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-da6ad3e3-845f-436a-98c4-e6d0ef081c2d tempest-VolumesGetTest-702217890 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:33:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-da6ad3e3-845f-436a-98c4-e6d0ef081c2d tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8814ca3a-aa2c-4b6e-bb05-685b3544c628 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:14 devstack sudo[101258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8814ca3a-aa2c-4b6e-bb05-685b3544c628 1073741824 Jul 07 17:33:14 devstack sudo[101258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:14 devstack sudo[101254]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5bea76aa-26fa-4377-b766-3434272427b6 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-9a650ab2-f606-47bf-9ce5-f4b8537f4145" returned: 0 in 1.084s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5bea76aa-26fa-4377-b766-3434272427b6 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-9a650ab2-f606-47bf-9ce5-f4b8537f4145 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:14 devstack sudo[101265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-9a650ab2-f606-47bf-9ce5-f4b8537f4145 Jul 07 17:33:14 devstack sudo[101265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:15 devstack sudo[101258]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-da6ad3e3-845f-436a-98c4-e6d0ef081c2d tempest-VolumesGetTest-702217890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8814ca3a-aa2c-4b6e-bb05-685b3544c628 1073741824" returned: 0 in 0.946s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:15 devstack sudo[101265]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5bea76aa-26fa-4377-b766-3434272427b6 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-9a650ab2-f606-47bf-9ce5-f4b8537f4145" returned: 0 in 0.766s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:15 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5bea76aa-26fa-4377-b766-3434272427b6 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "cinder-quobyte-9a650ab2-f606-47bf-9ce5-f4b8537f4145" released by "delete_volume" :: held 1.917s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-da6ad3e3-845f-436a-98c4-e6d0ef081c2d tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8814ca3a-aa2c-4b6e-bb05-685b3544c628 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:15 devstack sudo[101272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8814ca3a-aa2c-4b6e-bb05-685b3544c628 Jul 07 17:33:15 devstack sudo[101272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:15 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-5bea76aa-26fa-4377-b766-3434272427b6 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Created reservations ['ae328272-4aa9-4aba-bfc1-c0672c793dd4', 'd4edd06a-81f2-478f-ac24-b97161cb8041', '70298716-2774-4e3b-80df-a8135b9bc17c', '0de0e761-7223-4f27-9044-c9e265b2fdc6'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:33:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-5bea76aa-26fa-4377-b766-3434272427b6 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-5bea76aa-26fa-4377-b766-3434272427b6 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:15 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-5bea76aa-26fa-4377-b766-3434272427b6 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:15 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-5bea76aa-26fa-4377-b766-3434272427b6 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-5bea76aa-26fa-4377-b766-3434272427b6 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5bea76aa-26fa-4377-b766-3434272427b6 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:15 devstack sudo[101308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:33:15 devstack sudo[101308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:15 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-e20c8398-747e-4603-b45f-f0e046563088 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Acquiring lock "cinder-fd014857-4ba4-4b82-8780-e41680aa6046-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:15 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-e20c8398-747e-4603-b45f-f0e046563088 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "cinder-fd014857-4ba4-4b82-8780-e41680aa6046-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:16 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-e20c8398-747e-4603-b45f-f0e046563088 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Acquiring lock "cinder-quobyte-fd014857-4ba4-4b82-8780-e41680aa6046" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:16 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-e20c8398-747e-4603-b45f-f0e046563088 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "cinder-quobyte-fd014857-4ba4-4b82-8780-e41680aa6046" acquired by "delete_volume" :: waited 0.017s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:16 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f549fba1-7fab-453c-8477-952deb7b0954]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e20c8398-747e-4603-b45f-f0e046563088 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fd014857-4ba4-4b82-8780-e41680aa6046 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:16 devstack sudo[101310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fd014857-4ba4-4b82-8780-e41680aa6046 Jul 07 17:33:16 devstack sudo[101310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:16 devstack sudo[101272]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-da6ad3e3-845f-436a-98c4-e6d0ef081c2d tempest-VolumesGetTest-702217890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8814ca3a-aa2c-4b6e-bb05-685b3544c628" returned: 0 in 0.791s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:16 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-da6ad3e3-845f-436a-98c4-e6d0ef081c2d tempest-VolumesGetTest-702217890 None] <== create_volume: return (1803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:33:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-da6ad3e3-845f-436a-98c4-e6d0ef081c2d tempest-VolumesGetTest-702217890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.805s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:16 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-da6ad3e3-845f-436a-98c4-e6d0ef081c2d tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e068a3a6-142a-4872-99bd-501f9eef39b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8814ca3a-aa2c-4b6e-bb05-685b3544c628', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:16 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-da6ad3e3-845f-436a-98c4-e6d0ef081c2d tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (026eda77-fe64-4b16-92a3-4baaed0f28f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:16 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-da6ad3e3-845f-436a-98c4-e6d0ef081c2d tempest-VolumesGetTest-702217890 None] Volume volume-8814ca3a-aa2c-4b6e-bb05-685b3544c628 (8814ca3a-aa2c-4b6e-bb05-685b3544c628): created successfully Jul 07 17:33:16 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-da6ad3e3-845f-436a-98c4-e6d0ef081c2d tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (026eda77-fe64-4b16-92a3-4baaed0f28f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:16 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-da6ad3e3-845f-436a-98c4-e6d0ef081c2d tempest-VolumesGetTest-702217890 None] Flow 'volume_create_manager' (b46c3df1-61cf-458f-977c-db7ba178dc08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:16 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-da6ad3e3-845f-436a-98c4-e6d0ef081c2d tempest-VolumesGetTest-702217890 None] Created volume successfully. Jul 07 17:33:16 devstack sudo[101308]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5bea76aa-26fa-4377-b766-3434272427b6 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.765s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:16 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-5bea76aa-26fa-4377-b766-3434272427b6 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:33:16 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-5bea76aa-26fa-4377-b766-3434272427b6 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Deleted volume successfully. Jul 07 17:33:16 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5bea76aa-26fa-4377-b766-3434272427b6 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "cinder-9a650ab2-f606-47bf-9ce5-f4b8537f4145-delete_volume" released by "delete_volume" :: held 3.014s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:16 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-16a8d1a2-b28b-40c2-a1e0-9efd79b5bfee tempest-VolumesGetTest-702217890 None] Acquiring lock "cinder-8814ca3a-aa2c-4b6e-bb05-685b3544c628-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:16 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-16a8d1a2-b28b-40c2-a1e0-9efd79b5bfee tempest-VolumesGetTest-702217890 None] Lock "cinder-8814ca3a-aa2c-4b6e-bb05-685b3544c628-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:16 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-16a8d1a2-b28b-40c2-a1e0-9efd79b5bfee tempest-VolumesGetTest-702217890 None] Acquiring lock "cinder-quobyte-8814ca3a-aa2c-4b6e-bb05-685b3544c628" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:16 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-16a8d1a2-b28b-40c2-a1e0-9efd79b5bfee tempest-VolumesGetTest-702217890 None] Lock "cinder-quobyte-8814ca3a-aa2c-4b6e-bb05-685b3544c628" acquired by "delete_volume" :: waited 0.018s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:16 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a10c7c-660c-4d33-8519-a2ecb3eb490a]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-16a8d1a2-b28b-40c2-a1e0-9efd79b5bfee tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8814ca3a-aa2c-4b6e-bb05-685b3544c628 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:16 devstack sudo[101310]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e20c8398-747e-4603-b45f-f0e046563088 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fd014857-4ba4-4b82-8780-e41680aa6046" returned: 0 in 0.858s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e20c8398-747e-4603-b45f-f0e046563088 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fd014857-4ba4-4b82-8780-e41680aa6046 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:16 devstack sudo[101320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fd014857-4ba4-4b82-8780-e41680aa6046 Jul 07 17:33:16 devstack sudo[101320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:17 devstack sudo[101319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8814ca3a-aa2c-4b6e-bb05-685b3544c628 Jul 07 17:33:17 devstack sudo[101319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-592c4fd6-597b-476f-aac1-621fe5e51bfa req-87f1b28c-f087-4673-adf7-682d58153d53 tempest-TestShelveInstance-1988315190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-592c4fd6-597b-476f-aac1-621fe5e51bfa req-87f1b28c-f087-4673-adf7-682d58153d53 tempest-TestShelveInstance-1988315190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:17 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8a64e8-bf34-46e5-a138-8764e3fcf3f5]: (4, 'raw') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-592c4fd6-597b-476f-aac1-621fe5e51bfa req-87f1b28c-f087-4673-adf7-682d58153d53 tempest-TestShelveInstance-1988315190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e09b9c94-9373-4bac-9614-06b37514b12a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:17 devstack sudo[101320]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e20c8398-747e-4603-b45f-f0e046563088 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fd014857-4ba4-4b82-8780-e41680aa6046" returned: 0 in 0.731s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:17 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-e20c8398-747e-4603-b45f-f0e046563088 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "cinder-quobyte-fd014857-4ba4-4b82-8780-e41680aa6046" released by "delete_volume" :: held 1.657s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:17 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-e20c8398-747e-4603-b45f-f0e046563088 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Created reservations ['46f14330-789a-40bd-be34-09e782852992', 'b4c6b0f6-7e80-4dbc-b46b-223d2a8e57f9', '9f663492-9cf9-4979-80cc-a3bd0ccc3334', '957c48b4-a2d3-46d6-9c4b-d0238f461c29'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:33:17 devstack sudo[101319]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-16a8d1a2-b28b-40c2-a1e0-9efd79b5bfee tempest-VolumesGetTest-702217890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8814ca3a-aa2c-4b6e-bb05-685b3544c628" returned: 0 in 0.834s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-16a8d1a2-b28b-40c2-a1e0-9efd79b5bfee tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8814ca3a-aa2c-4b6e-bb05-685b3544c628 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:17 devstack sudo[101335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e09b9c94-9373-4bac-9614-06b37514b12a Jul 07 17:33:17 devstack sudo[101335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:17 devstack sudo[101336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8814ca3a-aa2c-4b6e-bb05-685b3544c628 Jul 07 17:33:17 devstack sudo[101336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e20c8398-747e-4603-b45f-f0e046563088 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e20c8398-747e-4603-b45f-f0e046563088 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:17 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-e20c8398-747e-4603-b45f-f0e046563088 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:17 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-e20c8398-747e-4603-b45f-f0e046563088 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e20c8398-747e-4603-b45f-f0e046563088 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e20c8398-747e-4603-b45f-f0e046563088 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:17 devstack sudo[101339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:33:17 devstack sudo[101339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:18 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-f878b4cf-2768-4904-9995-1fd8463539c9 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Acquiring lock "cinder-8975f881-e8c4-442e-8017-d35cae32959f-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:18 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-f878b4cf-2768-4904-9995-1fd8463539c9 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "cinder-8975f881-e8c4-442e-8017-d35cae32959f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:18 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-f878b4cf-2768-4904-9995-1fd8463539c9 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Acquiring lock "cinder-quobyte-8975f881-e8c4-442e-8017-d35cae32959f" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:18 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-f878b4cf-2768-4904-9995-1fd8463539c9 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "cinder-quobyte-8975f881-e8c4-442e-8017-d35cae32959f" acquired by "delete_volume" :: waited 0.022s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:18 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8742709-13e6-47ff-8af2-a53a79ad87ae]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f878b4cf-2768-4904-9995-1fd8463539c9 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8975f881-e8c4-442e-8017-d35cae32959f {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:18 devstack sudo[101343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8975f881-e8c4-442e-8017-d35cae32959f Jul 07 17:33:18 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:18 devstack sudo[101335]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-592c4fd6-597b-476f-aac1-621fe5e51bfa req-87f1b28c-f087-4673-adf7-682d58153d53 tempest-TestShelveInstance-1988315190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e09b9c94-9373-4bac-9614-06b37514b12a" returned: 0 in 0.886s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-592c4fd6-597b-476f-aac1-621fe5e51bfa req-87f1b28c-f087-4673-adf7-682d58153d53 tempest-TestShelveInstance-1988315190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e09b9c94-9373-4bac-9614-06b37514b12a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:18 devstack sudo[101336]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-16a8d1a2-b28b-40c2-a1e0-9efd79b5bfee tempest-VolumesGetTest-702217890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8814ca3a-aa2c-4b6e-bb05-685b3544c628" returned: 0 in 0.847s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:18 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-16a8d1a2-b28b-40c2-a1e0-9efd79b5bfee tempest-VolumesGetTest-702217890 None] Lock "cinder-quobyte-8814ca3a-aa2c-4b6e-bb05-685b3544c628" released by "delete_volume" :: held 1.743s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:18 devstack sudo[101339]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e20c8398-747e-4603-b45f-f0e046563088 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.807s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:18 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-e20c8398-747e-4603-b45f-f0e046563088 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:33:18 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-e20c8398-747e-4603-b45f-f0e046563088 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Deleted volume successfully. Jul 07 17:33:18 devstack sudo[101347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e09b9c94-9373-4bac-9614-06b37514b12a Jul 07 17:33:18 devstack sudo[101347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:18 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-e20c8398-747e-4603-b45f-f0e046563088 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "cinder-fd014857-4ba4-4b82-8780-e41680aa6046-delete_volume" released by "delete_volume" :: held 2.724s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:18 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-16a8d1a2-b28b-40c2-a1e0-9efd79b5bfee tempest-VolumesGetTest-702217890 None] Created reservations ['c9b613ed-e65e-427f-a305-1f994745f60c', 'a759400a-6f6f-47ff-b8b2-d79ffbcaaa5b', '56eec0b4-8c9d-4273-9234-c0b1063d2b9e', '75f0efb5-81fa-40df-ba4b-db382e8a2bca'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:33:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-16a8d1a2-b28b-40c2-a1e0-9efd79b5bfee tempest-VolumesGetTest-702217890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-16a8d1a2-b28b-40c2-a1e0-9efd79b5bfee tempest-VolumesGetTest-702217890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:18 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-16a8d1a2-b28b-40c2-a1e0-9efd79b5bfee tempest-VolumesGetTest-702217890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:18 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-16a8d1a2-b28b-40c2-a1e0-9efd79b5bfee tempest-VolumesGetTest-702217890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-16a8d1a2-b28b-40c2-a1e0-9efd79b5bfee tempest-VolumesGetTest-702217890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-16a8d1a2-b28b-40c2-a1e0-9efd79b5bfee tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:18 devstack sudo[101349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:33:18 devstack sudo[101349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:19 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ab6d49a1-04ea-45f2-a3f5-2b8b5ec7d456 tempest-VolumesGetTest-702217890 None] Acquiring lock "cinder-a453c894-f60e-40bb-8ab2-48946368b89d-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:19 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ab6d49a1-04ea-45f2-a3f5-2b8b5ec7d456 tempest-VolumesGetTest-702217890 None] Lock "cinder-a453c894-f60e-40bb-8ab2-48946368b89d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:19 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ab6d49a1-04ea-45f2-a3f5-2b8b5ec7d456 tempest-VolumesGetTest-702217890 None] Acquiring lock "cinder-quobyte-a453c894-f60e-40bb-8ab2-48946368b89d" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:19 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ab6d49a1-04ea-45f2-a3f5-2b8b5ec7d456 tempest-VolumesGetTest-702217890 None] Lock "cinder-quobyte-a453c894-f60e-40bb-8ab2-48946368b89d" acquired by "delete_volume" :: waited 0.017s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:19 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d06be16-09d4-409f-b353-f470279edd3e]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ab6d49a1-04ea-45f2-a3f5-2b8b5ec7d456 tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a453c894-f60e-40bb-8ab2-48946368b89d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:19 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f878b4cf-2768-4904-9995-1fd8463539c9 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8975f881-e8c4-442e-8017-d35cae32959f" returned: 0 in 0.940s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f878b4cf-2768-4904-9995-1fd8463539c9 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8975f881-e8c4-442e-8017-d35cae32959f {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:19 devstack sudo[101356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a453c894-f60e-40bb-8ab2-48946368b89d Jul 07 17:33:19 devstack sudo[101356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:19 devstack sudo[101358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8975f881-e8c4-442e-8017-d35cae32959f Jul 07 17:33:19 devstack sudo[101358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:19 devstack sudo[101347]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-592c4fd6-597b-476f-aac1-621fe5e51bfa req-87f1b28c-f087-4673-adf7-682d58153d53 tempest-TestShelveInstance-1988315190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e09b9c94-9373-4bac-9614-06b37514b12a" returned: 1 in 0.845s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-592c4fd6-597b-476f-aac1-621fe5e51bfa req-87f1b28c-f087-4673-adf7-682d58153d53 tempest-TestShelveInstance-1988315190 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e09b9c94-9373-4bac-9614-06b37514b12a' failed. Not Retrying. {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:33:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-592c4fd6-597b-476f-aac1-621fe5e51bfa req-87f1b28c-f087-4673-adf7-682d58153d53 tempest-TestShelveInstance-1988315190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.774s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:19 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-592c4fd6-597b-476f-aac1-621fe5e51bfa req-87f1b28c-f087-4673-adf7-682d58153d53 tempest-TestShelveInstance-1988315190 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7', 'name': 'volume-e09b9c94-9373-4bac-9614-06b37514b12a', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ef900db0-f392-4dbe-a633-6942683c2f8c', 'enforce_multipath': True} {{(pid=87233) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:33:19 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-592c4fd6-597b-476f-aac1-621fe5e51bfa req-87f1b28c-f087-4673-adf7-682d58153d53 tempest-TestShelveInstance-1988315190 None] attachment_update completed successfully. Jul 07 17:33:19 devstack sudo[101349]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-16a8d1a2-b28b-40c2-a1e0-9efd79b5bfee tempest-VolumesGetTest-702217890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.775s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:19 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-16a8d1a2-b28b-40c2-a1e0-9efd79b5bfee tempest-VolumesGetTest-702217890 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:33:19 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-16a8d1a2-b28b-40c2-a1e0-9efd79b5bfee tempest-VolumesGetTest-702217890 None] Deleted volume successfully. Jul 07 17:33:19 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-16a8d1a2-b28b-40c2-a1e0-9efd79b5bfee tempest-VolumesGetTest-702217890 None] Lock "cinder-8814ca3a-aa2c-4b6e-bb05-685b3544c628-delete_volume" released by "delete_volume" :: held 2.766s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:20 devstack sudo[101358]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f878b4cf-2768-4904-9995-1fd8463539c9 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8975f881-e8c4-442e-8017-d35cae32959f" returned: 0 in 0.745s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:20 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-f878b4cf-2768-4904-9995-1fd8463539c9 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "cinder-quobyte-8975f881-e8c4-442e-8017-d35cae32959f" released by "delete_volume" :: held 1.750s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:20 devstack sudo[101356]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ab6d49a1-04ea-45f2-a3f5-2b8b5ec7d456 tempest-VolumesGetTest-702217890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a453c894-f60e-40bb-8ab2-48946368b89d" returned: 0 in 0.889s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ab6d49a1-04ea-45f2-a3f5-2b8b5ec7d456 tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a453c894-f60e-40bb-8ab2-48946368b89d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:20 devstack sudo[101366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a453c894-f60e-40bb-8ab2-48946368b89d Jul 07 17:33:20 devstack sudo[101366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:20 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-f878b4cf-2768-4904-9995-1fd8463539c9 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Created reservations ['2b13e3e2-ca1b-4cdc-8ca8-aba292b29c9c', '5a722633-0594-42c4-bf7d-3001aa6a51fc', 'cf209a2d-400a-48f2-b22e-028c61776e3c', 'cf75c993-1ef9-4f93-bb79-fafdaa1c0455'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:33:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f878b4cf-2768-4904-9995-1fd8463539c9 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f878b4cf-2768-4904-9995-1fd8463539c9 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:20 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-f878b4cf-2768-4904-9995-1fd8463539c9 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:20 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-f878b4cf-2768-4904-9995-1fd8463539c9 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f878b4cf-2768-4904-9995-1fd8463539c9 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f878b4cf-2768-4904-9995-1fd8463539c9 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:20 devstack sudo[101368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:33:20 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:20 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-20a6cf8e-3a6c-42c7-8a7b-2101c630e876 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Acquiring lock "cinder-eacad06f-7120-4759-8c99-dbf38b540235-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:20 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-20a6cf8e-3a6c-42c7-8a7b-2101c630e876 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "cinder-eacad06f-7120-4759-8c99-dbf38b540235-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:20 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-20a6cf8e-3a6c-42c7-8a7b-2101c630e876 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Acquiring lock "cinder-quobyte-eacad06f-7120-4759-8c99-dbf38b540235" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:20 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-20a6cf8e-3a6c-42c7-8a7b-2101c630e876 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "cinder-quobyte-eacad06f-7120-4759-8c99-dbf38b540235" acquired by "delete_volume" :: waited 0.018s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:20 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2d531b-4bf7-4799-b2ed-dcd3d7c4684f]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-20a6cf8e-3a6c-42c7-8a7b-2101c630e876 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-eacad06f-7120-4759-8c99-dbf38b540235 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:20 devstack sudo[101371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-eacad06f-7120-4759-8c99-dbf38b540235 Jul 07 17:33:20 devstack sudo[101371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:20 devstack sudo[101366]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ab6d49a1-04ea-45f2-a3f5-2b8b5ec7d456 tempest-VolumesGetTest-702217890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a453c894-f60e-40bb-8ab2-48946368b89d" returned: 0 in 0.734s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:20 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ab6d49a1-04ea-45f2-a3f5-2b8b5ec7d456 tempest-VolumesGetTest-702217890 None] Lock "cinder-quobyte-a453c894-f60e-40bb-8ab2-48946368b89d" released by "delete_volume" :: held 1.673s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:20 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-ab6d49a1-04ea-45f2-a3f5-2b8b5ec7d456 tempest-VolumesGetTest-702217890 None] Created reservations ['3ca2aa20-56a3-420c-bdea-f7fdf3ed4a94', '7213a1df-15e6-4318-8fea-33f18b38b433', 'c675bebe-9d84-4f0c-b5b6-5ec835e1e26b', 'ff8fee2a-027e-40e5-912e-a53baee73a2b'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:33:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ab6d49a1-04ea-45f2-a3f5-2b8b5ec7d456 tempest-VolumesGetTest-702217890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ab6d49a1-04ea-45f2-a3f5-2b8b5ec7d456 tempest-VolumesGetTest-702217890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:21 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ab6d49a1-04ea-45f2-a3f5-2b8b5ec7d456 tempest-VolumesGetTest-702217890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:21 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ab6d49a1-04ea-45f2-a3f5-2b8b5ec7d456 tempest-VolumesGetTest-702217890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ab6d49a1-04ea-45f2-a3f5-2b8b5ec7d456 tempest-VolumesGetTest-702217890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ab6d49a1-04ea-45f2-a3f5-2b8b5ec7d456 tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:21 devstack sudo[101376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:33:21 devstack sudo[101376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:21 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f878b4cf-2768-4904-9995-1fd8463539c9 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.805s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:21 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-f878b4cf-2768-4904-9995-1fd8463539c9 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:33:21 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-f878b4cf-2768-4904-9995-1fd8463539c9 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Deleted volume successfully. Jul 07 17:33:21 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-f878b4cf-2768-4904-9995-1fd8463539c9 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "cinder-8975f881-e8c4-442e-8017-d35cae32959f-delete_volume" released by "delete_volume" :: held 2.900s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:21 devstack sudo[101371]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-20a6cf8e-3a6c-42c7-8a7b-2101c630e876 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-eacad06f-7120-4759-8c99-dbf38b540235" returned: 0 in 0.841s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-20a6cf8e-3a6c-42c7-8a7b-2101c630e876 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-eacad06f-7120-4759-8c99-dbf38b540235 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:21 devstack sudo[101388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-eacad06f-7120-4759-8c99-dbf38b540235 Jul 07 17:33:21 devstack sudo[101388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:21 devstack sudo[101376]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ab6d49a1-04ea-45f2-a3f5-2b8b5ec7d456 tempest-VolumesGetTest-702217890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.721s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:21 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-ab6d49a1-04ea-45f2-a3f5-2b8b5ec7d456 tempest-VolumesGetTest-702217890 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:33:21 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-ab6d49a1-04ea-45f2-a3f5-2b8b5ec7d456 tempest-VolumesGetTest-702217890 None] Deleted volume successfully. Jul 07 17:33:21 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ab6d49a1-04ea-45f2-a3f5-2b8b5ec7d456 tempest-VolumesGetTest-702217890 None] Lock "cinder-a453c894-f60e-40bb-8ab2-48946368b89d-delete_volume" released by "delete_volume" :: held 2.696s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:21 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc1ab2c2-ef33-44f5-b26e-54cc46c1803f tempest-VolumesGetTest-702217890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:33:21 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-cc1ab2c2-ef33-44f5-b26e-54cc46c1803f tempest-VolumesGetTest-702217890 None] Flow 'volume_create_manager' (cca50e1f-39c8-4e21-a276-775279704b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:21 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-cc1ab2c2-ef33-44f5-b26e-54cc46c1803f tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ab9b7f5-f083-4741-aa94-42ab1eaf47c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:21 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-cc1ab2c2-ef33-44f5-b26e-54cc46c1803f tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ab9b7f5-f083-4741-aa94-42ab1eaf47c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-680418382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf096af2-f8ec-408b-8ed5-41f7eb74f38a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9fcad01754d4605a8996d83455e0bf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:22Z,use_quota=True,user_id='e9e20ab6b3574245816d4bd7e981e344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:22 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-cc1ab2c2-ef33-44f5-b26e-54cc46c1803f tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b0a0a73-f646-4414-9ad7-fbb4b8fd4738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:22 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-cc1ab2c2-ef33-44f5-b26e-54cc46c1803f tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b0a0a73-f646-4414-9ad7-fbb4b8fd4738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:22 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-cc1ab2c2-ef33-44f5-b26e-54cc46c1803f tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76788672-de8c-433b-a340-8fcd657a1fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:22 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-cc1ab2c2-ef33-44f5-b26e-54cc46c1803f tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76788672-de8c-433b-a340-8fcd657a1fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf096af2-f8ec-408b-8ed5-41f7eb74f38a', 'volume_name': 'volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:22 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-cc1ab2c2-ef33-44f5-b26e-54cc46c1803f tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfa6d2b1-93ba-48dd-bf1f-fefb73af5a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:22 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-cc1ab2c2-ef33-44f5-b26e-54cc46c1803f tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfa6d2b1-93ba-48dd-bf1f-fefb73af5a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:22 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-cc1ab2c2-ef33-44f5-b26e-54cc46c1803f tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01cb97d1-badb-46a6-8e13-cb716c7c15fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:22 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-cc1ab2c2-ef33-44f5-b26e-54cc46c1803f tempest-VolumesGetTest-702217890 None] Volume cf096af2-f8ec-408b-8ed5-41f7eb74f38a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a', 'volume_size': 1} Jul 07 17:33:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-cc1ab2c2-ef33-44f5-b26e-54cc46c1803f tempest-VolumesGetTest-702217890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-cc1ab2c2-ef33-44f5-b26e-54cc46c1803f tempest-VolumesGetTest-702217890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:22 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-cc1ab2c2-ef33-44f5-b26e-54cc46c1803f tempest-VolumesGetTest-702217890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-680418382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf096af2-f8ec-408b-8ed5-41f7eb74f38a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9fcad01754d4605a8996d83455e0bf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:22Z,use_quota=True,user_id='e9e20ab6b3574245816d4bd7e981e344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:33:22 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-cc1ab2c2-ef33-44f5-b26e-54cc46c1803f tempest-VolumesGetTest-702217890 None] Creating volume cf096af2-f8ec-408b-8ed5-41f7eb74f38a {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:33:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-cc1ab2c2-ef33-44f5-b26e-54cc46c1803f tempest-VolumesGetTest-702217890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-cc1ab2c2-ef33-44f5-b26e-54cc46c1803f tempest-VolumesGetTest-702217890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:22 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-cc1ab2c2-ef33-44f5-b26e-54cc46c1803f tempest-VolumesGetTest-702217890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:22 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-cc1ab2c2-ef33-44f5-b26e-54cc46c1803f tempest-VolumesGetTest-702217890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-cc1ab2c2-ef33-44f5-b26e-54cc46c1803f tempest-VolumesGetTest-702217890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:22 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-cc1ab2c2-ef33-44f5-b26e-54cc46c1803f tempest-VolumesGetTest-702217890 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:33:22 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-cc1ab2c2-ef33-44f5-b26e-54cc46c1803f tempest-VolumesGetTest-702217890 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:33:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-cc1ab2c2-ef33-44f5-b26e-54cc46c1803f tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:22 devstack sudo[101391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a 1073741824 Jul 07 17:33:22 devstack sudo[101391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:22 devstack sudo[101388]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-20a6cf8e-3a6c-42c7-8a7b-2101c630e876 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-eacad06f-7120-4759-8c99-dbf38b540235" returned: 0 in 0.719s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:22 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-20a6cf8e-3a6c-42c7-8a7b-2101c630e876 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "cinder-quobyte-eacad06f-7120-4759-8c99-dbf38b540235" released by "delete_volume" :: held 1.608s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:22 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-20a6cf8e-3a6c-42c7-8a7b-2101c630e876 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Created reservations ['a900c273-bbbf-4f17-9fc7-4dbfe66ea609', 'f17d70c2-85f9-4d21-96f9-f93f5ed8a016', 'afbd2aa5-4638-4143-b104-46c35644c90c', 'c48b9413-439e-47c8-9dc3-be0be7bc036d'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:33:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-20a6cf8e-3a6c-42c7-8a7b-2101c630e876 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-20a6cf8e-3a6c-42c7-8a7b-2101c630e876 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:22 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-20a6cf8e-3a6c-42c7-8a7b-2101c630e876 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:22 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-20a6cf8e-3a6c-42c7-8a7b-2101c630e876 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-20a6cf8e-3a6c-42c7-8a7b-2101c630e876 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-20a6cf8e-3a6c-42c7-8a7b-2101c630e876 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:22 devstack sudo[101394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:33:22 devstack sudo[101394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:22 devstack sudo[101391]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-cc1ab2c2-ef33-44f5-b26e-54cc46c1803f tempest-VolumesGetTest-702217890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a 1073741824" returned: 0 in 0.910s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-cc1ab2c2-ef33-44f5-b26e-54cc46c1803f tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:23 devstack sudo[101399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a Jul 07 17:33:23 devstack sudo[101399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:23 devstack sudo[101394]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-20a6cf8e-3a6c-42c7-8a7b-2101c630e876 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.765s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:23 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-20a6cf8e-3a6c-42c7-8a7b-2101c630e876 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:33:23 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-20a6cf8e-3a6c-42c7-8a7b-2101c630e876 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Deleted volume successfully. Jul 07 17:33:23 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-20a6cf8e-3a6c-42c7-8a7b-2101c630e876 tempest-CreateVolumesFromSourceVolumeTest-999225787 None] Lock "cinder-eacad06f-7120-4759-8c99-dbf38b540235-delete_volume" released by "delete_volume" :: held 2.619s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:23 devstack sudo[101399]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-cc1ab2c2-ef33-44f5-b26e-54cc46c1803f tempest-VolumesGetTest-702217890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a" returned: 0 in 0.703s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:23 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-cc1ab2c2-ef33-44f5-b26e-54cc46c1803f tempest-VolumesGetTest-702217890 None] <== create_volume: return (1666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:33:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-cc1ab2c2-ef33-44f5-b26e-54cc46c1803f tempest-VolumesGetTest-702217890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.670s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:23 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-cc1ab2c2-ef33-44f5-b26e-54cc46c1803f tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01cb97d1-badb-46a6-8e13-cb716c7c15fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:23 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-cc1ab2c2-ef33-44f5-b26e-54cc46c1803f tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a15f0c0-302b-46f6-97e7-4c7c97208eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:23 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-cc1ab2c2-ef33-44f5-b26e-54cc46c1803f tempest-VolumesGetTest-702217890 None] Volume volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a (cf096af2-f8ec-408b-8ed5-41f7eb74f38a): created successfully Jul 07 17:33:23 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-cc1ab2c2-ef33-44f5-b26e-54cc46c1803f tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a15f0c0-302b-46f6-97e7-4c7c97208eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:23 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-cc1ab2c2-ef33-44f5-b26e-54cc46c1803f tempest-VolumesGetTest-702217890 None] Flow 'volume_create_manager' (cca50e1f-39c8-4e21-a276-775279704b0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:23 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-cc1ab2c2-ef33-44f5-b26e-54cc46c1803f tempest-VolumesGetTest-702217890 None] Created volume successfully. Jul 07 17:33:24 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:33:24 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Flow 'volume_create_manager' (5816f96b-1dda-46b8-81fd-404345eea809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:24 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54144ed2-bb91-4868-9041-25d2f355d768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:24 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54144ed2-bb91-4868-9041-25d2f355d768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-143564069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1bbcba9-0c2f-41b3-8a3c-a42725524497,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f9fcad01754d4605a8996d83455e0bf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=cf096af2-f8ec-408b-8ed5-41f7eb74f38a,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:25Z,use_quota=True,user_id='e9e20ab6b3574245816d4bd7e981e344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:24 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31444502-cc3e-4ceb-aa64-8341e28a8a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:24 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31444502-cc3e-4ceb-aa64-8341e28a8a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:24 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (474d3b71-ecdf-49e5-a9bd-3535e208de7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:24 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (474d3b71-ecdf-49e5-a9bd-3535e208de7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f1bbcba9-0c2f-41b3-8a3c-a42725524497', 'volume_name': 'volume-f1bbcba9-0c2f-41b3-8a3c-a42725524497', 'volume_size': 1, 'source_volid': 'cf096af2-f8ec-408b-8ed5-41f7eb74f38a', 'source_volstatus': 'available'}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:24 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91650788-f8be-4ee8-97c2-4268c398b32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:24 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91650788-f8be-4ee8-97c2-4268c398b32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:24 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ffa016c-6cdb-4d3b-9172-bd4120fcfb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:24 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Volume f1bbcba9-0c2f-41b3-8a3c-a42725524497: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f1bbcba9-0c2f-41b3-8a3c-a42725524497', 'volume_size': 1, 'source_volid': 'cf096af2-f8ec-408b-8ed5-41f7eb74f38a', 'source_volstatus': 'available'} Jul 07 17:33:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:24 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Cloning volume cf096af2-f8ec-408b-8ed5-41f7eb74f38a to volume f1bbcba9-0c2f-41b3-8a3c-a42725524497 Jul 07 17:33:24 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Creating offline snapshot 074b346e-6710-452c-9e78-7fa4262f2a52 of volume cf096af2-f8ec-408b-8ed5-41f7eb74f38a {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:33:24 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[877e5f51-aba7-42df-b38d-d190d38bd335]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:24 devstack sudo[101405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a Jul 07 17:33:24 devstack sudo[101405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:25 devstack sudo[101405]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a" returned: 0 in 0.860s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a.074b346e-6710-452c-9e78-7fa4262f2a52 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:25 devstack sudo[101411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a.074b346e-6710-452c-9e78-7fa4262f2a52 1G Jul 07 17:33:25 devstack sudo[101411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:26 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-9087eecb-4d18-4c2c-92d0-7294a008fc47 tempest-CinderUnicodeTest-1182530120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:33:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-9087eecb-4d18-4c2c-92d0-7294a008fc47 tempest-CinderUnicodeTest-1182530120 None] Flow 'volume_create_manager' (87a5182a-7f2c-49ab-a8f7-701de88c0535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-9087eecb-4d18-4c2c-92d0-7294a008fc47 tempest-CinderUnicodeTest-1182530120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afb4e864-26df-44b6-9f20-d08c320041fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-9087eecb-4d18-4c2c-92d0-7294a008fc47 tempest-CinderUnicodeTest-1182530120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afb4e864-26df-44b6-9f20-d08c320041fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e36c0aa5-6ed0-4069-9a48-58c6ea693337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da7371c6f5fa422ab239335d7818c609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:26Z,use_quota=True,user_id='bc4ce41ca62048baadc8d0c2cd53a142',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-9087eecb-4d18-4c2c-92d0-7294a008fc47 tempest-CinderUnicodeTest-1182530120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f6f11f-6ed6-4dca-87e7-aac2f557923c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-9087eecb-4d18-4c2c-92d0-7294a008fc47 tempest-CinderUnicodeTest-1182530120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f6f11f-6ed6-4dca-87e7-aac2f557923c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-9087eecb-4d18-4c2c-92d0-7294a008fc47 tempest-CinderUnicodeTest-1182530120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8948d0c9-9faf-407a-a192-39eb9f47caba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-9087eecb-4d18-4c2c-92d0-7294a008fc47 tempest-CinderUnicodeTest-1182530120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8948d0c9-9faf-407a-a192-39eb9f47caba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e36c0aa5-6ed0-4069-9a48-58c6ea693337', 'volume_name': 'volume-e36c0aa5-6ed0-4069-9a48-58c6ea693337', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-9087eecb-4d18-4c2c-92d0-7294a008fc47 tempest-CinderUnicodeTest-1182530120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7cd4b98-4a5f-4bc5-b27c-5adfae614276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-9087eecb-4d18-4c2c-92d0-7294a008fc47 tempest-CinderUnicodeTest-1182530120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7cd4b98-4a5f-4bc5-b27c-5adfae614276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:26 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-9087eecb-4d18-4c2c-92d0-7294a008fc47 tempest-CinderUnicodeTest-1182530120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7f89238-a221-4fbc-a59b-2e2493940242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:26 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-9087eecb-4d18-4c2c-92d0-7294a008fc47 tempest-CinderUnicodeTest-1182530120 None] Volume e36c0aa5-6ed0-4069-9a48-58c6ea693337: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e36c0aa5-6ed0-4069-9a48-58c6ea693337', 'volume_size': 1} Jul 07 17:33:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9087eecb-4d18-4c2c-92d0-7294a008fc47 tempest-CinderUnicodeTest-1182530120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:26 devstack sudo[101411]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a.074b346e-6710-452c-9e78-7fa4262f2a52 1G" returned: 0 in 0.914s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a.074b346e-6710-452c-9e78-7fa4262f2a52 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:26 devstack sudo[101416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a.074b346e-6710-452c-9e78-7fa4262f2a52 Jul 07 17:33:26 devstack sudo[101416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:27 devstack sudo[101416]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a.074b346e-6710-452c-9e78-7fa4262f2a52" returned: 0 in 0.687s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:27 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a.074b346e-6710-452c-9e78-7fa4262f2a52 is being set with open permissions: ugo+rw Jul 07 17:33:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a.074b346e-6710-452c-9e78-7fa4262f2a52 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:27 devstack sudo[101422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a.074b346e-6710-452c-9e78-7fa4262f2a52 Jul 07 17:33:27 devstack sudo[101422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:27 devstack sudo[101422]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a.074b346e-6710-452c-9e78-7fa4262f2a52" returned: 0 in 0.716s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:27 devstack sudo[101492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a.info Jul 07 17:33:28 devstack sudo[101492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:28 devstack sudo[101492]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a.info" returned: 0 in 0.642s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:28 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a.info is being set with open permissions: ugo+rw Jul 07 17:33:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:28 devstack sudo[101495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a.info Jul 07 17:33:28 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:29 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a.info" returned: 0 in 0.835s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:29 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Acquiring lock "cinder-quobyte-f1bbcba9-0c2f-41b3-8a3c-a42725524497" by "_copy_volume_from_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:29 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Lock "cinder-quobyte-f1bbcba9-0c2f-41b3-8a3c-a42725524497" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:29 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] snapshot: 074b346e-6710-452c-9e78-7fa4262f2a52, volume: f1bbcba9-0c2f-41b3-8a3c-a42725524497, {{(pid=87233) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 17:33:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:29 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:29 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:29 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a65dd1-1e3a-42be-b004-bee787b1acd8]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a.074b346e-6710-452c-9e78-7fa4262f2a52 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:29 devstack sudo[101541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a.074b346e-6710-452c-9e78-7fa4262f2a52 Jul 07 17:33:29 devstack sudo[101541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:30 devstack sudo[101541]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a.074b346e-6710-452c-9e78-7fa4262f2a52" returned: 0 in 0.804s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:30 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:33:30 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] will copy from snapshot at /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a {{(pid=87233) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 17:33:30 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Creating direct copy from snapshot {{(pid=87233) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 17:33:30 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08b14d4-9e44-4bdd-bfb4-fd14a900e8c8]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:30 devstack sudo[101550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a Jul 07 17:33:30 devstack sudo[101550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:31 devstack sudo[101550]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a" returned: 0 in 0.795s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:31 devstack cinder-volume[87233]: DEBUG cinder.utils [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Path /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f1bbcba9-0c2f-41b3-8a3c-a42725524497 not found in is_blk_device check {{(pid=87233) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 17:33:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f1bbcba9-0c2f-41b3-8a3c-a42725524497 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:31 devstack sudo[101885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f1bbcba9-0c2f-41b3-8a3c-a42725524497 Jul 07 17:33:31 devstack sudo[101885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:37 devstack sudo[101885]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f1bbcba9-0c2f-41b3-8a3c-a42725524497" returned: 0 in 6.293s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:37 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[243a08b5-015d-4ede-93ed-dd18329e824e]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:37 devstack sudo[101900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a Jul 07 17:33:37 devstack sudo[101900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:37 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:SELECT=82,cinder:INSERT=25,cinder:UPDATE=130,cinder:DELETE=11 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:33:37 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:SELECT=93,cinder:INSERT=32,cinder:UPDATE=116,cinder:DELETE=11 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:33:38 devstack sudo[101900]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a" returned: 0 in 1.020s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:38 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Image conversion details: src /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a, size 1024.00 MB, duration 6.29 sec, destination /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f1bbcba9-0c2f-41b3-8a3c-a42725524497 {{(pid=87233) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:33:38 devstack cinder-volume[87233]: INFO cinder.image.image_utils [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Converted 1024.00 MB image at 162.68 MB/s Jul 07 17:33:38 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f1bbcba9-0c2f-41b3-8a3c-a42725524497 is being set with open permissions: ugo+rw Jul 07 17:33:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f1bbcba9-0c2f-41b3-8a3c-a42725524497 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:38 devstack sudo[101905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f1bbcba9-0c2f-41b3-8a3c-a42725524497 Jul 07 17:33:38 devstack sudo[101905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:39 devstack sudo[101905]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f1bbcba9-0c2f-41b3-8a3c-a42725524497" returned: 0 in 0.626s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:39 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Lock "cinder-quobyte-f1bbcba9-0c2f-41b3-8a3c-a42725524497" released by "_copy_volume_from_snapshot" :: held 9.658s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:39 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Acquiring lock "cinder-quobyte-074b346e-6710-452c-9e78-7fa4262f2a52" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:39 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Lock "cinder-quobyte-074b346e-6710-452c-9e78-7fa4262f2a52" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:39 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Deleting offline snapshot 074b346e-6710-452c-9e78-7fa4262f2a52 of volume cf096af2-f8ec-408b-8ed5-41f7eb74f38a {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:33:39 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] snapshot_file for this snap is: volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a.074b346e-6710-452c-9e78-7fa4262f2a52 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:33:39 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0587cd2a-47aa-4713-9c49-30e534846b01]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a.074b346e-6710-452c-9e78-7fa4262f2a52 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:39 devstack sudo[101908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a.074b346e-6710-452c-9e78-7fa4262f2a52 Jul 07 17:33:39 devstack sudo[101908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:40 devstack sudo[101908]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a.074b346e-6710-452c-9e78-7fa4262f2a52" returned: 0 in 0.783s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:40 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:33:40 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[607bb166-d4e5-42a8-b5c6-de9998975239]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:40 devstack sudo[101913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a Jul 07 17:33:40 devstack sudo[101913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:40 devstack sudo[101913]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a" returned: 0 in 0.780s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a.074b346e-6710-452c-9e78-7fa4262f2a52 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:40 devstack sudo[101919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a.074b346e-6710-452c-9e78-7fa4262f2a52 Jul 07 17:33:40 devstack sudo[101919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:41 devstack sudo[101919]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a.074b346e-6710-452c-9e78-7fa4262f2a52" returned: 0 in 0.769s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a.074b346e-6710-452c-9e78-7fa4262f2a52 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:41 devstack sudo[101924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a.074b346e-6710-452c-9e78-7fa4262f2a52 Jul 07 17:33:41 devstack sudo[101924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:42 devstack sudo[101924]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a.074b346e-6710-452c-9e78-7fa4262f2a52" returned: 0 in 0.674s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:42 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Lock "cinder-quobyte-074b346e-6710-452c-9e78-7fa4262f2a52" released by "_delete_snapshot" :: held 3.100s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.640s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9087eecb-4d18-4c2c-92d0-7294a008fc47 tempest-CinderUnicodeTest-1182530120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.094s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:42 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-9087eecb-4d18-4c2c-92d0-7294a008fc47 tempest-CinderUnicodeTest-1182530120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e36c0aa5-6ed0-4069-9a48-58c6ea693337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da7371c6f5fa422ab239335d7818c609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:26Z,use_quota=True,user_id='bc4ce41ca62048baadc8d0c2cd53a142',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:33:42 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-9087eecb-4d18-4c2c-92d0-7294a008fc47 tempest-CinderUnicodeTest-1182530120 None] Creating volume e36c0aa5-6ed0-4069-9a48-58c6ea693337 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:33:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9087eecb-4d18-4c2c-92d0-7294a008fc47 tempest-CinderUnicodeTest-1182530120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9087eecb-4d18-4c2c-92d0-7294a008fc47 tempest-CinderUnicodeTest-1182530120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:42 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-9087eecb-4d18-4c2c-92d0-7294a008fc47 tempest-CinderUnicodeTest-1182530120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:42 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-9087eecb-4d18-4c2c-92d0-7294a008fc47 tempest-CinderUnicodeTest-1182530120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9087eecb-4d18-4c2c-92d0-7294a008fc47 tempest-CinderUnicodeTest-1182530120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:42 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-9087eecb-4d18-4c2c-92d0-7294a008fc47 tempest-CinderUnicodeTest-1182530120 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:33:42 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-9087eecb-4d18-4c2c-92d0-7294a008fc47 tempest-CinderUnicodeTest-1182530120 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:33:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9087eecb-4d18-4c2c-92d0-7294a008fc47 tempest-CinderUnicodeTest-1182530120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e36c0aa5-6ed0-4069-9a48-58c6ea693337 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:42 devstack sudo[101927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e36c0aa5-6ed0-4069-9a48-58c6ea693337 1073741824 Jul 07 17:33:42 devstack sudo[101927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:42 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ffa016c-6cdb-4d3b-9172-bd4120fcfb1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1bbcba9-0c2f-41b3-8a3c-a42725524497', 'volume_size': 1, 'source_volid': 'cf096af2-f8ec-408b-8ed5-41f7eb74f38a', 'source_volstatus': 'available'}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:42 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fc5d66f-a286-45b9-8e43-88b7a401282a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:42 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Volume volume-f1bbcba9-0c2f-41b3-8a3c-a42725524497 (f1bbcba9-0c2f-41b3-8a3c-a42725524497): created successfully Jul 07 17:33:42 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fc5d66f-a286-45b9-8e43-88b7a401282a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:42 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Flow 'volume_create_manager' (5816f96b-1dda-46b8-81fd-404345eea809) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:42 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-8c888e2a-3c5c-4397-83eb-9a2290b03589 tempest-VolumesGetTest-702217890 None] Created volume successfully. Jul 07 17:33:43 devstack sudo[101927]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9087eecb-4d18-4c2c-92d0-7294a008fc47 tempest-CinderUnicodeTest-1182530120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e36c0aa5-6ed0-4069-9a48-58c6ea693337 1073741824" returned: 0 in 0.826s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9087eecb-4d18-4c2c-92d0-7294a008fc47 tempest-CinderUnicodeTest-1182530120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e36c0aa5-6ed0-4069-9a48-58c6ea693337 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:43 devstack sudo[101932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e36c0aa5-6ed0-4069-9a48-58c6ea693337 Jul 07 17:33:43 devstack sudo[101932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:43 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:33:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:43 devstack sudo[101934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:33:43 devstack sudo[101934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:44 devstack sudo[101932]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9087eecb-4d18-4c2c-92d0-7294a008fc47 tempest-CinderUnicodeTest-1182530120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e36c0aa5-6ed0-4069-9a48-58c6ea693337" returned: 0 in 0.784s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:44 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-9087eecb-4d18-4c2c-92d0-7294a008fc47 tempest-CinderUnicodeTest-1182530120 None] <== create_volume: return (1658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:33:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9087eecb-4d18-4c2c-92d0-7294a008fc47 tempest-CinderUnicodeTest-1182530120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.665s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-9087eecb-4d18-4c2c-92d0-7294a008fc47 tempest-CinderUnicodeTest-1182530120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7f89238-a221-4fbc-a59b-2e2493940242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e36c0aa5-6ed0-4069-9a48-58c6ea693337', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-9087eecb-4d18-4c2c-92d0-7294a008fc47 tempest-CinderUnicodeTest-1182530120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36bf7c6e-63f8-4545-8c64-6c146f09d05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:44 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-9087eecb-4d18-4c2c-92d0-7294a008fc47 tempest-CinderUnicodeTest-1182530120 None] Volume volume-e36c0aa5-6ed0-4069-9a48-58c6ea693337 (e36c0aa5-6ed0-4069-9a48-58c6ea693337): created successfully Jul 07 17:33:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-9087eecb-4d18-4c2c-92d0-7294a008fc47 tempest-CinderUnicodeTest-1182530120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36bf7c6e-63f8-4545-8c64-6c146f09d05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-9087eecb-4d18-4c2c-92d0-7294a008fc47 tempest-CinderUnicodeTest-1182530120 None] Flow 'volume_create_manager' (87a5182a-7f2c-49ab-a8f7-701de88c0535) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:44 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-9087eecb-4d18-4c2c-92d0-7294a008fc47 tempest-CinderUnicodeTest-1182530120 None] Created volume successfully. Jul 07 17:33:44 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-64f7b703-252e-40e0-a66e-40dc5dd884bc tempest-VolumesGetTest-702217890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:33:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-64f7b703-252e-40e0-a66e-40dc5dd884bc tempest-VolumesGetTest-702217890 None] Flow 'volume_create_manager' (64639edd-27f8-4424-b48d-499a08bd137b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-64f7b703-252e-40e0-a66e-40dc5dd884bc tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aec9e024-ac9a-403a-ae12-ff56bbf9c170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-64f7b703-252e-40e0-a66e-40dc5dd884bc tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aec9e024-ac9a-403a-ae12-ff56bbf9c170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:33:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2098445213',display_name='tempest-VolumesGetTest-Volume-1228083834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9ea3e91-b852-46f9-bf40-21329804598d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9fcad01754d4605a8996d83455e0bf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:44Z,use_quota=True,user_id='e9e20ab6b3574245816d4bd7e981e344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-64f7b703-252e-40e0-a66e-40dc5dd884bc tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb14e42d-bb4a-4a38-b9ad-503baf6f3499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-64f7b703-252e-40e0-a66e-40dc5dd884bc tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb14e42d-bb4a-4a38-b9ad-503baf6f3499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-64f7b703-252e-40e0-a66e-40dc5dd884bc tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79d4dee8-a8c9-4cf1-b48d-25a8c6c8fb1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-64f7b703-252e-40e0-a66e-40dc5dd884bc tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79d4dee8-a8c9-4cf1-b48d-25a8c6c8fb1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9ea3e91-b852-46f9-bf40-21329804598d', 'volume_name': 'volume-e9ea3e91-b852-46f9-bf40-21329804598d', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-64f7b703-252e-40e0-a66e-40dc5dd884bc tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ee263f8-6fe4-4cc4-9382-394dadd3dacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-64f7b703-252e-40e0-a66e-40dc5dd884bc tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ee263f8-6fe4-4cc4-9382-394dadd3dacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-64f7b703-252e-40e0-a66e-40dc5dd884bc tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7059df63-fffd-427c-805d-1925f97823ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:44 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-64f7b703-252e-40e0-a66e-40dc5dd884bc tempest-VolumesGetTest-702217890 None] Volume e9ea3e91-b852-46f9-bf40-21329804598d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9ea3e91-b852-46f9-bf40-21329804598d', 'volume_size': 1} Jul 07 17:33:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-64f7b703-252e-40e0-a66e-40dc5dd884bc tempest-VolumesGetTest-702217890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-64f7b703-252e-40e0-a66e-40dc5dd884bc tempest-VolumesGetTest-702217890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:44 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-64f7b703-252e-40e0-a66e-40dc5dd884bc tempest-VolumesGetTest-702217890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:33:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2098445213',display_name='tempest-VolumesGetTest-Volume-1228083834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9ea3e91-b852-46f9-bf40-21329804598d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9fcad01754d4605a8996d83455e0bf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:44Z,use_quota=True,user_id='e9e20ab6b3574245816d4bd7e981e344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:33:44 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-64f7b703-252e-40e0-a66e-40dc5dd884bc tempest-VolumesGetTest-702217890 None] Creating volume e9ea3e91-b852-46f9-bf40-21329804598d {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:33:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-64f7b703-252e-40e0-a66e-40dc5dd884bc tempest-VolumesGetTest-702217890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-64f7b703-252e-40e0-a66e-40dc5dd884bc tempest-VolumesGetTest-702217890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:44 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-64f7b703-252e-40e0-a66e-40dc5dd884bc tempest-VolumesGetTest-702217890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:44 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-64f7b703-252e-40e0-a66e-40dc5dd884bc tempest-VolumesGetTest-702217890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-64f7b703-252e-40e0-a66e-40dc5dd884bc tempest-VolumesGetTest-702217890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:44 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-64f7b703-252e-40e0-a66e-40dc5dd884bc tempest-VolumesGetTest-702217890 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:33:44 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-64f7b703-252e-40e0-a66e-40dc5dd884bc tempest-VolumesGetTest-702217890 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:33:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-64f7b703-252e-40e0-a66e-40dc5dd884bc tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e9ea3e91-b852-46f9-bf40-21329804598d 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:44 devstack sudo[101938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e9ea3e91-b852-46f9-bf40-21329804598d 1073741824 Jul 07 17:33:44 devstack sudo[101938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:44 devstack sudo[101934]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.969s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:44 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:33:44 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:33:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread count: 28 {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:33:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread info: [<_MainThread(MainThread, started 126077716062336)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:33:45 devstack sudo[101938]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-64f7b703-252e-40e0-a66e-40dc5dd884bc tempest-VolumesGetTest-702217890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e9ea3e91-b852-46f9-bf40-21329804598d 1073741824" returned: 0 in 0.938s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-64f7b703-252e-40e0-a66e-40dc5dd884bc tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e9ea3e91-b852-46f9-bf40-21329804598d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:45 devstack sudo[101944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e9ea3e91-b852-46f9-bf40-21329804598d Jul 07 17:33:45 devstack sudo[101944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:45 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-b65770b6-a6c9-41aa-840d-9079ae1c6f64 tempest-CinderUnicodeTest-1182530120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:33:45 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b65770b6-a6c9-41aa-840d-9079ae1c6f64 tempest-CinderUnicodeTest-1182530120 None] Flow 'volume_create_manager' (84a58d16-ed3b-4182-878f-c46837bd031f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:45 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b65770b6-a6c9-41aa-840d-9079ae1c6f64 tempest-CinderUnicodeTest-1182530120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bfd8b4a-3eb6-49c1-b3a6-8ce01e1569bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:45 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b65770b6-a6c9-41aa-840d-9079ae1c6f64 tempest-CinderUnicodeTest-1182530120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bfd8b4a-3eb6-49c1-b3a6-8ce01e1569bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:33:45Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-512004755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=970ba218-2404-4f7c-b2b9-2ca53aaf6516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da7371c6f5fa422ab239335d7818c609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:46Z,use_quota=True,user_id='bc4ce41ca62048baadc8d0c2cd53a142',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:45 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b65770b6-a6c9-41aa-840d-9079ae1c6f64 tempest-CinderUnicodeTest-1182530120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce23f4ce-5ec0-4634-941a-b1d8a7964868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:45 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b65770b6-a6c9-41aa-840d-9079ae1c6f64 tempest-CinderUnicodeTest-1182530120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce23f4ce-5ec0-4634-941a-b1d8a7964868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:45 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b65770b6-a6c9-41aa-840d-9079ae1c6f64 tempest-CinderUnicodeTest-1182530120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90317c4f-2fd3-46b8-8610-4bc3faeb14e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:45 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b65770b6-a6c9-41aa-840d-9079ae1c6f64 tempest-CinderUnicodeTest-1182530120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90317c4f-2fd3-46b8-8610-4bc3faeb14e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '970ba218-2404-4f7c-b2b9-2ca53aaf6516', 'volume_name': 'volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:45 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b65770b6-a6c9-41aa-840d-9079ae1c6f64 tempest-CinderUnicodeTest-1182530120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (275901d9-d9e9-4cfc-84f3-c079699ed9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:45 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b65770b6-a6c9-41aa-840d-9079ae1c6f64 tempest-CinderUnicodeTest-1182530120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (275901d9-d9e9-4cfc-84f3-c079699ed9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:45 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b65770b6-a6c9-41aa-840d-9079ae1c6f64 tempest-CinderUnicodeTest-1182530120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (174a133d-a094-40a1-9c0e-93747291c7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:45 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-b65770b6-a6c9-41aa-840d-9079ae1c6f64 tempest-CinderUnicodeTest-1182530120 None] Volume 970ba218-2404-4f7c-b2b9-2ca53aaf6516: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516', 'volume_size': 1} Jul 07 17:33:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b65770b6-a6c9-41aa-840d-9079ae1c6f64 tempest-CinderUnicodeTest-1182530120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:45 devstack sudo[101944]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-64f7b703-252e-40e0-a66e-40dc5dd884bc tempest-VolumesGetTest-702217890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e9ea3e91-b852-46f9-bf40-21329804598d" returned: 0 in 0.688s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:45 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-64f7b703-252e-40e0-a66e-40dc5dd884bc tempest-VolumesGetTest-702217890 None] <== create_volume: return (1678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:33:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-64f7b703-252e-40e0-a66e-40dc5dd884bc tempest-VolumesGetTest-702217890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.681s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b65770b6-a6c9-41aa-840d-9079ae1c6f64 tempest-CinderUnicodeTest-1182530120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.321s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:45 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b65770b6-a6c9-41aa-840d-9079ae1c6f64 tempest-CinderUnicodeTest-1182530120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:33:45Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-512004755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=970ba218-2404-4f7c-b2b9-2ca53aaf6516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da7371c6f5fa422ab239335d7818c609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:46Z,use_quota=True,user_id='bc4ce41ca62048baadc8d0c2cd53a142',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:33:45 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-b65770b6-a6c9-41aa-840d-9079ae1c6f64 tempest-CinderUnicodeTest-1182530120 None] Creating volume 970ba218-2404-4f7c-b2b9-2ca53aaf6516 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:33:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b65770b6-a6c9-41aa-840d-9079ae1c6f64 tempest-CinderUnicodeTest-1182530120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b65770b6-a6c9-41aa-840d-9079ae1c6f64 tempest-CinderUnicodeTest-1182530120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:45 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b65770b6-a6c9-41aa-840d-9079ae1c6f64 tempest-CinderUnicodeTest-1182530120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:45 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b65770b6-a6c9-41aa-840d-9079ae1c6f64 tempest-CinderUnicodeTest-1182530120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b65770b6-a6c9-41aa-840d-9079ae1c6f64 tempest-CinderUnicodeTest-1182530120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:45 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b65770b6-a6c9-41aa-840d-9079ae1c6f64 tempest-CinderUnicodeTest-1182530120 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:33:45 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-b65770b6-a6c9-41aa-840d-9079ae1c6f64 tempest-CinderUnicodeTest-1182530120 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:33:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b65770b6-a6c9-41aa-840d-9079ae1c6f64 tempest-CinderUnicodeTest-1182530120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:46 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-64f7b703-252e-40e0-a66e-40dc5dd884bc tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7059df63-fffd-427c-805d-1925f97823ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9ea3e91-b852-46f9-bf40-21329804598d', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:46 devstack sudo[101947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516 1073741824 Jul 07 17:33:46 devstack sudo[101947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:46 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-64f7b703-252e-40e0-a66e-40dc5dd884bc tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59935d5c-1f61-492b-935f-a4c841dee514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:46 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-64f7b703-252e-40e0-a66e-40dc5dd884bc tempest-VolumesGetTest-702217890 None] Volume volume-e9ea3e91-b852-46f9-bf40-21329804598d (e9ea3e91-b852-46f9-bf40-21329804598d): created successfully Jul 07 17:33:46 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-64f7b703-252e-40e0-a66e-40dc5dd884bc tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59935d5c-1f61-492b-935f-a4c841dee514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:46 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-64f7b703-252e-40e0-a66e-40dc5dd884bc tempest-VolumesGetTest-702217890 None] Flow 'volume_create_manager' (64639edd-27f8-4424-b48d-499a08bd137b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:46 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-64f7b703-252e-40e0-a66e-40dc5dd884bc tempest-VolumesGetTest-702217890 None] Created volume successfully. Jul 07 17:33:46 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-7ce4e4d6-a7a7-4e67-b867-6f0739cb07d2 tempest-VolumesGetTest-702217890 None] Acquiring lock "cinder-e9ea3e91-b852-46f9-bf40-21329804598d-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:46 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-7ce4e4d6-a7a7-4e67-b867-6f0739cb07d2 tempest-VolumesGetTest-702217890 None] Lock "cinder-e9ea3e91-b852-46f9-bf40-21329804598d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:46 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-7ce4e4d6-a7a7-4e67-b867-6f0739cb07d2 tempest-VolumesGetTest-702217890 None] Acquiring lock "cinder-quobyte-e9ea3e91-b852-46f9-bf40-21329804598d" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:46 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-7ce4e4d6-a7a7-4e67-b867-6f0739cb07d2 tempest-VolumesGetTest-702217890 None] Lock "cinder-quobyte-e9ea3e91-b852-46f9-bf40-21329804598d" acquired by "delete_volume" :: waited 0.034s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:46 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c85fbe-9e3a-4cda-9524-5aed2103dd24]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7ce4e4d6-a7a7-4e67-b867-6f0739cb07d2 tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e9ea3e91-b852-46f9-bf40-21329804598d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:46 devstack sudo[101951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e9ea3e91-b852-46f9-bf40-21329804598d Jul 07 17:33:46 devstack sudo[101951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:46 devstack sudo[101947]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b65770b6-a6c9-41aa-840d-9079ae1c6f64 tempest-CinderUnicodeTest-1182530120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516 1073741824" returned: 0 in 0.905s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b65770b6-a6c9-41aa-840d-9079ae1c6f64 tempest-CinderUnicodeTest-1182530120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:46 devstack sudo[101954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516 Jul 07 17:33:46 devstack sudo[101954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:47 devstack sudo[101951]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7ce4e4d6-a7a7-4e67-b867-6f0739cb07d2 tempest-VolumesGetTest-702217890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e9ea3e91-b852-46f9-bf40-21329804598d" returned: 0 in 0.857s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7ce4e4d6-a7a7-4e67-b867-6f0739cb07d2 tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e9ea3e91-b852-46f9-bf40-21329804598d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:47 devstack sudo[101963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e9ea3e91-b852-46f9-bf40-21329804598d Jul 07 17:33:47 devstack sudo[101963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:47 devstack sudo[101954]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b65770b6-a6c9-41aa-840d-9079ae1c6f64 tempest-CinderUnicodeTest-1182530120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516" returned: 0 in 0.756s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:47 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b65770b6-a6c9-41aa-840d-9079ae1c6f64 tempest-CinderUnicodeTest-1182530120 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:33:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b65770b6-a6c9-41aa-840d-9079ae1c6f64 tempest-CinderUnicodeTest-1182530120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.710s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:47 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b65770b6-a6c9-41aa-840d-9079ae1c6f64 tempest-CinderUnicodeTest-1182530120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (174a133d-a094-40a1-9c0e-93747291c7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:47 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b65770b6-a6c9-41aa-840d-9079ae1c6f64 tempest-CinderUnicodeTest-1182530120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eecfd45d-2bc2-4724-ab64-89287b5ea96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:47 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-b65770b6-a6c9-41aa-840d-9079ae1c6f64 tempest-CinderUnicodeTest-1182530120 None] Volume volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516 (970ba218-2404-4f7c-b2b9-2ca53aaf6516): created successfully Jul 07 17:33:47 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b65770b6-a6c9-41aa-840d-9079ae1c6f64 tempest-CinderUnicodeTest-1182530120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eecfd45d-2bc2-4724-ab64-89287b5ea96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:47 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b65770b6-a6c9-41aa-840d-9079ae1c6f64 tempest-CinderUnicodeTest-1182530120 None] Flow 'volume_create_manager' (84a58d16-ed3b-4182-878f-c46837bd031f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:47 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-b65770b6-a6c9-41aa-840d-9079ae1c6f64 tempest-CinderUnicodeTest-1182530120 None] Created volume successfully. Jul 07 17:33:48 devstack sudo[101963]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7ce4e4d6-a7a7-4e67-b867-6f0739cb07d2 tempest-VolumesGetTest-702217890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e9ea3e91-b852-46f9-bf40-21329804598d" returned: 0 in 0.803s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:48 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-7ce4e4d6-a7a7-4e67-b867-6f0739cb07d2 tempest-VolumesGetTest-702217890 None] Lock "cinder-quobyte-e9ea3e91-b852-46f9-bf40-21329804598d" released by "delete_volume" :: held 1.728s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:48 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-7ce4e4d6-a7a7-4e67-b867-6f0739cb07d2 tempest-VolumesGetTest-702217890 None] Created reservations ['41b34ec4-66cc-4ee3-88b0-58a4bf7c9213', '83b510a3-30cc-4d71-ac15-0bf757959c8e', '3b0c5dde-25a0-4660-a20c-3fa623da4f52', '9a80fb5c-bc87-45e8-9a5a-3daf15eaef8b'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:33:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-7ce4e4d6-a7a7-4e67-b867-6f0739cb07d2 tempest-VolumesGetTest-702217890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-7ce4e4d6-a7a7-4e67-b867-6f0739cb07d2 tempest-VolumesGetTest-702217890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:48 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-7ce4e4d6-a7a7-4e67-b867-6f0739cb07d2 tempest-VolumesGetTest-702217890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:48 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-7ce4e4d6-a7a7-4e67-b867-6f0739cb07d2 tempest-VolumesGetTest-702217890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-7ce4e4d6-a7a7-4e67-b867-6f0739cb07d2 tempest-VolumesGetTest-702217890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7ce4e4d6-a7a7-4e67-b867-6f0739cb07d2 tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:48 devstack sudo[101992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:33:48 devstack sudo[101992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:48 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-8df6ead8-aa5b-4012-b5c6-743e23a5f260 tempest-VolumesGetTest-702217890 None] Acquiring lock "cinder-f1bbcba9-0c2f-41b3-8a3c-a42725524497-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:48 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-8df6ead8-aa5b-4012-b5c6-743e23a5f260 tempest-VolumesGetTest-702217890 None] Lock "cinder-f1bbcba9-0c2f-41b3-8a3c-a42725524497-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:48 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-8df6ead8-aa5b-4012-b5c6-743e23a5f260 tempest-VolumesGetTest-702217890 None] Acquiring lock "cinder-quobyte-f1bbcba9-0c2f-41b3-8a3c-a42725524497" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:48 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-8df6ead8-aa5b-4012-b5c6-743e23a5f260 tempest-VolumesGetTest-702217890 None] Lock "cinder-quobyte-f1bbcba9-0c2f-41b3-8a3c-a42725524497" acquired by "delete_volume" :: waited 0.025s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:48 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d88651-2058-4742-b396-4870b6c2cd0b]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8df6ead8-aa5b-4012-b5c6-743e23a5f260 tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f1bbcba9-0c2f-41b3-8a3c-a42725524497 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:49 devstack sudo[101992]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7ce4e4d6-a7a7-4e67-b867-6f0739cb07d2 tempest-VolumesGetTest-702217890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.695s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:49 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-7ce4e4d6-a7a7-4e67-b867-6f0739cb07d2 tempest-VolumesGetTest-702217890 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:33:49 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-7ce4e4d6-a7a7-4e67-b867-6f0739cb07d2 tempest-VolumesGetTest-702217890 None] Deleted volume successfully. Jul 07 17:33:49 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-7ce4e4d6-a7a7-4e67-b867-6f0739cb07d2 tempest-VolumesGetTest-702217890 None] Lock "cinder-e9ea3e91-b852-46f9-bf40-21329804598d-delete_volume" released by "delete_volume" :: held 2.685s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:49 devstack sudo[101995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f1bbcba9-0c2f-41b3-8a3c-a42725524497 Jul 07 17:33:49 devstack sudo[101995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ebc0113b-4311-4028-930c-5e93d88964f6 tempest-CinderUnicodeTest-1182530120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ebc0113b-4311-4028-930c-5e93d88964f6 tempest-CinderUnicodeTest-1182530120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:49 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-ebc0113b-4311-4028-930c-5e93d88964f6 tempest-CinderUnicodeTest-1182530120 None] Creating offline snapshot 93d6d148-2bb2-4b99-9112-a0808e474305 of volume 970ba218-2404-4f7c-b2b9-2ca53aaf6516 {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:33:49 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a75359-0129-4010-ae0a-b63b5030ab52]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ebc0113b-4311-4028-930c-5e93d88964f6 tempest-CinderUnicodeTest-1182530120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:49 devstack sudo[101997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516 Jul 07 17:33:49 devstack sudo[101997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:49 devstack sudo[101995]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8df6ead8-aa5b-4012-b5c6-743e23a5f260 tempest-VolumesGetTest-702217890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f1bbcba9-0c2f-41b3-8a3c-a42725524497" returned: 0 in 0.881s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8df6ead8-aa5b-4012-b5c6-743e23a5f260 tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f1bbcba9-0c2f-41b3-8a3c-a42725524497 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:49 devstack sudo[102002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f1bbcba9-0c2f-41b3-8a3c-a42725524497 Jul 07 17:33:49 devstack sudo[102002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:50 devstack sudo[101997]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ebc0113b-4311-4028-930c-5e93d88964f6 tempest-CinderUnicodeTest-1182530120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516" returned: 0 in 0.833s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ebc0113b-4311-4028-930c-5e93d88964f6 tempest-CinderUnicodeTest-1182530120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516.93d6d148-2bb2-4b99-9112-a0808e474305 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:50 devstack sudo[102007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516.93d6d148-2bb2-4b99-9112-a0808e474305 1G Jul 07 17:33:50 devstack sudo[102007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:50 devstack sudo[102002]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8df6ead8-aa5b-4012-b5c6-743e23a5f260 tempest-VolumesGetTest-702217890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f1bbcba9-0c2f-41b3-8a3c-a42725524497" returned: 0 in 0.650s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:50 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-8df6ead8-aa5b-4012-b5c6-743e23a5f260 tempest-VolumesGetTest-702217890 None] Lock "cinder-quobyte-f1bbcba9-0c2f-41b3-8a3c-a42725524497" released by "delete_volume" :: held 1.580s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:50 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-8df6ead8-aa5b-4012-b5c6-743e23a5f260 tempest-VolumesGetTest-702217890 None] Created reservations ['64ffd0b7-8bf1-428c-b9ef-b4b276cd2fee', 'f83b9e09-2e51-4c61-bad7-55a82cdbc15e', '4392933e-ac3a-4e17-ab23-62b718fe0451', '89c274ae-d4f1-4278-9d1c-811395374f78'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:33:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-8df6ead8-aa5b-4012-b5c6-743e23a5f260 tempest-VolumesGetTest-702217890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-8df6ead8-aa5b-4012-b5c6-743e23a5f260 tempest-VolumesGetTest-702217890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:50 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-8df6ead8-aa5b-4012-b5c6-743e23a5f260 tempest-VolumesGetTest-702217890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:50 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-8df6ead8-aa5b-4012-b5c6-743e23a5f260 tempest-VolumesGetTest-702217890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-8df6ead8-aa5b-4012-b5c6-743e23a5f260 tempest-VolumesGetTest-702217890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8df6ead8-aa5b-4012-b5c6-743e23a5f260 tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:50 devstack sudo[102014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:33:50 devstack sudo[102014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:50 devstack sudo[102007]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ebc0113b-4311-4028-930c-5e93d88964f6 tempest-CinderUnicodeTest-1182530120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516.93d6d148-2bb2-4b99-9112-a0808e474305 1G" returned: 0 in 0.811s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ebc0113b-4311-4028-930c-5e93d88964f6 tempest-CinderUnicodeTest-1182530120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516.93d6d148-2bb2-4b99-9112-a0808e474305 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:50 devstack sudo[102017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516.93d6d148-2bb2-4b99-9112-a0808e474305 Jul 07 17:33:50 devstack sudo[102017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:51 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-180d025c-f66d-4d01-9c39-07958e04f93b tempest-VolumesGetTest-702217890 None] Acquiring lock "cinder-cf096af2-f8ec-408b-8ed5-41f7eb74f38a-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:51 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-180d025c-f66d-4d01-9c39-07958e04f93b tempest-VolumesGetTest-702217890 None] Lock "cinder-cf096af2-f8ec-408b-8ed5-41f7eb74f38a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:51 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-180d025c-f66d-4d01-9c39-07958e04f93b tempest-VolumesGetTest-702217890 None] Acquiring lock "cinder-quobyte-cf096af2-f8ec-408b-8ed5-41f7eb74f38a" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:51 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-180d025c-f66d-4d01-9c39-07958e04f93b tempest-VolumesGetTest-702217890 None] Lock "cinder-quobyte-cf096af2-f8ec-408b-8ed5-41f7eb74f38a" acquired by "delete_volume" :: waited 0.019s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:51 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e933e9-ffb1-4c83-8bba-484757e5d1ab]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-180d025c-f66d-4d01-9c39-07958e04f93b tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:51 devstack sudo[102014]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8df6ead8-aa5b-4012-b5c6-743e23a5f260 tempest-VolumesGetTest-702217890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.726s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:51 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-8df6ead8-aa5b-4012-b5c6-743e23a5f260 tempest-VolumesGetTest-702217890 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:33:51 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-8df6ead8-aa5b-4012-b5c6-743e23a5f260 tempest-VolumesGetTest-702217890 None] Deleted volume successfully. Jul 07 17:33:51 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-8df6ead8-aa5b-4012-b5c6-743e23a5f260 tempest-VolumesGetTest-702217890 None] Lock "cinder-f1bbcba9-0c2f-41b3-8a3c-a42725524497-delete_volume" released by "delete_volume" :: held 2.536s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:51 devstack sudo[102020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a Jul 07 17:33:51 devstack sudo[102020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:51 devstack sudo[102017]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ebc0113b-4311-4028-930c-5e93d88964f6 tempest-CinderUnicodeTest-1182530120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516.93d6d148-2bb2-4b99-9112-a0808e474305" returned: 0 in 0.802s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:51 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-ebc0113b-4311-4028-930c-5e93d88964f6 tempest-CinderUnicodeTest-1182530120 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516.93d6d148-2bb2-4b99-9112-a0808e474305 is being set with open permissions: ugo+rw Jul 07 17:33:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ebc0113b-4311-4028-930c-5e93d88964f6 tempest-CinderUnicodeTest-1182530120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516.93d6d148-2bb2-4b99-9112-a0808e474305 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:51 devstack sudo[102025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516.93d6d148-2bb2-4b99-9112-a0808e474305 Jul 07 17:33:51 devstack sudo[102025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:52 devstack sudo[102020]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-180d025c-f66d-4d01-9c39-07958e04f93b tempest-VolumesGetTest-702217890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a" returned: 0 in 0.778s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-180d025c-f66d-4d01-9c39-07958e04f93b tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:52 devstack sudo[102030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a Jul 07 17:33:52 devstack sudo[102030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:52 devstack sudo[102025]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ebc0113b-4311-4028-930c-5e93d88964f6 tempest-CinderUnicodeTest-1182530120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516.93d6d148-2bb2-4b99-9112-a0808e474305" returned: 0 in 0.716s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ebc0113b-4311-4028-930c-5e93d88964f6 tempest-CinderUnicodeTest-1182530120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:52 devstack sudo[102033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516.info Jul 07 17:33:52 devstack sudo[102033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:52 devstack sudo[102030]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-180d025c-f66d-4d01-9c39-07958e04f93b tempest-VolumesGetTest-702217890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf096af2-f8ec-408b-8ed5-41f7eb74f38a" returned: 0 in 0.697s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:52 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-180d025c-f66d-4d01-9c39-07958e04f93b tempest-VolumesGetTest-702217890 None] Lock "cinder-quobyte-cf096af2-f8ec-408b-8ed5-41f7eb74f38a" released by "delete_volume" :: held 1.561s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:52 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-180d025c-f66d-4d01-9c39-07958e04f93b tempest-VolumesGetTest-702217890 None] Created reservations ['e341f0d3-6955-47e9-bdcf-26f84ed5f043', 'bc1a4443-c4a1-4cdf-93d4-110a591cd778', '758bfc0c-3b92-4ac7-bcd9-b429dec1ab15', '7b039d5a-bc7d-4953-9b72-302181c44774'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:33:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-180d025c-f66d-4d01-9c39-07958e04f93b tempest-VolumesGetTest-702217890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-180d025c-f66d-4d01-9c39-07958e04f93b tempest-VolumesGetTest-702217890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:52 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-180d025c-f66d-4d01-9c39-07958e04f93b tempest-VolumesGetTest-702217890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:52 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-180d025c-f66d-4d01-9c39-07958e04f93b tempest-VolumesGetTest-702217890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-180d025c-f66d-4d01-9c39-07958e04f93b tempest-VolumesGetTest-702217890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-180d025c-f66d-4d01-9c39-07958e04f93b tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:53 devstack sudo[102036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:33:53 devstack sudo[102036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:53 devstack sudo[102033]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ebc0113b-4311-4028-930c-5e93d88964f6 tempest-CinderUnicodeTest-1182530120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516.info" returned: 0 in 0.708s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:53 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-ebc0113b-4311-4028-930c-5e93d88964f6 tempest-CinderUnicodeTest-1182530120 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516.info is being set with open permissions: ugo+rw Jul 07 17:33:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ebc0113b-4311-4028-930c-5e93d88964f6 tempest-CinderUnicodeTest-1182530120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:53 devstack sudo[102039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516.info Jul 07 17:33:53 devstack sudo[102039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:53 devstack sudo[102036]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-180d025c-f66d-4d01-9c39-07958e04f93b tempest-VolumesGetTest-702217890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.659s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:53 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-180d025c-f66d-4d01-9c39-07958e04f93b tempest-VolumesGetTest-702217890 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:33:53 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-180d025c-f66d-4d01-9c39-07958e04f93b tempest-VolumesGetTest-702217890 None] Deleted volume successfully. Jul 07 17:33:53 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-180d025c-f66d-4d01-9c39-07958e04f93b tempest-VolumesGetTest-702217890 None] Lock "cinder-cf096af2-f8ec-408b-8ed5-41f7eb74f38a-delete_volume" released by "delete_volume" :: held 2.465s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:53 devstack sudo[102039]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ebc0113b-4311-4028-930c-5e93d88964f6 tempest-CinderUnicodeTest-1182530120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516.info" returned: 0 in 0.668s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ebc0113b-4311-4028-930c-5e93d88964f6 tempest-CinderUnicodeTest-1182530120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.627s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:53 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-ebc0113b-4311-4028-930c-5e93d88964f6 tempest-CinderUnicodeTest-1182530120 None] Create snapshot completed successfully Jul 07 17:33:54 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:33:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Flow 'volume_create_manager' (55e79dcc-ade3-4785-9f8a-fe95f5ec02f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ce72bd5-7b01-4d5d-bf18-c1766a8805f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ce72bd5-7b01-4d5d-bf18-c1766a8805f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2071885563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b44cf3ff-64c7-423f-ba40-0da4c3226795,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f9fcad01754d4605a8996d83455e0bf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:54Z,use_quota=True,user_id='e9e20ab6b3574245816d4bd7e981e344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62ecbd89-51b5-4b3f-b9b9-2386b8e141bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62ecbd89-51b5-4b3f-b9b9-2386b8e141bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8db280e6-5113-4af9-8720-09d6ded983ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:54 devstack cinder-volume[87233]: DEBUG cinder.image.glance [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Creating Keystone auth plugin from conf {{(pid=87233) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 17:33:54 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-68d67fe8-f731-4ee8-a59c-aa6a62868cdc tempest-CinderUnicodeTest-1182530120 None] Acquiring lock "cinder-93d6d148-2bb2-4b99-9112-a0808e474305-delete_snapshot" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:54 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-68d67fe8-f731-4ee8-a59c-aa6a62868cdc tempest-CinderUnicodeTest-1182530120 None] Lock "cinder-93d6d148-2bb2-4b99-9112-a0808e474305-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:54 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-68d67fe8-f731-4ee8-a59c-aa6a62868cdc tempest-CinderUnicodeTest-1182530120 None] Acquiring lock "cinder-quobyte-970ba218-2404-4f7c-b2b9-2ca53aaf6516" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:54 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-68d67fe8-f731-4ee8-a59c-aa6a62868cdc tempest-CinderUnicodeTest-1182530120 None] Lock "cinder-quobyte-970ba218-2404-4f7c-b2b9-2ca53aaf6516" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:54 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-68d67fe8-f731-4ee8-a59c-aa6a62868cdc tempest-CinderUnicodeTest-1182530120 None] Acquiring lock "cinder-quobyte-93d6d148-2bb2-4b99-9112-a0808e474305" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:54 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-68d67fe8-f731-4ee8-a59c-aa6a62868cdc tempest-CinderUnicodeTest-1182530120 None] Lock "cinder-quobyte-93d6d148-2bb2-4b99-9112-a0808e474305" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:54 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-68d67fe8-f731-4ee8-a59c-aa6a62868cdc tempest-CinderUnicodeTest-1182530120 None] Deleting offline snapshot 93d6d148-2bb2-4b99-9112-a0808e474305 of volume 970ba218-2404-4f7c-b2b9-2ca53aaf6516 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:33:54 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-68d67fe8-f731-4ee8-a59c-aa6a62868cdc tempest-CinderUnicodeTest-1182530120 None] snapshot_file for this snap is: volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516.93d6d148-2bb2-4b99-9112-a0808e474305 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:33:54 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[282e852c-f5da-49bf-92cf-19a908cbb0ed]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-68d67fe8-f731-4ee8-a59c-aa6a62868cdc tempest-CinderUnicodeTest-1182530120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516.93d6d148-2bb2-4b99-9112-a0808e474305 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8db280e6-5113-4af9-8720-09d6ded983ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b44cf3ff-64c7-423f-ba40-0da4c3226795', 'volume_name': 'volume-b44cf3ff-64c7-423f-ba40-0da4c3226795', 'volume_size': 1, 'image_id': '0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ed2f318bab304b78b69744376e93ea0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'created_at': datetime.datetime(2026, 7, 7, 15, 11, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 11, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e7aa8bb-335b-45a2-aabb-4dc50188f189/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:54 devstack sudo[102044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516.93d6d148-2bb2-4b99-9112-a0808e474305 Jul 07 17:33:54 devstack sudo[102044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (789a5385-3e77-4796-b71c-2ef2cfa4f549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (789a5385-3e77-4796-b71c-2ef2cfa4f549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0c3597d-8240-4f7c-87aa-9ac4301d7e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:54 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Volume b44cf3ff-64c7-423f-ba40-0da4c3226795: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b44cf3ff-64c7-423f-ba40-0da4c3226795', 'volume_size': 1, 'image_id': '0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ed2f318bab304b78b69744376e93ea0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'created_at': datetime.datetime(2026, 7, 7, 15, 11, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 11, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e7aa8bb-335b-45a2-aabb-4dc50188f189/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 17:33:54 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Trying to clone b44cf3ff-64c7-423f-ba40-0da4c3226795 from image 0e7aa8bb-335b-45a2-aabb-4dc50188f189 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'metadata': {}}]). {{(pid=87233) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 17:33:55 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_30u6y8x_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87233) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 17:33:55 devstack cinder-volume[87233]: INFO cinder.image.image_utils [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Image download 20.69 MB at 20.69 MB/s Jul 07 17:33:55 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed7ac96-f17b-4410-b9b0-138dc56f3bcd]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_30u6y8x_devstack@QuobyteHD {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:55 devstack sudo[102047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_30u6y8x_devstack@QuobyteHD Jul 07 17:33:55 devstack sudo[102047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:55 devstack sudo[102044]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-68d67fe8-f731-4ee8-a59c-aa6a62868cdc tempest-CinderUnicodeTest-1182530120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516.93d6d148-2bb2-4b99-9112-a0808e474305" returned: 0 in 0.887s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:55 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-68d67fe8-f731-4ee8-a59c-aa6a62868cdc tempest-CinderUnicodeTest-1182530120 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:33:55 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a157df-f5e5-4dbb-b3c9-a598890129c9]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-68d67fe8-f731-4ee8-a59c-aa6a62868cdc tempest-CinderUnicodeTest-1182530120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:55 devstack sudo[102053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516 Jul 07 17:33:55 devstack sudo[102053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:55 devstack sudo[102047]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_30u6y8x_devstack@QuobyteHD" returned: 0 in 0.785s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:55 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Temporary image 0e7aa8bb-335b-45a2-aabb-4dc50188f189 is fetched for user e9e20ab6b3574245816d4bd7e981e344. {{(pid=87233) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 17:33:55 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2c1e07-6efb-4949-be47-96d04d24752f]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_30u6y8x_devstack@QuobyteHD {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:56 devstack sudo[102058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_30u6y8x_devstack@QuobyteHD Jul 07 17:33:56 devstack sudo[102058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:56 devstack sudo[102053]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-68d67fe8-f731-4ee8-a59c-aa6a62868cdc tempest-CinderUnicodeTest-1182530120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516" returned: 0 in 0.945s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-68d67fe8-f731-4ee8-a59c-aa6a62868cdc tempest-CinderUnicodeTest-1182530120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516.93d6d148-2bb2-4b99-9112-a0808e474305 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:56 devstack sudo[102063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516.93d6d148-2bb2-4b99-9112-a0808e474305 Jul 07 17:33:56 devstack sudo[102063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:56 devstack sudo[102058]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_30u6y8x_devstack@QuobyteHD" returned: 0 in 0.835s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:56 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2071885563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b44cf3ff-64c7-423f-ba40-0da4c3226795,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f9fcad01754d4605a8996d83455e0bf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:54Z,use_quota=True,user_id='e9e20ab6b3574245816d4bd7e981e344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:33:56 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Creating volume b44cf3ff-64c7-423f-ba40-0da4c3226795 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:33:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:56 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:56 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:56 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:33:56 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:33:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b44cf3ff-64c7-423f-ba40-0da4c3226795 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:56 devstack sudo[102068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b44cf3ff-64c7-423f-ba40-0da4c3226795 1073741824 Jul 07 17:33:56 devstack sudo[102068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:57 devstack sudo[102063]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-68d67fe8-f731-4ee8-a59c-aa6a62868cdc tempest-CinderUnicodeTest-1182530120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516.93d6d148-2bb2-4b99-9112-a0808e474305" returned: 0 in 0.827s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-68d67fe8-f731-4ee8-a59c-aa6a62868cdc tempest-CinderUnicodeTest-1182530120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516.93d6d148-2bb2-4b99-9112-a0808e474305 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:57 devstack sudo[102073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516.93d6d148-2bb2-4b99-9112-a0808e474305 Jul 07 17:33:57 devstack sudo[102073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:57 devstack sudo[102068]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b44cf3ff-64c7-423f-ba40-0da4c3226795 1073741824" returned: 0 in 0.915s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b44cf3ff-64c7-423f-ba40-0da4c3226795 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:57 devstack sudo[102078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b44cf3ff-64c7-423f-ba40-0da4c3226795 Jul 07 17:33:57 devstack sudo[102078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:57 devstack sudo[102073]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-68d67fe8-f731-4ee8-a59c-aa6a62868cdc tempest-CinderUnicodeTest-1182530120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516.93d6d148-2bb2-4b99-9112-a0808e474305" returned: 0 in 0.691s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:57 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-68d67fe8-f731-4ee8-a59c-aa6a62868cdc tempest-CinderUnicodeTest-1182530120 None] Lock "cinder-quobyte-93d6d148-2bb2-4b99-9112-a0808e474305" released by "_delete_snapshot" :: held 3.487s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:57 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-68d67fe8-f731-4ee8-a59c-aa6a62868cdc tempest-CinderUnicodeTest-1182530120 None] Lock "cinder-quobyte-970ba218-2404-4f7c-b2b9-2ca53aaf6516" released by "delete_snapshot" :: held 3.517s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:58 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-68d67fe8-f731-4ee8-a59c-aa6a62868cdc tempest-CinderUnicodeTest-1182530120 None] Created reservations ['6b5a1127-7739-48c9-b6d1-252fb412a948', '04bd7c21-aa35-4afa-be67-9e0ebe452ffb', '7981b8b5-8122-4684-a40a-bd164ef82a4a', '3d5e9deb-1041-4c5b-ad4d-312754cde9a4'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:33:58 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-68d67fe8-f731-4ee8-a59c-aa6a62868cdc tempest-CinderUnicodeTest-1182530120 None] Delete snapshot completed successfully. Jul 07 17:33:58 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-68d67fe8-f731-4ee8-a59c-aa6a62868cdc tempest-CinderUnicodeTest-1182530120 None] Lock "cinder-93d6d148-2bb2-4b99-9112-a0808e474305-delete_snapshot" released by "delete_snapshot" :: held 3.661s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:58 devstack sudo[102078]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b44cf3ff-64c7-423f-ba40-0da4c3226795" returned: 0 in 0.664s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:58 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:33:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:58 devstack cinder-volume[87233]: DEBUG cinder.volume.volume_utils [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Attempting download of 0e7aa8bb-335b-45a2-aabb-4dc50188f189 ((None, [{'url': 'file:///opt/stack/data/glance/images/0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'metadata': {}}])) to volume b44cf3ff-64c7-423f-ba40-0da4c3226795. {{(pid=87233) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 17:33:58 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf1b1b1-ddaf-42df-9b81-dc80b31113f9]: (4, 'raw') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e7aa8bb-335b-45a2-aabb-4dc50188f189_y59j36qq {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:58 devstack sudo[102083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e7aa8bb-335b-45a2-aabb-4dc50188f189_y59j36qq Jul 07 17:33:58 devstack sudo[102083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:58 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a9954789-90a8-4b65-96be-1416fbf63175 tempest-CinderUnicodeTest-1182530120 None] Acquiring lock "cinder-970ba218-2404-4f7c-b2b9-2ca53aaf6516-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:58 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a9954789-90a8-4b65-96be-1416fbf63175 tempest-CinderUnicodeTest-1182530120 None] Lock "cinder-970ba218-2404-4f7c-b2b9-2ca53aaf6516-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:58 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a9954789-90a8-4b65-96be-1416fbf63175 tempest-CinderUnicodeTest-1182530120 None] Acquiring lock "cinder-quobyte-970ba218-2404-4f7c-b2b9-2ca53aaf6516" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:58 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a9954789-90a8-4b65-96be-1416fbf63175 tempest-CinderUnicodeTest-1182530120 None] Lock "cinder-quobyte-970ba218-2404-4f7c-b2b9-2ca53aaf6516" acquired by "delete_volume" :: waited 0.019s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:58 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8b1882-06c5-4e8f-a115-3aad6c831585]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a9954789-90a8-4b65-96be-1416fbf63175 tempest-CinderUnicodeTest-1182530120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:58 devstack sudo[102085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516 Jul 07 17:33:58 devstack sudo[102085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:59 devstack sudo[102083]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e7aa8bb-335b-45a2-aabb-4dc50188f189_y59j36qq" returned: 0 in 0.775s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e7aa8bb-335b-45a2-aabb-4dc50188f189_y59j36qq {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:59 devstack sudo[102089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e7aa8bb-335b-45a2-aabb-4dc50188f189_y59j36qq Jul 07 17:33:59 devstack sudo[102089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:59 devstack sudo[102085]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a9954789-90a8-4b65-96be-1416fbf63175 tempest-CinderUnicodeTest-1182530120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516" returned: 0 in 0.875s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a9954789-90a8-4b65-96be-1416fbf63175 tempest-CinderUnicodeTest-1182530120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:59 devstack sudo[102094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516 Jul 07 17:33:59 devstack sudo[102094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:00 devstack sudo[102089]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e7aa8bb-335b-45a2-aabb-4dc50188f189_y59j36qq" returned: 1 in 0.751s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e7aa8bb-335b-45a2-aabb-4dc50188f189_y59j36qq' failed. Not Retrying. {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:34:00 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d66b75-5da7-400b-ba64-1105a216d3e1]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_30u6y8x_devstack@QuobyteHD {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:00 devstack sudo[102098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_30u6y8x_devstack@QuobyteHD Jul 07 17:34:00 devstack sudo[102098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:00 devstack sudo[102094]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a9954789-90a8-4b65-96be-1416fbf63175 tempest-CinderUnicodeTest-1182530120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-970ba218-2404-4f7c-b2b9-2ca53aaf6516" returned: 0 in 0.733s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:00 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a9954789-90a8-4b65-96be-1416fbf63175 tempest-CinderUnicodeTest-1182530120 None] Lock "cinder-quobyte-970ba218-2404-4f7c-b2b9-2ca53aaf6516" released by "delete_volume" :: held 1.674s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:00 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-a9954789-90a8-4b65-96be-1416fbf63175 tempest-CinderUnicodeTest-1182530120 None] Created reservations ['7554502e-3d3f-43b2-9275-05e0910e76b1', '4dfdb3d5-4353-4520-9c9b-8f0682d2e21b', '4c2b2b2b-f5aa-49f8-aacb-b542c0e682db', 'dc5dca72-e152-4cb2-9bc2-50047e39f0a7'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:34:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a9954789-90a8-4b65-96be-1416fbf63175 tempest-CinderUnicodeTest-1182530120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a9954789-90a8-4b65-96be-1416fbf63175 tempest-CinderUnicodeTest-1182530120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:00 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-a9954789-90a8-4b65-96be-1416fbf63175 tempest-CinderUnicodeTest-1182530120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:00 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-a9954789-90a8-4b65-96be-1416fbf63175 tempest-CinderUnicodeTest-1182530120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a9954789-90a8-4b65-96be-1416fbf63175 tempest-CinderUnicodeTest-1182530120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a9954789-90a8-4b65-96be-1416fbf63175 tempest-CinderUnicodeTest-1182530120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:00 devstack sudo[102102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:34:00 devstack sudo[102102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:00 devstack sudo[102098]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_30u6y8x_devstack@QuobyteHD" returned: 0 in 0.838s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:00 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] 0e7aa8bb-335b-45a2-aabb-4dc50188f189 was qcow2, converting to raw {{(pid=87233) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 17:34:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_30u6y8x_devstack@QuobyteHD /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b44cf3ff-64c7-423f-ba40-0da4c3226795 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:00 devstack sudo[102107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_30u6y8x_devstack@QuobyteHD /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b44cf3ff-64c7-423f-ba40-0da4c3226795 Jul 07 17:34:00 devstack sudo[102107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:00 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-45e84e53-ac23-43d3-83ee-597e8c3322a2 tempest-CinderUnicodeTest-1182530120 None] Acquiring lock "cinder-e36c0aa5-6ed0-4069-9a48-58c6ea693337-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:00 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-45e84e53-ac23-43d3-83ee-597e8c3322a2 tempest-CinderUnicodeTest-1182530120 None] Lock "cinder-e36c0aa5-6ed0-4069-9a48-58c6ea693337-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:01 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-45e84e53-ac23-43d3-83ee-597e8c3322a2 tempest-CinderUnicodeTest-1182530120 None] Acquiring lock "cinder-quobyte-e36c0aa5-6ed0-4069-9a48-58c6ea693337" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:01 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-45e84e53-ac23-43d3-83ee-597e8c3322a2 tempest-CinderUnicodeTest-1182530120 None] Lock "cinder-quobyte-e36c0aa5-6ed0-4069-9a48-58c6ea693337" acquired by "delete_volume" :: waited 0.023s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:01 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed04551-9c8f-4b94-bdef-9053430efed8]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-45e84e53-ac23-43d3-83ee-597e8c3322a2 tempest-CinderUnicodeTest-1182530120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e36c0aa5-6ed0-4069-9a48-58c6ea693337 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:01 devstack sudo[102109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e36c0aa5-6ed0-4069-9a48-58c6ea693337 Jul 07 17:34:01 devstack sudo[102109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:01 devstack sudo[102102]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a9954789-90a8-4b65-96be-1416fbf63175 tempest-CinderUnicodeTest-1182530120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.771s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:01 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-a9954789-90a8-4b65-96be-1416fbf63175 tempest-CinderUnicodeTest-1182530120 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:34:01 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-a9954789-90a8-4b65-96be-1416fbf63175 tempest-CinderUnicodeTest-1182530120 None] Deleted volume successfully. Jul 07 17:34:01 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a9954789-90a8-4b65-96be-1416fbf63175 tempest-CinderUnicodeTest-1182530120 None] Lock "cinder-970ba218-2404-4f7c-b2b9-2ca53aaf6516-delete_volume" released by "delete_volume" :: held 2.728s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:02 devstack sudo[102109]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-45e84e53-ac23-43d3-83ee-597e8c3322a2 tempest-CinderUnicodeTest-1182530120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e36c0aa5-6ed0-4069-9a48-58c6ea693337" returned: 0 in 0.938s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-45e84e53-ac23-43d3-83ee-597e8c3322a2 tempest-CinderUnicodeTest-1182530120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e36c0aa5-6ed0-4069-9a48-58c6ea693337 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:02 devstack sudo[102124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e36c0aa5-6ed0-4069-9a48-58c6ea693337 Jul 07 17:34:02 devstack sudo[102124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:02 devstack sudo[102124]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-45e84e53-ac23-43d3-83ee-597e8c3322a2 tempest-CinderUnicodeTest-1182530120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e36c0aa5-6ed0-4069-9a48-58c6ea693337" returned: 0 in 0.758s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:02 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-45e84e53-ac23-43d3-83ee-597e8c3322a2 tempest-CinderUnicodeTest-1182530120 None] Lock "cinder-quobyte-e36c0aa5-6ed0-4069-9a48-58c6ea693337" released by "delete_volume" :: held 1.763s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:02 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-45e84e53-ac23-43d3-83ee-597e8c3322a2 tempest-CinderUnicodeTest-1182530120 None] Created reservations ['37390a72-76fa-4bfa-9c22-d2033a69a0b6', '1d08b38f-0d4d-46a0-b3f9-e99d5ebe673f', 'fc52cf68-fd02-4b78-b0e1-0ec6efa0a80f', 'bdf97546-4263-4b8e-a1b8-04df3446186c'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:34:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-45e84e53-ac23-43d3-83ee-597e8c3322a2 tempest-CinderUnicodeTest-1182530120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-45e84e53-ac23-43d3-83ee-597e8c3322a2 tempest-CinderUnicodeTest-1182530120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:02 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-45e84e53-ac23-43d3-83ee-597e8c3322a2 tempest-CinderUnicodeTest-1182530120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:02 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-45e84e53-ac23-43d3-83ee-597e8c3322a2 tempest-CinderUnicodeTest-1182530120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-45e84e53-ac23-43d3-83ee-597e8c3322a2 tempest-CinderUnicodeTest-1182530120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-45e84e53-ac23-43d3-83ee-597e8c3322a2 tempest-CinderUnicodeTest-1182530120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:03 devstack sudo[102127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:34:03 devstack sudo[102127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:03 devstack sudo[102107]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_30u6y8x_devstack@QuobyteHD /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b44cf3ff-64c7-423f-ba40-0da4c3226795" returned: 0 in 2.231s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:03 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0e7aa8bb-335b-45a2-aabb-4dc50188f189_30u6y8x_devstack@QuobyteHD, size 112.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b44cf3ff-64c7-423f-ba40-0da4c3226795 {{(pid=87233) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:34:03 devstack cinder-volume[87233]: INFO cinder.image.image_utils [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Converted 112.00 MB image at 50.17 MB/s Jul 07 17:34:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b44cf3ff-64c7-423f-ba40-0da4c3226795 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:03 devstack sudo[102129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b44cf3ff-64c7-423f-ba40-0da4c3226795 1G Jul 07 17:34:03 devstack sudo[102129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:03 devstack sudo[102127]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-45e84e53-ac23-43d3-83ee-597e8c3322a2 tempest-CinderUnicodeTest-1182530120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.760s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:03 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-45e84e53-ac23-43d3-83ee-597e8c3322a2 tempest-CinderUnicodeTest-1182530120 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:34:03 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-45e84e53-ac23-43d3-83ee-597e8c3322a2 tempest-CinderUnicodeTest-1182530120 None] Deleted volume successfully. Jul 07 17:34:03 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-45e84e53-ac23-43d3-83ee-597e8c3322a2 tempest-CinderUnicodeTest-1182530120 None] Lock "cinder-e36c0aa5-6ed0-4069-9a48-58c6ea693337-delete_volume" released by "delete_volume" :: held 2.781s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:03 devstack sudo[102129]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b44cf3ff-64c7-423f-ba40-0da4c3226795 1G" returned: 0 in 0.814s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:04 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c74b7a-0d3d-41d7-af47-a898ba4f739b]: (4, 'raw') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b44cf3ff-64c7-423f-ba40-0da4c3226795 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:04 devstack sudo[102136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b44cf3ff-64c7-423f-ba40-0da4c3226795 Jul 07 17:34:04 devstack sudo[102136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:04 devstack sudo[102136]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b44cf3ff-64c7-423f-ba40-0da4c3226795" returned: 0 in 0.907s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b44cf3ff-64c7-423f-ba40-0da4c3226795 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:05 devstack sudo[102140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b44cf3ff-64c7-423f-ba40-0da4c3226795 Jul 07 17:34:05 devstack sudo[102140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:05 devstack sudo[102140]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b44cf3ff-64c7-423f-ba40-0da4c3226795" returned: 1 in 0.829s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b44cf3ff-64c7-423f-ba40-0da4c3226795' failed. Not Retrying. {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:34:05 devstack cinder-volume[87233]: DEBUG cinder.volume.volume_utils [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Downloaded image 0e7aa8bb-335b-45a2-aabb-4dc50188f189 ((None, [{'url': 'file:///opt/stack/data/glance/images/0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'metadata': {}}])) to volume b44cf3ff-64c7-423f-ba40-0da4c3226795 successfully. {{(pid=87233) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 17:34:05 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Temporary image 0e7aa8bb-335b-45a2-aabb-4dc50188f189 for user e9e20ab6b3574245816d4bd7e981e344 is deleted. {{(pid=87233) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 17:34:05 devstack cinder-volume[87233]: DEBUG cinder.volume.volume_utils [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Marking volume b44cf3ff-64c7-423f-ba40-0da4c3226795 as bootable. {{(pid=87233) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 17:34:05 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Copying metadata from image 0e7aa8bb-335b-45a2-aabb-4dc50188f189 to b44cf3ff-64c7-423f-ba40-0da4c3226795. {{(pid=87233) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 17:34:05 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Creating volume glance metadata for volume b44cf3ff-64c7-423f-ba40-0da4c3226795 backed by image 0e7aa8bb-335b-45a2-aabb-4dc50188f189 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87233) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 17:34:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0c3597d-8240-4f7c-87aa-9ac4301d7e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b44cf3ff-64c7-423f-ba40-0da4c3226795', 'volume_size': 1, 'image_id': '0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ed2f318bab304b78b69744376e93ea0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0e7aa8bb-335b-45a2-aabb-4dc50188f189', 'created_at': datetime.datetime(2026, 7, 7, 15, 11, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 11, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e7aa8bb-335b-45a2-aabb-4dc50188f189/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c09d07-cc72-485f-bbd4-fca1860ccd21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:05 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Volume volume-b44cf3ff-64c7-423f-ba40-0da4c3226795 (b44cf3ff-64c7-423f-ba40-0da4c3226795): created successfully Jul 07 17:34:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c09d07-cc72-485f-bbd4-fca1860ccd21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Flow 'volume_create_manager' (55e79dcc-ade3-4785-9f8a-fe95f5ec02f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:05 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-d370be83-db84-4f1d-a96d-dfe0d30217c1 tempest-VolumesGetTest-702217890 None] Created volume successfully. Jul 07 17:34:06 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8fd8270-f770-4bcf-bce8-16626f4feea2 tempest-VolumesGetTest-702217890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:34:06 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d8fd8270-f770-4bcf-bce8-16626f4feea2 tempest-VolumesGetTest-702217890 None] Flow 'volume_create_manager' (07e68e4a-5cfb-4b8a-a87a-8ddbc8cdabef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:06 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d8fd8270-f770-4bcf-bce8-16626f4feea2 tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41500f10-3463-47fe-9472-634902806a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:06 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d8fd8270-f770-4bcf-bce8-16626f4feea2 tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41500f10-3463-47fe-9472-634902806a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2076063423',display_name='tempest-VolumesGetTest-Volume-250340162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc518cdd-a9ba-47c9-8457-74533025d09f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9fcad01754d4605a8996d83455e0bf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:07Z,use_quota=True,user_id='e9e20ab6b3574245816d4bd7e981e344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:06 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d8fd8270-f770-4bcf-bce8-16626f4feea2 tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee2310d8-e8f1-454a-b27f-bc88143cb9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:06 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d8fd8270-f770-4bcf-bce8-16626f4feea2 tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee2310d8-e8f1-454a-b27f-bc88143cb9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:06 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d8fd8270-f770-4bcf-bce8-16626f4feea2 tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (227305d9-76ea-49ab-b2c6-3ce5bb3aecb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:06 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d8fd8270-f770-4bcf-bce8-16626f4feea2 tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (227305d9-76ea-49ab-b2c6-3ce5bb3aecb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc518cdd-a9ba-47c9-8457-74533025d09f', 'volume_name': 'volume-cc518cdd-a9ba-47c9-8457-74533025d09f', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:06 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d8fd8270-f770-4bcf-bce8-16626f4feea2 tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36d1ac19-8732-4ad3-95a6-04cd04addce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:06 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d8fd8270-f770-4bcf-bce8-16626f4feea2 tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36d1ac19-8732-4ad3-95a6-04cd04addce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:06 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d8fd8270-f770-4bcf-bce8-16626f4feea2 tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f29cb3ed-e4a3-474a-9ccf-4133a7ddc9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:06 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-d8fd8270-f770-4bcf-bce8-16626f4feea2 tempest-VolumesGetTest-702217890 None] Volume cc518cdd-a9ba-47c9-8457-74533025d09f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc518cdd-a9ba-47c9-8457-74533025d09f', 'volume_size': 1} Jul 07 17:34:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d8fd8270-f770-4bcf-bce8-16626f4feea2 tempest-VolumesGetTest-702217890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d8fd8270-f770-4bcf-bce8-16626f4feea2 tempest-VolumesGetTest-702217890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:06 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d8fd8270-f770-4bcf-bce8-16626f4feea2 tempest-VolumesGetTest-702217890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2076063423',display_name='tempest-VolumesGetTest-Volume-250340162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc518cdd-a9ba-47c9-8457-74533025d09f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9fcad01754d4605a8996d83455e0bf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:07Z,use_quota=True,user_id='e9e20ab6b3574245816d4bd7e981e344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:34:06 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-d8fd8270-f770-4bcf-bce8-16626f4feea2 tempest-VolumesGetTest-702217890 None] Creating volume cc518cdd-a9ba-47c9-8457-74533025d09f {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:34:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d8fd8270-f770-4bcf-bce8-16626f4feea2 tempest-VolumesGetTest-702217890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d8fd8270-f770-4bcf-bce8-16626f4feea2 tempest-VolumesGetTest-702217890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:06 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d8fd8270-f770-4bcf-bce8-16626f4feea2 tempest-VolumesGetTest-702217890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:06 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d8fd8270-f770-4bcf-bce8-16626f4feea2 tempest-VolumesGetTest-702217890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d8fd8270-f770-4bcf-bce8-16626f4feea2 tempest-VolumesGetTest-702217890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:06 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d8fd8270-f770-4bcf-bce8-16626f4feea2 tempest-VolumesGetTest-702217890 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:34:06 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-d8fd8270-f770-4bcf-bce8-16626f4feea2 tempest-VolumesGetTest-702217890 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:34:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d8fd8270-f770-4bcf-bce8-16626f4feea2 tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc518cdd-a9ba-47c9-8457-74533025d09f 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:06 devstack sudo[102145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc518cdd-a9ba-47c9-8457-74533025d09f 1073741824 Jul 07 17:34:06 devstack sudo[102145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:07 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8a79f2f-ed94-427d-bd03-14fa80f13de7 tempest-ProjectReaderTests-1460118790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:34:07 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b8a79f2f-ed94-427d-bd03-14fa80f13de7 tempest-ProjectReaderTests-1460118790 None] Flow 'volume_create_manager' (bb6fdb7f-4407-4503-bc32-b0467dbf4853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:07 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b8a79f2f-ed94-427d-bd03-14fa80f13de7 tempest-ProjectReaderTests-1460118790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a96065a8-df7f-468b-86b5-0fe46055fe1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:07 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b8a79f2f-ed94-427d-bd03-14fa80f13de7 tempest-ProjectReaderTests-1460118790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a96065a8-df7f-468b-86b5-0fe46055fe1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-219778073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7b7a735-2e13-4db7-b222-916cfe38f44d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee2235af77d541b487a776ec0cd86b79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:07Z,use_quota=True,user_id='bae02e7cf53d4bd1a35acbed69be4dcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:07 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b8a79f2f-ed94-427d-bd03-14fa80f13de7 tempest-ProjectReaderTests-1460118790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b81694c-0884-4d75-b8e5-1ac2b0ae585b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:07 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b8a79f2f-ed94-427d-bd03-14fa80f13de7 tempest-ProjectReaderTests-1460118790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b81694c-0884-4d75-b8e5-1ac2b0ae585b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:07 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b8a79f2f-ed94-427d-bd03-14fa80f13de7 tempest-ProjectReaderTests-1460118790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88baf08e-e457-43a2-8b79-8e0ad3f0f26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:07 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b8a79f2f-ed94-427d-bd03-14fa80f13de7 tempest-ProjectReaderTests-1460118790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88baf08e-e457-43a2-8b79-8e0ad3f0f26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7b7a735-2e13-4db7-b222-916cfe38f44d', 'volume_name': 'volume-e7b7a735-2e13-4db7-b222-916cfe38f44d', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:07 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b8a79f2f-ed94-427d-bd03-14fa80f13de7 tempest-ProjectReaderTests-1460118790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (903c00dc-8e2e-4a1f-a9ef-006c7a65f888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:07 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b8a79f2f-ed94-427d-bd03-14fa80f13de7 tempest-ProjectReaderTests-1460118790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (903c00dc-8e2e-4a1f-a9ef-006c7a65f888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:07 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b8a79f2f-ed94-427d-bd03-14fa80f13de7 tempest-ProjectReaderTests-1460118790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dae5237c-34e5-4114-a569-59ddf4a4bd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:07 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-b8a79f2f-ed94-427d-bd03-14fa80f13de7 tempest-ProjectReaderTests-1460118790 None] Volume e7b7a735-2e13-4db7-b222-916cfe38f44d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7b7a735-2e13-4db7-b222-916cfe38f44d', 'volume_size': 1} Jul 07 17:34:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b8a79f2f-ed94-427d-bd03-14fa80f13de7 tempest-ProjectReaderTests-1460118790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:07 devstack sudo[102145]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d8fd8270-f770-4bcf-bce8-16626f4feea2 tempest-VolumesGetTest-702217890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc518cdd-a9ba-47c9-8457-74533025d09f 1073741824" returned: 0 in 0.852s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d8fd8270-f770-4bcf-bce8-16626f4feea2 tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc518cdd-a9ba-47c9-8457-74533025d09f {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:07 devstack sudo[102151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc518cdd-a9ba-47c9-8457-74533025d09f Jul 07 17:34:07 devstack sudo[102151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:08 devstack sudo[102151]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d8fd8270-f770-4bcf-bce8-16626f4feea2 tempest-VolumesGetTest-702217890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc518cdd-a9ba-47c9-8457-74533025d09f" returned: 0 in 0.649s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:08 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d8fd8270-f770-4bcf-bce8-16626f4feea2 tempest-VolumesGetTest-702217890 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:34:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d8fd8270-f770-4bcf-bce8-16626f4feea2 tempest-VolumesGetTest-702217890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.548s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b8a79f2f-ed94-427d-bd03-14fa80f13de7 tempest-ProjectReaderTests-1460118790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.267s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:08 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b8a79f2f-ed94-427d-bd03-14fa80f13de7 tempest-ProjectReaderTests-1460118790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-219778073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7b7a735-2e13-4db7-b222-916cfe38f44d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee2235af77d541b487a776ec0cd86b79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:07Z,use_quota=True,user_id='bae02e7cf53d4bd1a35acbed69be4dcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:34:08 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-b8a79f2f-ed94-427d-bd03-14fa80f13de7 tempest-ProjectReaderTests-1460118790 None] Creating volume e7b7a735-2e13-4db7-b222-916cfe38f44d {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:34:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b8a79f2f-ed94-427d-bd03-14fa80f13de7 tempest-ProjectReaderTests-1460118790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b8a79f2f-ed94-427d-bd03-14fa80f13de7 tempest-ProjectReaderTests-1460118790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:08 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b8a79f2f-ed94-427d-bd03-14fa80f13de7 tempest-ProjectReaderTests-1460118790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:08 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b8a79f2f-ed94-427d-bd03-14fa80f13de7 tempest-ProjectReaderTests-1460118790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b8a79f2f-ed94-427d-bd03-14fa80f13de7 tempest-ProjectReaderTests-1460118790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:08 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b8a79f2f-ed94-427d-bd03-14fa80f13de7 tempest-ProjectReaderTests-1460118790 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:34:08 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-b8a79f2f-ed94-427d-bd03-14fa80f13de7 tempest-ProjectReaderTests-1460118790 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:34:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b8a79f2f-ed94-427d-bd03-14fa80f13de7 tempest-ProjectReaderTests-1460118790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e7b7a735-2e13-4db7-b222-916cfe38f44d 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:08 devstack sudo[102154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e7b7a735-2e13-4db7-b222-916cfe38f44d 1073741824 Jul 07 17:34:08 devstack sudo[102154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:08 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d8fd8270-f770-4bcf-bce8-16626f4feea2 tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f29cb3ed-e4a3-474a-9ccf-4133a7ddc9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc518cdd-a9ba-47c9-8457-74533025d09f', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:08 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d8fd8270-f770-4bcf-bce8-16626f4feea2 tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2952d2d-d21e-42d0-9333-a71b6c347503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:08 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-d8fd8270-f770-4bcf-bce8-16626f4feea2 tempest-VolumesGetTest-702217890 None] Volume volume-cc518cdd-a9ba-47c9-8457-74533025d09f (cc518cdd-a9ba-47c9-8457-74533025d09f): created successfully Jul 07 17:34:08 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d8fd8270-f770-4bcf-bce8-16626f4feea2 tempest-VolumesGetTest-702217890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2952d2d-d21e-42d0-9333-a71b6c347503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:08 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d8fd8270-f770-4bcf-bce8-16626f4feea2 tempest-VolumesGetTest-702217890 None] Flow 'volume_create_manager' (07e68e4a-5cfb-4b8a-a87a-8ddbc8cdabef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:08 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-d8fd8270-f770-4bcf-bce8-16626f4feea2 tempest-VolumesGetTest-702217890 None] Created volume successfully. Jul 07 17:34:09 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-73842745-182b-46aa-9737-b98b8f2a8450 tempest-VolumesGetTest-702217890 None] Acquiring lock "cinder-cc518cdd-a9ba-47c9-8457-74533025d09f-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:09 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-73842745-182b-46aa-9737-b98b8f2a8450 tempest-VolumesGetTest-702217890 None] Lock "cinder-cc518cdd-a9ba-47c9-8457-74533025d09f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:09 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-73842745-182b-46aa-9737-b98b8f2a8450 tempest-VolumesGetTest-702217890 None] Acquiring lock "cinder-quobyte-cc518cdd-a9ba-47c9-8457-74533025d09f" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:09 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-73842745-182b-46aa-9737-b98b8f2a8450 tempest-VolumesGetTest-702217890 None] Lock "cinder-quobyte-cc518cdd-a9ba-47c9-8457-74533025d09f" acquired by "delete_volume" :: waited 0.021s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:09 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[615b9eb1-4d54-4acb-9fab-b8d3c0c6dd98]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-73842745-182b-46aa-9737-b98b8f2a8450 tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc518cdd-a9ba-47c9-8457-74533025d09f {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:09 devstack sudo[102159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc518cdd-a9ba-47c9-8457-74533025d09f Jul 07 17:34:09 devstack sudo[102159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:09 devstack sudo[102154]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b8a79f2f-ed94-427d-bd03-14fa80f13de7 tempest-ProjectReaderTests-1460118790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e7b7a735-2e13-4db7-b222-916cfe38f44d 1073741824" returned: 0 in 0.910s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b8a79f2f-ed94-427d-bd03-14fa80f13de7 tempest-ProjectReaderTests-1460118790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e7b7a735-2e13-4db7-b222-916cfe38f44d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:09 devstack sudo[102164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e7b7a735-2e13-4db7-b222-916cfe38f44d Jul 07 17:34:09 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:10 devstack sudo[102159]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-73842745-182b-46aa-9737-b98b8f2a8450 tempest-VolumesGetTest-702217890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc518cdd-a9ba-47c9-8457-74533025d09f" returned: 0 in 0.848s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-73842745-182b-46aa-9737-b98b8f2a8450 tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc518cdd-a9ba-47c9-8457-74533025d09f {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:10 devstack sudo[102172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc518cdd-a9ba-47c9-8457-74533025d09f Jul 07 17:34:10 devstack sudo[102172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:10 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b8a79f2f-ed94-427d-bd03-14fa80f13de7 tempest-ProjectReaderTests-1460118790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e7b7a735-2e13-4db7-b222-916cfe38f44d" returned: 0 in 0.674s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:10 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b8a79f2f-ed94-427d-bd03-14fa80f13de7 tempest-ProjectReaderTests-1460118790 None] <== create_volume: return (1626ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:34:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b8a79f2f-ed94-427d-bd03-14fa80f13de7 tempest-ProjectReaderTests-1460118790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b8a79f2f-ed94-427d-bd03-14fa80f13de7 tempest-ProjectReaderTests-1460118790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dae5237c-34e5-4114-a569-59ddf4a4bd71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7b7a735-2e13-4db7-b222-916cfe38f44d', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b8a79f2f-ed94-427d-bd03-14fa80f13de7 tempest-ProjectReaderTests-1460118790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e365613d-0799-4d76-931a-7046a8ad5f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:10 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-b8a79f2f-ed94-427d-bd03-14fa80f13de7 tempest-ProjectReaderTests-1460118790 None] Volume volume-e7b7a735-2e13-4db7-b222-916cfe38f44d (e7b7a735-2e13-4db7-b222-916cfe38f44d): created successfully Jul 07 17:34:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b8a79f2f-ed94-427d-bd03-14fa80f13de7 tempest-ProjectReaderTests-1460118790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e365613d-0799-4d76-931a-7046a8ad5f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-b8a79f2f-ed94-427d-bd03-14fa80f13de7 tempest-ProjectReaderTests-1460118790 None] Flow 'volume_create_manager' (bb6fdb7f-4407-4503-bc32-b0467dbf4853) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:10 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-b8a79f2f-ed94-427d-bd03-14fa80f13de7 tempest-ProjectReaderTests-1460118790 None] Created volume successfully. Jul 07 17:34:10 devstack sudo[102172]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-73842745-182b-46aa-9737-b98b8f2a8450 tempest-VolumesGetTest-702217890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc518cdd-a9ba-47c9-8457-74533025d09f" returned: 0 in 0.780s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:10 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-73842745-182b-46aa-9737-b98b8f2a8450 tempest-VolumesGetTest-702217890 None] Lock "cinder-quobyte-cc518cdd-a9ba-47c9-8457-74533025d09f" released by "delete_volume" :: held 1.667s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:10 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-73842745-182b-46aa-9737-b98b8f2a8450 tempest-VolumesGetTest-702217890 None] Created reservations ['9b776a03-185e-491e-8591-d69c99a03cc5', 'ac005380-7df6-40a4-8abb-1032db6cb941', 'b061462f-231f-4621-a024-51e249ec1b33', '44dfe35c-0fb7-47c0-85b3-f27baa1cd2f8'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:34:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-73842745-182b-46aa-9737-b98b8f2a8450 tempest-VolumesGetTest-702217890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-73842745-182b-46aa-9737-b98b8f2a8450 tempest-VolumesGetTest-702217890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:10 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-73842745-182b-46aa-9737-b98b8f2a8450 tempest-VolumesGetTest-702217890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:10 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-73842745-182b-46aa-9737-b98b8f2a8450 tempest-VolumesGetTest-702217890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-73842745-182b-46aa-9737-b98b8f2a8450 tempest-VolumesGetTest-702217890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-73842745-182b-46aa-9737-b98b8f2a8450 tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:11 devstack sudo[102179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:34:11 devstack sudo[102179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:11 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-29cc2b8c-28b7-4883-ae75-586728380164 tempest-VolumesGetTest-702217890 None] Acquiring lock "cinder-b44cf3ff-64c7-423f-ba40-0da4c3226795-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:11 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-29cc2b8c-28b7-4883-ae75-586728380164 tempest-VolumesGetTest-702217890 None] Lock "cinder-b44cf3ff-64c7-423f-ba40-0da4c3226795-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:11 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-29cc2b8c-28b7-4883-ae75-586728380164 tempest-VolumesGetTest-702217890 None] Acquiring lock "cinder-quobyte-b44cf3ff-64c7-423f-ba40-0da4c3226795" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:11 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-29cc2b8c-28b7-4883-ae75-586728380164 tempest-VolumesGetTest-702217890 None] Lock "cinder-quobyte-b44cf3ff-64c7-423f-ba40-0da4c3226795" acquired by "delete_volume" :: waited 0.020s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:11 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db70dfe-939a-4d39-a9aa-d57a28583aa6]: (4, 'raw') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-29cc2b8c-28b7-4883-ae75-586728380164 tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b44cf3ff-64c7-423f-ba40-0da4c3226795 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:11 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9d406162-0b5c-44cf-9b62-684ed0eb8dab tempest-ProjectReaderTests-1460118790 None] Acquiring lock "cinder-e7b7a735-2e13-4db7-b222-916cfe38f44d-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:11 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9d406162-0b5c-44cf-9b62-684ed0eb8dab tempest-ProjectReaderTests-1460118790 None] Lock "cinder-e7b7a735-2e13-4db7-b222-916cfe38f44d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:11 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9d406162-0b5c-44cf-9b62-684ed0eb8dab tempest-ProjectReaderTests-1460118790 None] Acquiring lock "cinder-quobyte-e7b7a735-2e13-4db7-b222-916cfe38f44d" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:11 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9d406162-0b5c-44cf-9b62-684ed0eb8dab tempest-ProjectReaderTests-1460118790 None] Lock "cinder-quobyte-e7b7a735-2e13-4db7-b222-916cfe38f44d" acquired by "delete_volume" :: waited 0.029s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:11 devstack sudo[102181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b44cf3ff-64c7-423f-ba40-0da4c3226795 Jul 07 17:34:11 devstack sudo[102181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:11 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7d823a-d445-4eae-b1de-004df00ff961]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9d406162-0b5c-44cf-9b62-684ed0eb8dab tempest-ProjectReaderTests-1460118790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e7b7a735-2e13-4db7-b222-916cfe38f44d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:11 devstack sudo[102179]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-73842745-182b-46aa-9737-b98b8f2a8450 tempest-VolumesGetTest-702217890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.882s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:11 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-73842745-182b-46aa-9737-b98b8f2a8450 tempest-VolumesGetTest-702217890 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:34:11 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-73842745-182b-46aa-9737-b98b8f2a8450 tempest-VolumesGetTest-702217890 None] Deleted volume successfully. Jul 07 17:34:11 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-73842745-182b-46aa-9737-b98b8f2a8450 tempest-VolumesGetTest-702217890 None] Lock "cinder-cc518cdd-a9ba-47c9-8457-74533025d09f-delete_volume" released by "delete_volume" :: held 2.810s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:11 devstack sudo[102186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e7b7a735-2e13-4db7-b222-916cfe38f44d Jul 07 17:34:11 devstack sudo[102186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:12 devstack sudo[102181]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-29cc2b8c-28b7-4883-ae75-586728380164 tempest-VolumesGetTest-702217890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b44cf3ff-64c7-423f-ba40-0da4c3226795" returned: 0 in 0.901s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-29cc2b8c-28b7-4883-ae75-586728380164 tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b44cf3ff-64c7-423f-ba40-0da4c3226795 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:12 devstack sudo[102198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b44cf3ff-64c7-423f-ba40-0da4c3226795 Jul 07 17:34:12 devstack sudo[102198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:12 devstack sudo[102186]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9d406162-0b5c-44cf-9b62-684ed0eb8dab tempest-ProjectReaderTests-1460118790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e7b7a735-2e13-4db7-b222-916cfe38f44d" returned: 0 in 1.033s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9d406162-0b5c-44cf-9b62-684ed0eb8dab tempest-ProjectReaderTests-1460118790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e7b7a735-2e13-4db7-b222-916cfe38f44d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:12 devstack sudo[102213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e7b7a735-2e13-4db7-b222-916cfe38f44d Jul 07 17:34:12 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:13 devstack sudo[102198]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-29cc2b8c-28b7-4883-ae75-586728380164 tempest-VolumesGetTest-702217890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b44cf3ff-64c7-423f-ba40-0da4c3226795" returned: 1 in 0.968s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-29cc2b8c-28b7-4883-ae75-586728380164 tempest-VolumesGetTest-702217890 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b44cf3ff-64c7-423f-ba40-0da4c3226795' failed. Not Retrying. {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:34:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-29cc2b8c-28b7-4883-ae75-586728380164 tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b44cf3ff-64c7-423f-ba40-0da4c3226795 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:13 devstack sudo[102222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b44cf3ff-64c7-423f-ba40-0da4c3226795 Jul 07 17:34:13 devstack sudo[102222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:13 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9d406162-0b5c-44cf-9b62-684ed0eb8dab tempest-ProjectReaderTests-1460118790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e7b7a735-2e13-4db7-b222-916cfe38f44d" returned: 0 in 0.722s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:13 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9d406162-0b5c-44cf-9b62-684ed0eb8dab tempest-ProjectReaderTests-1460118790 None] Lock "cinder-quobyte-e7b7a735-2e13-4db7-b222-916cfe38f44d" released by "delete_volume" :: held 1.831s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:13 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-9d406162-0b5c-44cf-9b62-684ed0eb8dab tempest-ProjectReaderTests-1460118790 None] Created reservations ['6f2aace3-0f12-422e-bf68-61802706d8d4', '4e687b0c-910a-4d21-9c2e-3a9bf58f8517', 'f698a434-8d94-45f9-9ad4-7be5e36fdd2f', '301d06b2-cfea-4b40-b169-15f92411030a'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:34:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9d406162-0b5c-44cf-9b62-684ed0eb8dab tempest-ProjectReaderTests-1460118790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9d406162-0b5c-44cf-9b62-684ed0eb8dab tempest-ProjectReaderTests-1460118790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:13 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-9d406162-0b5c-44cf-9b62-684ed0eb8dab tempest-ProjectReaderTests-1460118790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:13 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-9d406162-0b5c-44cf-9b62-684ed0eb8dab tempest-ProjectReaderTests-1460118790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9d406162-0b5c-44cf-9b62-684ed0eb8dab tempest-ProjectReaderTests-1460118790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9d406162-0b5c-44cf-9b62-684ed0eb8dab tempest-ProjectReaderTests-1460118790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:13 devstack sudo[102224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:34:13 devstack sudo[102224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:14 devstack sudo[102222]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-29cc2b8c-28b7-4883-ae75-586728380164 tempest-VolumesGetTest-702217890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b44cf3ff-64c7-423f-ba40-0da4c3226795" returned: 0 in 0.784s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:14 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-29cc2b8c-28b7-4883-ae75-586728380164 tempest-VolumesGetTest-702217890 None] Lock "cinder-quobyte-b44cf3ff-64c7-423f-ba40-0da4c3226795" released by "delete_volume" :: held 2.741s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:14 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-29cc2b8c-28b7-4883-ae75-586728380164 tempest-VolumesGetTest-702217890 None] Created reservations ['0b7d9858-e08c-4628-9fe3-64556e1a324f', '9bb59371-6024-4071-9e3e-a4c560733dc1', 'fbdc4fba-b1d6-4a37-8753-2e24d30cb659', 'd05f2c29-06f7-49ad-919d-a7c727fdc633'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:34:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-29cc2b8c-28b7-4883-ae75-586728380164 tempest-VolumesGetTest-702217890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-29cc2b8c-28b7-4883-ae75-586728380164 tempest-VolumesGetTest-702217890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:14 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-29cc2b8c-28b7-4883-ae75-586728380164 tempest-VolumesGetTest-702217890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:14 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-29cc2b8c-28b7-4883-ae75-586728380164 tempest-VolumesGetTest-702217890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-29cc2b8c-28b7-4883-ae75-586728380164 tempest-VolumesGetTest-702217890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-29cc2b8c-28b7-4883-ae75-586728380164 tempest-VolumesGetTest-702217890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:14 devstack sudo[102229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:34:14 devstack sudo[102229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:14 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-65c8456c-4e55-4b1e-aa31-8759e4b61305 tempest-ProjectReaderTests-1460118790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:34:14 devstack sudo[102224]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:14 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-65c8456c-4e55-4b1e-aa31-8759e4b61305 tempest-ProjectReaderTests-1460118790 None] Flow 'volume_create_manager' (4ed88b73-1f33-4cd4-b179-29686d22f861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:14 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-65c8456c-4e55-4b1e-aa31-8759e4b61305 tempest-ProjectReaderTests-1460118790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccc177cb-ce4e-4e4e-b474-4bdef3aee47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9d406162-0b5c-44cf-9b62-684ed0eb8dab tempest-ProjectReaderTests-1460118790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.790s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:14 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-9d406162-0b5c-44cf-9b62-684ed0eb8dab tempest-ProjectReaderTests-1460118790 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:34:14 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-9d406162-0b5c-44cf-9b62-684ed0eb8dab tempest-ProjectReaderTests-1460118790 None] Deleted volume successfully. Jul 07 17:34:14 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-65c8456c-4e55-4b1e-aa31-8759e4b61305 tempest-ProjectReaderTests-1460118790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccc177cb-ce4e-4e4e-b474-4bdef3aee47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1681168451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=530351b3-6629-4a43-befa-679fa0d74f48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee2235af77d541b487a776ec0cd86b79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:14Z,use_quota=True,user_id='bae02e7cf53d4bd1a35acbed69be4dcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:14 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-65c8456c-4e55-4b1e-aa31-8759e4b61305 tempest-ProjectReaderTests-1460118790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c22b7ac-7a22-4f81-bb88-37fa122ccaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:14 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-65c8456c-4e55-4b1e-aa31-8759e4b61305 tempest-ProjectReaderTests-1460118790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c22b7ac-7a22-4f81-bb88-37fa122ccaa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:14 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-65c8456c-4e55-4b1e-aa31-8759e4b61305 tempest-ProjectReaderTests-1460118790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c427353b-aed6-4f98-94ad-a2d6cb1589eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:14 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-65c8456c-4e55-4b1e-aa31-8759e4b61305 tempest-ProjectReaderTests-1460118790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c427353b-aed6-4f98-94ad-a2d6cb1589eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '530351b3-6629-4a43-befa-679fa0d74f48', 'volume_name': 'volume-530351b3-6629-4a43-befa-679fa0d74f48', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:14 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-65c8456c-4e55-4b1e-aa31-8759e4b61305 tempest-ProjectReaderTests-1460118790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73d35f57-866c-40ac-8888-25aa778ccbd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:14 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-65c8456c-4e55-4b1e-aa31-8759e4b61305 tempest-ProjectReaderTests-1460118790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73d35f57-866c-40ac-8888-25aa778ccbd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:14 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-65c8456c-4e55-4b1e-aa31-8759e4b61305 tempest-ProjectReaderTests-1460118790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0559f56d-28af-4071-9a67-4309ff2d2948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:14 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-65c8456c-4e55-4b1e-aa31-8759e4b61305 tempest-ProjectReaderTests-1460118790 None] Volume 530351b3-6629-4a43-befa-679fa0d74f48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-530351b3-6629-4a43-befa-679fa0d74f48', 'volume_size': 1} Jul 07 17:34:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-65c8456c-4e55-4b1e-aa31-8759e4b61305 tempest-ProjectReaderTests-1460118790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-65c8456c-4e55-4b1e-aa31-8759e4b61305 tempest-ProjectReaderTests-1460118790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:14 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-65c8456c-4e55-4b1e-aa31-8759e4b61305 tempest-ProjectReaderTests-1460118790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1681168451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=530351b3-6629-4a43-befa-679fa0d74f48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee2235af77d541b487a776ec0cd86b79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:14Z,use_quota=True,user_id='bae02e7cf53d4bd1a35acbed69be4dcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:34:14 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-65c8456c-4e55-4b1e-aa31-8759e4b61305 tempest-ProjectReaderTests-1460118790 None] Creating volume 530351b3-6629-4a43-befa-679fa0d74f48 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:34:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-65c8456c-4e55-4b1e-aa31-8759e4b61305 tempest-ProjectReaderTests-1460118790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-65c8456c-4e55-4b1e-aa31-8759e4b61305 tempest-ProjectReaderTests-1460118790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:14 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-65c8456c-4e55-4b1e-aa31-8759e4b61305 tempest-ProjectReaderTests-1460118790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:14 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-65c8456c-4e55-4b1e-aa31-8759e4b61305 tempest-ProjectReaderTests-1460118790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-65c8456c-4e55-4b1e-aa31-8759e4b61305 tempest-ProjectReaderTests-1460118790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:14 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-65c8456c-4e55-4b1e-aa31-8759e4b61305 tempest-ProjectReaderTests-1460118790 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:34:14 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-65c8456c-4e55-4b1e-aa31-8759e4b61305 tempest-ProjectReaderTests-1460118790 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:34:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-65c8456c-4e55-4b1e-aa31-8759e4b61305 tempest-ProjectReaderTests-1460118790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-530351b3-6629-4a43-befa-679fa0d74f48 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:14 devstack sudo[102231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-530351b3-6629-4a43-befa-679fa0d74f48 1073741824 Jul 07 17:34:14 devstack sudo[102231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:14 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9d406162-0b5c-44cf-9b62-684ed0eb8dab tempest-ProjectReaderTests-1460118790 None] Lock "cinder-e7b7a735-2e13-4db7-b222-916cfe38f44d-delete_volume" released by "delete_volume" :: held 2.988s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:14 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-19640c2e-2953-485a-9e66-0114cbf278b0 req-0b2a618f-9d3a-4d49-a4d6-2fa2b43c2aad tempest-TestShelveInstance-1988315190 None] Terminate volume connection completed successfully. Jul 07 17:34:14 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-19640c2e-2953-485a-9e66-0114cbf278b0 req-0b2a618f-9d3a-4d49-a4d6-2fa2b43c2aad tempest-TestShelveInstance-1988315190 None] Deleting attachment ef900db0-f392-4dbe-a633-6942683c2f8c. {{(pid=87233) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:34:15 devstack sudo[102229]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-29cc2b8c-28b7-4883-ae75-586728380164 tempest-VolumesGetTest-702217890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.709s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:15 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-29cc2b8c-28b7-4883-ae75-586728380164 tempest-VolumesGetTest-702217890 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:34:15 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-29cc2b8c-28b7-4883-ae75-586728380164 tempest-VolumesGetTest-702217890 None] Deleted volume successfully. Jul 07 17:34:15 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-29cc2b8c-28b7-4883-ae75-586728380164 tempest-VolumesGetTest-702217890 None] Lock "cinder-b44cf3ff-64c7-423f-ba40-0da4c3226795-delete_volume" released by "delete_volume" :: held 3.705s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:15 devstack sudo[102231]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-65c8456c-4e55-4b1e-aa31-8759e4b61305 tempest-ProjectReaderTests-1460118790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-530351b3-6629-4a43-befa-679fa0d74f48 1073741824" returned: 0 in 0.915s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-65c8456c-4e55-4b1e-aa31-8759e4b61305 tempest-ProjectReaderTests-1460118790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-530351b3-6629-4a43-befa-679fa0d74f48 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:15 devstack cinder-volume[87233]: DEBUG cinder.coordination [req-19640c2e-2953-485a-9e66-0114cbf278b0 req-f55ac311-fde8-48e4-88d6-227caeb5729c tempest-TestShelveInstance-1988315190 None] Acquiring lock "cinder-e09b9c94-9373-4bac-9614-06b37514b12a-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:15 devstack sudo[102238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-530351b3-6629-4a43-befa-679fa0d74f48 Jul 07 17:34:15 devstack sudo[102238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:15 devstack cinder-volume[87233]: DEBUG cinder.coordination [req-19640c2e-2953-485a-9e66-0114cbf278b0 req-f55ac311-fde8-48e4-88d6-227caeb5729c tempest-TestShelveInstance-1988315190 None] Lock "cinder-e09b9c94-9373-4bac-9614-06b37514b12a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:15 devstack cinder-volume[87233]: DEBUG cinder.coordination [req-19640c2e-2953-485a-9e66-0114cbf278b0 req-f55ac311-fde8-48e4-88d6-227caeb5729c tempest-TestShelveInstance-1988315190 None] Acquiring lock "cinder-quobyte-e09b9c94-9373-4bac-9614-06b37514b12a" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:15 devstack cinder-volume[87233]: DEBUG cinder.coordination [req-19640c2e-2953-485a-9e66-0114cbf278b0 req-f55ac311-fde8-48e4-88d6-227caeb5729c tempest-TestShelveInstance-1988315190 None] Lock "cinder-quobyte-e09b9c94-9373-4bac-9614-06b37514b12a" acquired by "delete_volume" :: waited 0.027s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:15 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[22723775-1cf5-4063-8f97-3837815348a3]: (4, 'raw') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-19640c2e-2953-485a-9e66-0114cbf278b0 req-f55ac311-fde8-48e4-88d6-227caeb5729c tempest-TestShelveInstance-1988315190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e09b9c94-9373-4bac-9614-06b37514b12a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:15 devstack sudo[102240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e09b9c94-9373-4bac-9614-06b37514b12a Jul 07 17:34:15 devstack sudo[102240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:16 devstack sudo[102238]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-65c8456c-4e55-4b1e-aa31-8759e4b61305 tempest-ProjectReaderTests-1460118790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-530351b3-6629-4a43-befa-679fa0d74f48" returned: 0 in 0.803s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:16 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-65c8456c-4e55-4b1e-aa31-8759e4b61305 tempest-ProjectReaderTests-1460118790 None] <== create_volume: return (1800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:34:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-65c8456c-4e55-4b1e-aa31-8759e4b61305 tempest-ProjectReaderTests-1460118790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:16 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-65c8456c-4e55-4b1e-aa31-8759e4b61305 tempest-ProjectReaderTests-1460118790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0559f56d-28af-4071-9a67-4309ff2d2948) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-530351b3-6629-4a43-befa-679fa0d74f48', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:16 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-65c8456c-4e55-4b1e-aa31-8759e4b61305 tempest-ProjectReaderTests-1460118790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd743bf2-41e0-44d6-ae12-ca1eafb8e4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:16 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-65c8456c-4e55-4b1e-aa31-8759e4b61305 tempest-ProjectReaderTests-1460118790 None] Volume volume-530351b3-6629-4a43-befa-679fa0d74f48 (530351b3-6629-4a43-befa-679fa0d74f48): created successfully Jul 07 17:34:16 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-65c8456c-4e55-4b1e-aa31-8759e4b61305 tempest-ProjectReaderTests-1460118790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd743bf2-41e0-44d6-ae12-ca1eafb8e4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:16 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-65c8456c-4e55-4b1e-aa31-8759e4b61305 tempest-ProjectReaderTests-1460118790 None] Flow 'volume_create_manager' (4ed88b73-1f33-4cd4-b179-29686d22f861) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:16 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-65c8456c-4e55-4b1e-aa31-8759e4b61305 tempest-ProjectReaderTests-1460118790 None] Created volume successfully. Jul 07 17:34:16 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-8e0fd9ea-835f-47d7-8c14-7ea709b9bc9d tempest-ProjectReaderTests-1460118790 None] Acquiring lock "cinder-530351b3-6629-4a43-befa-679fa0d74f48-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:16 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-8e0fd9ea-835f-47d7-8c14-7ea709b9bc9d tempest-ProjectReaderTests-1460118790 None] Lock "cinder-530351b3-6629-4a43-befa-679fa0d74f48-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:16 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-8e0fd9ea-835f-47d7-8c14-7ea709b9bc9d tempest-ProjectReaderTests-1460118790 None] Acquiring lock "cinder-quobyte-530351b3-6629-4a43-befa-679fa0d74f48" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:16 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-8e0fd9ea-835f-47d7-8c14-7ea709b9bc9d tempest-ProjectReaderTests-1460118790 None] Lock "cinder-quobyte-530351b3-6629-4a43-befa-679fa0d74f48" acquired by "delete_volume" :: waited 0.016s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:16 devstack sudo[102240]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-19640c2e-2953-485a-9e66-0114cbf278b0 req-f55ac311-fde8-48e4-88d6-227caeb5729c tempest-TestShelveInstance-1988315190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e09b9c94-9373-4bac-9614-06b37514b12a" returned: 0 in 0.962s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-19640c2e-2953-485a-9e66-0114cbf278b0 req-f55ac311-fde8-48e4-88d6-227caeb5729c tempest-TestShelveInstance-1988315190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e09b9c94-9373-4bac-9614-06b37514b12a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:16 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b67b3c-140b-42b0-9c55-b0b6e9b487fe]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8e0fd9ea-835f-47d7-8c14-7ea709b9bc9d tempest-ProjectReaderTests-1460118790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-530351b3-6629-4a43-befa-679fa0d74f48 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:16 devstack sudo[102279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e09b9c94-9373-4bac-9614-06b37514b12a Jul 07 17:34:16 devstack sudo[102279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:16 devstack sudo[102280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-530351b3-6629-4a43-befa-679fa0d74f48 Jul 07 17:34:16 devstack sudo[102280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:17 devstack sudo[102279]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-19640c2e-2953-485a-9e66-0114cbf278b0 req-f55ac311-fde8-48e4-88d6-227caeb5729c tempest-TestShelveInstance-1988315190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e09b9c94-9373-4bac-9614-06b37514b12a" returned: 1 in 0.850s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-19640c2e-2953-485a-9e66-0114cbf278b0 req-f55ac311-fde8-48e4-88d6-227caeb5729c tempest-TestShelveInstance-1988315190 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e09b9c94-9373-4bac-9614-06b37514b12a' failed. Not Retrying. {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:34:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-19640c2e-2953-485a-9e66-0114cbf278b0 req-f55ac311-fde8-48e4-88d6-227caeb5729c tempest-TestShelveInstance-1988315190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e09b9c94-9373-4bac-9614-06b37514b12a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:17 devstack sudo[102291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e09b9c94-9373-4bac-9614-06b37514b12a Jul 07 17:34:17 devstack sudo[102291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:17 devstack sudo[102280]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8e0fd9ea-835f-47d7-8c14-7ea709b9bc9d tempest-ProjectReaderTests-1460118790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-530351b3-6629-4a43-befa-679fa0d74f48" returned: 0 in 0.908s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8e0fd9ea-835f-47d7-8c14-7ea709b9bc9d tempest-ProjectReaderTests-1460118790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-530351b3-6629-4a43-befa-679fa0d74f48 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:17 devstack sudo[102293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-530351b3-6629-4a43-befa-679fa0d74f48 Jul 07 17:34:17 devstack sudo[102293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:18 devstack sudo[102291]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-19640c2e-2953-485a-9e66-0114cbf278b0 req-f55ac311-fde8-48e4-88d6-227caeb5729c tempest-TestShelveInstance-1988315190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-e09b9c94-9373-4bac-9614-06b37514b12a" returned: 0 in 0.742s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:18 devstack cinder-volume[87233]: DEBUG cinder.coordination [req-19640c2e-2953-485a-9e66-0114cbf278b0 req-f55ac311-fde8-48e4-88d6-227caeb5729c tempest-TestShelveInstance-1988315190 None] Lock "cinder-quobyte-e09b9c94-9373-4bac-9614-06b37514b12a" released by "delete_volume" :: held 2.645s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:18 devstack sudo[102293]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8e0fd9ea-835f-47d7-8c14-7ea709b9bc9d tempest-ProjectReaderTests-1460118790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-530351b3-6629-4a43-befa-679fa0d74f48" returned: 0 in 0.739s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:18 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-8e0fd9ea-835f-47d7-8c14-7ea709b9bc9d tempest-ProjectReaderTests-1460118790 None] Lock "cinder-quobyte-530351b3-6629-4a43-befa-679fa0d74f48" released by "delete_volume" :: held 1.731s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:18 devstack cinder-volume[87233]: DEBUG cinder.quota [req-19640c2e-2953-485a-9e66-0114cbf278b0 req-f55ac311-fde8-48e4-88d6-227caeb5729c tempest-TestShelveInstance-1988315190 None] Created reservations ['8a45ec24-2cc7-41c5-bb0a-0bcdad3515d9', 'e39ee0dc-7245-445f-9264-6a0d8e6292a5', '305fd1b0-5f0b-4e1c-890a-81e01ec8dce3', 'afa49c5b-fb38-4d0a-a5c5-edc4c91d117e'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:34:18 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-8e0fd9ea-835f-47d7-8c14-7ea709b9bc9d tempest-ProjectReaderTests-1460118790 None] Created reservations ['05049115-92ac-414d-9f2f-a7d7bac74b07', '92ea8b66-2743-422d-8bda-0af590037f68', '2aa6806f-0ab1-435d-98a4-c121ccc1ecfe', '8a6e148a-e2ba-4716-94fc-5fc294e87edd'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:34:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-19640c2e-2953-485a-9e66-0114cbf278b0 req-f55ac311-fde8-48e4-88d6-227caeb5729c tempest-TestShelveInstance-1988315190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-19640c2e-2953-485a-9e66-0114cbf278b0 req-f55ac311-fde8-48e4-88d6-227caeb5729c tempest-TestShelveInstance-1988315190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:18 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [req-19640c2e-2953-485a-9e66-0114cbf278b0 req-f55ac311-fde8-48e4-88d6-227caeb5729c tempest-TestShelveInstance-1988315190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:18 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [req-19640c2e-2953-485a-9e66-0114cbf278b0 req-f55ac311-fde8-48e4-88d6-227caeb5729c tempest-TestShelveInstance-1988315190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-19640c2e-2953-485a-9e66-0114cbf278b0 req-f55ac311-fde8-48e4-88d6-227caeb5729c tempest-TestShelveInstance-1988315190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-19640c2e-2953-485a-9e66-0114cbf278b0 req-f55ac311-fde8-48e4-88d6-227caeb5729c tempest-TestShelveInstance-1988315190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:18 devstack sudo[102297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:34:18 devstack sudo[102297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:18 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-68033e19-92ca-4af3-b192-e4184df15257 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:34:18 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-68033e19-92ca-4af3-b192-e4184df15257 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Flow 'volume_create_manager' (bef835ce-2782-4b10-8ebb-d64f4845dd46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:18 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-68033e19-92ca-4af3-b192-e4184df15257 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36b879fa-462b-44cc-8a1f-7582273a785a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-8e0fd9ea-835f-47d7-8c14-7ea709b9bc9d tempest-ProjectReaderTests-1460118790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-8e0fd9ea-835f-47d7-8c14-7ea709b9bc9d tempest-ProjectReaderTests-1460118790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:18 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-8e0fd9ea-835f-47d7-8c14-7ea709b9bc9d tempest-ProjectReaderTests-1460118790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:18 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-8e0fd9ea-835f-47d7-8c14-7ea709b9bc9d tempest-ProjectReaderTests-1460118790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-8e0fd9ea-835f-47d7-8c14-7ea709b9bc9d tempest-ProjectReaderTests-1460118790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8e0fd9ea-835f-47d7-8c14-7ea709b9bc9d tempest-ProjectReaderTests-1460118790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:18 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-68033e19-92ca-4af3-b192-e4184df15257 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36b879fa-462b-44cc-8a1f-7582273a785a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1234268083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=076041f7-028a-4237-a050-414118bfd440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a493be9729d947f789c9c35f7a53a619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:19Z,use_quota=True,user_id='46b40a3dd3514e7082e3a4d436281462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:18 devstack sudo[102299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:34:18 devstack sudo[102299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:18 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-68033e19-92ca-4af3-b192-e4184df15257 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7539a7c2-d110-49e1-802d-749d08888a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:18 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-68033e19-92ca-4af3-b192-e4184df15257 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7539a7c2-d110-49e1-802d-749d08888a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:18 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-68033e19-92ca-4af3-b192-e4184df15257 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b8506de-9ee1-4eca-90c4-5a1b86faf632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:18 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-68033e19-92ca-4af3-b192-e4184df15257 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b8506de-9ee1-4eca-90c4-5a1b86faf632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '076041f7-028a-4237-a050-414118bfd440', 'volume_name': 'volume-076041f7-028a-4237-a050-414118bfd440', 'volume_size': 2}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:18 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-68033e19-92ca-4af3-b192-e4184df15257 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (360ea02d-f3ee-493a-a979-a99434dcdaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:18 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-68033e19-92ca-4af3-b192-e4184df15257 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (360ea02d-f3ee-493a-a979-a99434dcdaec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:18 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-68033e19-92ca-4af3-b192-e4184df15257 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3be22565-f6d0-4718-9f5d-a720d70a084d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:18 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-68033e19-92ca-4af3-b192-e4184df15257 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Volume 076041f7-028a-4237-a050-414118bfd440: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-076041f7-028a-4237-a050-414118bfd440', 'volume_size': 2} Jul 07 17:34:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-68033e19-92ca-4af3-b192-e4184df15257 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-68033e19-92ca-4af3-b192-e4184df15257 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:18 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-68033e19-92ca-4af3-b192-e4184df15257 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1234268083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=076041f7-028a-4237-a050-414118bfd440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a493be9729d947f789c9c35f7a53a619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:19Z,use_quota=True,user_id='46b40a3dd3514e7082e3a4d436281462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:34:18 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-68033e19-92ca-4af3-b192-e4184df15257 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Creating volume 076041f7-028a-4237-a050-414118bfd440 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:34:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-68033e19-92ca-4af3-b192-e4184df15257 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-68033e19-92ca-4af3-b192-e4184df15257 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:18 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-68033e19-92ca-4af3-b192-e4184df15257 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:18 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-68033e19-92ca-4af3-b192-e4184df15257 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-68033e19-92ca-4af3-b192-e4184df15257 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:18 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-68033e19-92ca-4af3-b192-e4184df15257 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:34:18 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-68033e19-92ca-4af3-b192-e4184df15257 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:34:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-68033e19-92ca-4af3-b192-e4184df15257 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-076041f7-028a-4237-a050-414118bfd440 2147483648 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:18 devstack sudo[102301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-076041f7-028a-4237-a050-414118bfd440 2147483648 Jul 07 17:34:18 devstack sudo[102301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:19 devstack sudo[102297]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-19640c2e-2953-485a-9e66-0114cbf278b0 req-f55ac311-fde8-48e4-88d6-227caeb5729c tempest-TestShelveInstance-1988315190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 1.062s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:19 devstack cinder-volume[87233]: DEBUG cinder.manager [req-19640c2e-2953-485a-9e66-0114cbf278b0 req-f55ac311-fde8-48e4-88d6-227caeb5729c tempest-TestShelveInstance-1988315190 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:34:19 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-19640c2e-2953-485a-9e66-0114cbf278b0 req-f55ac311-fde8-48e4-88d6-227caeb5729c tempest-TestShelveInstance-1988315190 None] Deleted volume successfully. Jul 07 17:34:19 devstack cinder-volume[87233]: DEBUG cinder.coordination [req-19640c2e-2953-485a-9e66-0114cbf278b0 req-f55ac311-fde8-48e4-88d6-227caeb5729c tempest-TestShelveInstance-1988315190 None] Lock "cinder-e09b9c94-9373-4bac-9614-06b37514b12a-delete_volume" released by "delete_volume" :: held 4.078s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:19 devstack sudo[102299]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8e0fd9ea-835f-47d7-8c14-7ea709b9bc9d tempest-ProjectReaderTests-1460118790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 1.032s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:19 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-8e0fd9ea-835f-47d7-8c14-7ea709b9bc9d tempest-ProjectReaderTests-1460118790 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:34:19 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-8e0fd9ea-835f-47d7-8c14-7ea709b9bc9d tempest-ProjectReaderTests-1460118790 None] Deleted volume successfully. Jul 07 17:34:19 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-8e0fd9ea-835f-47d7-8c14-7ea709b9bc9d tempest-ProjectReaderTests-1460118790 None] Lock "cinder-530351b3-6629-4a43-befa-679fa0d74f48-delete_volume" released by "delete_volume" :: held 3.143s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:20 devstack sudo[102301]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-68033e19-92ca-4af3-b192-e4184df15257 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-076041f7-028a-4237-a050-414118bfd440 2147483648" returned: 0 in 1.241s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-68033e19-92ca-4af3-b192-e4184df15257 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-076041f7-028a-4237-a050-414118bfd440 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:20 devstack sudo[102309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-076041f7-028a-4237-a050-414118bfd440 Jul 07 17:34:20 devstack sudo[102309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:20 devstack sudo[102309]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-68033e19-92ca-4af3-b192-e4184df15257 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-076041f7-028a-4237-a050-414118bfd440" returned: 0 in 0.774s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:20 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-68033e19-92ca-4af3-b192-e4184df15257 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] <== create_volume: return (2086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:34:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-68033e19-92ca-4af3-b192-e4184df15257 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.090s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:20 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-68033e19-92ca-4af3-b192-e4184df15257 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3be22565-f6d0-4718-9f5d-a720d70a084d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-076041f7-028a-4237-a050-414118bfd440', 'volume_size': 2}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:20 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-68033e19-92ca-4af3-b192-e4184df15257 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a18e014-a2ce-4274-8453-01822eb38118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:20 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-68033e19-92ca-4af3-b192-e4184df15257 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Volume volume-076041f7-028a-4237-a050-414118bfd440 (076041f7-028a-4237-a050-414118bfd440): created successfully Jul 07 17:34:20 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-68033e19-92ca-4af3-b192-e4184df15257 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a18e014-a2ce-4274-8453-01822eb38118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:20 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-68033e19-92ca-4af3-b192-e4184df15257 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Flow 'volume_create_manager' (bef835ce-2782-4b10-8ebb-d64f4845dd46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:21 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-68033e19-92ca-4af3-b192-e4184df15257 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Created volume successfully. Jul 07 17:34:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-76d45a6a-1086-4ddd-bc52-e4b6901a6bcf tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-76d45a6a-1086-4ddd-bc52-e4b6901a6bcf tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:22 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-76d45a6a-1086-4ddd-bc52-e4b6901a6bcf tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Creating offline snapshot f440b231-226a-43a7-ad12-2b844da30aaa of volume 076041f7-028a-4237-a050-414118bfd440 {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:34:22 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a5c28a-3b10-4397-b8d0-97c3e021d1ab]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-76d45a6a-1086-4ddd-bc52-e4b6901a6bcf tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-076041f7-028a-4237-a050-414118bfd440 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:22 devstack sudo[102321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-076041f7-028a-4237-a050-414118bfd440 Jul 07 17:34:22 devstack sudo[102321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:23 devstack sudo[102321]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-76d45a6a-1086-4ddd-bc52-e4b6901a6bcf tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-076041f7-028a-4237-a050-414118bfd440" returned: 0 in 1.052s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-76d45a6a-1086-4ddd-bc52-e4b6901a6bcf tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-076041f7-028a-4237-a050-414118bfd440,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-076041f7-028a-4237-a050-414118bfd440.f440b231-226a-43a7-ad12-2b844da30aaa 2G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:23 devstack sudo[102329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-076041f7-028a-4237-a050-414118bfd440,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-076041f7-028a-4237-a050-414118bfd440.f440b231-226a-43a7-ad12-2b844da30aaa 2G Jul 07 17:34:23 devstack sudo[102329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:24 devstack sudo[102329]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-76d45a6a-1086-4ddd-bc52-e4b6901a6bcf tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-076041f7-028a-4237-a050-414118bfd440,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-076041f7-028a-4237-a050-414118bfd440.f440b231-226a-43a7-ad12-2b844da30aaa 2G" returned: 0 in 0.893s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-76d45a6a-1086-4ddd-bc52-e4b6901a6bcf tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-076041f7-028a-4237-a050-414118bfd440 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-076041f7-028a-4237-a050-414118bfd440.f440b231-226a-43a7-ad12-2b844da30aaa {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:24 devstack sudo[102335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-076041f7-028a-4237-a050-414118bfd440 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-076041f7-028a-4237-a050-414118bfd440.f440b231-226a-43a7-ad12-2b844da30aaa Jul 07 17:34:24 devstack sudo[102335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:25 devstack sudo[102335]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-76d45a6a-1086-4ddd-bc52-e4b6901a6bcf tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-076041f7-028a-4237-a050-414118bfd440 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-076041f7-028a-4237-a050-414118bfd440.f440b231-226a-43a7-ad12-2b844da30aaa" returned: 0 in 0.814s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:25 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-76d45a6a-1086-4ddd-bc52-e4b6901a6bcf tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-076041f7-028a-4237-a050-414118bfd440.f440b231-226a-43a7-ad12-2b844da30aaa is being set with open permissions: ugo+rw Jul 07 17:34:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-76d45a6a-1086-4ddd-bc52-e4b6901a6bcf tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-076041f7-028a-4237-a050-414118bfd440.f440b231-226a-43a7-ad12-2b844da30aaa {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:25 devstack sudo[102342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-076041f7-028a-4237-a050-414118bfd440.f440b231-226a-43a7-ad12-2b844da30aaa Jul 07 17:34:25 devstack sudo[102342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:25 devstack sudo[102342]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-76d45a6a-1086-4ddd-bc52-e4b6901a6bcf tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-076041f7-028a-4237-a050-414118bfd440.f440b231-226a-43a7-ad12-2b844da30aaa" returned: 0 in 0.677s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-76d45a6a-1086-4ddd-bc52-e4b6901a6bcf tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-076041f7-028a-4237-a050-414118bfd440.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:26 devstack sudo[102345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-076041f7-028a-4237-a050-414118bfd440.info Jul 07 17:34:26 devstack sudo[102345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:26 devstack sudo[102345]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-76d45a6a-1086-4ddd-bc52-e4b6901a6bcf tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-076041f7-028a-4237-a050-414118bfd440.info" returned: 0 in 0.788s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:26 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-76d45a6a-1086-4ddd-bc52-e4b6901a6bcf tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-076041f7-028a-4237-a050-414118bfd440.info is being set with open permissions: ugo+rw Jul 07 17:34:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-76d45a6a-1086-4ddd-bc52-e4b6901a6bcf tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-076041f7-028a-4237-a050-414118bfd440.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:26 devstack sudo[102348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-076041f7-028a-4237-a050-414118bfd440.info Jul 07 17:34:26 devstack sudo[102348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:27 devstack sudo[102348]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-76d45a6a-1086-4ddd-bc52-e4b6901a6bcf tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-076041f7-028a-4237-a050-414118bfd440.info" returned: 0 in 0.747s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-76d45a6a-1086-4ddd-bc52-e4b6901a6bcf tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.078s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:27 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-76d45a6a-1086-4ddd-bc52-e4b6901a6bcf tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Create snapshot completed successfully Jul 07 17:34:27 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a50dedde-b2f5-41cb-85c0-57b2e11011f5 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Acquiring lock "cinder-f440b231-226a-43a7-ad12-2b844da30aaa-delete_snapshot" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:27 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a50dedde-b2f5-41cb-85c0-57b2e11011f5 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Lock "cinder-f440b231-226a-43a7-ad12-2b844da30aaa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:27 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a50dedde-b2f5-41cb-85c0-57b2e11011f5 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Acquiring lock "cinder-quobyte-076041f7-028a-4237-a050-414118bfd440" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:27 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a50dedde-b2f5-41cb-85c0-57b2e11011f5 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Lock "cinder-quobyte-076041f7-028a-4237-a050-414118bfd440" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:27 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a50dedde-b2f5-41cb-85c0-57b2e11011f5 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Acquiring lock "cinder-quobyte-f440b231-226a-43a7-ad12-2b844da30aaa" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:27 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a50dedde-b2f5-41cb-85c0-57b2e11011f5 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Lock "cinder-quobyte-f440b231-226a-43a7-ad12-2b844da30aaa" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:27 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-a50dedde-b2f5-41cb-85c0-57b2e11011f5 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Deleting offline snapshot f440b231-226a-43a7-ad12-2b844da30aaa of volume 076041f7-028a-4237-a050-414118bfd440 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:34:27 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-a50dedde-b2f5-41cb-85c0-57b2e11011f5 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] snapshot_file for this snap is: volume-076041f7-028a-4237-a050-414118bfd440.f440b231-226a-43a7-ad12-2b844da30aaa {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:34:27 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[763cdd1d-d8b0-4917-bbb4-c8f67dc45dfe]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a50dedde-b2f5-41cb-85c0-57b2e11011f5 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-076041f7-028a-4237-a050-414118bfd440.f440b231-226a-43a7-ad12-2b844da30aaa {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:28 devstack sudo[102352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-076041f7-028a-4237-a050-414118bfd440.f440b231-226a-43a7-ad12-2b844da30aaa Jul 07 17:34:28 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:28 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a50dedde-b2f5-41cb-85c0-57b2e11011f5 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-076041f7-028a-4237-a050-414118bfd440.f440b231-226a-43a7-ad12-2b844da30aaa" returned: 0 in 1.005s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:28 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-a50dedde-b2f5-41cb-85c0-57b2e11011f5 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-076041f7-028a-4237-a050-414118bfd440(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:34:29 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a018749-a7b3-48bd-837f-2692303ae704]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a50dedde-b2f5-41cb-85c0-57b2e11011f5 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-076041f7-028a-4237-a050-414118bfd440 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:29 devstack sudo[102358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-076041f7-028a-4237-a050-414118bfd440 Jul 07 17:34:29 devstack sudo[102358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:29 devstack sudo[102358]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a50dedde-b2f5-41cb-85c0-57b2e11011f5 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-076041f7-028a-4237-a050-414118bfd440" returned: 0 in 0.876s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a50dedde-b2f5-41cb-85c0-57b2e11011f5 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-076041f7-028a-4237-a050-414118bfd440.f440b231-226a-43a7-ad12-2b844da30aaa {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:29 devstack sudo[102363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-076041f7-028a-4237-a050-414118bfd440.f440b231-226a-43a7-ad12-2b844da30aaa Jul 07 17:34:29 devstack sudo[102363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:30 devstack sudo[102363]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a50dedde-b2f5-41cb-85c0-57b2e11011f5 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-076041f7-028a-4237-a050-414118bfd440.f440b231-226a-43a7-ad12-2b844da30aaa" returned: 0 in 0.924s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a50dedde-b2f5-41cb-85c0-57b2e11011f5 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-076041f7-028a-4237-a050-414118bfd440.f440b231-226a-43a7-ad12-2b844da30aaa {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:30 devstack sudo[102369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-076041f7-028a-4237-a050-414118bfd440.f440b231-226a-43a7-ad12-2b844da30aaa Jul 07 17:34:30 devstack sudo[102369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:31 devstack sudo[102369]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a50dedde-b2f5-41cb-85c0-57b2e11011f5 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-076041f7-028a-4237-a050-414118bfd440.f440b231-226a-43a7-ad12-2b844da30aaa" returned: 0 in 0.724s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:31 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a50dedde-b2f5-41cb-85c0-57b2e11011f5 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Lock "cinder-quobyte-f440b231-226a-43a7-ad12-2b844da30aaa" released by "_delete_snapshot" :: held 3.658s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:31 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a50dedde-b2f5-41cb-85c0-57b2e11011f5 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Lock "cinder-quobyte-076041f7-028a-4237-a050-414118bfd440" released by "delete_snapshot" :: held 3.692s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:31 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-a50dedde-b2f5-41cb-85c0-57b2e11011f5 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Created reservations ['a07c05d1-1dca-4470-82fe-e87f5b3e8110', 'c00bee73-fe2e-4598-a0b5-f8111baf6186', '378cb9ee-0e9c-4e2f-a917-3bfa9cf75405', '5b3770ea-f564-4f03-a54f-a6ecc30efa5c'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:34:31 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-a50dedde-b2f5-41cb-85c0-57b2e11011f5 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Delete snapshot completed successfully. Jul 07 17:34:31 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a50dedde-b2f5-41cb-85c0-57b2e11011f5 tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Lock "cinder-f440b231-226a-43a7-ad12-2b844da30aaa-delete_snapshot" released by "delete_snapshot" :: held 3.880s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:32 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6bbf252b-37eb-4a19-b83f-31c80c189bdf tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Acquiring lock "cinder-076041f7-028a-4237-a050-414118bfd440-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:32 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6bbf252b-37eb-4a19-b83f-31c80c189bdf tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Lock "cinder-076041f7-028a-4237-a050-414118bfd440-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:32 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6bbf252b-37eb-4a19-b83f-31c80c189bdf tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Acquiring lock "cinder-quobyte-076041f7-028a-4237-a050-414118bfd440" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:32 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6bbf252b-37eb-4a19-b83f-31c80c189bdf tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Lock "cinder-quobyte-076041f7-028a-4237-a050-414118bfd440" acquired by "delete_volume" :: waited 0.020s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:32 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[73994e5f-b257-486d-a2f9-4ca05ed4add7]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6bbf252b-37eb-4a19-b83f-31c80c189bdf tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-076041f7-028a-4237-a050-414118bfd440 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:32 devstack sudo[102372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-076041f7-028a-4237-a050-414118bfd440 Jul 07 17:34:32 devstack sudo[102372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:33 devstack sudo[102372]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6bbf252b-37eb-4a19-b83f-31c80c189bdf tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-076041f7-028a-4237-a050-414118bfd440" returned: 0 in 0.847s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6bbf252b-37eb-4a19-b83f-31c80c189bdf tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-076041f7-028a-4237-a050-414118bfd440 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:33 devstack sudo[102377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-076041f7-028a-4237-a050-414118bfd440 Jul 07 17:34:33 devstack sudo[102377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:33 devstack sudo[102377]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6bbf252b-37eb-4a19-b83f-31c80c189bdf tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-076041f7-028a-4237-a050-414118bfd440" returned: 0 in 0.686s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:34 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6bbf252b-37eb-4a19-b83f-31c80c189bdf tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Lock "cinder-quobyte-076041f7-028a-4237-a050-414118bfd440" released by "delete_volume" :: held 1.628s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:34 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-6bbf252b-37eb-4a19-b83f-31c80c189bdf tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Created reservations ['8491771e-a62c-41cf-a7d5-094098ca1964', '5020ad25-82b0-4d48-bfca-2dbc2352c439', '834c920f-f069-47a4-ae04-7b07d119eff1', 'e68ac56d-0d92-48f8-8e03-a0c971155a88'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:34:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-6bbf252b-37eb-4a19-b83f-31c80c189bdf tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-6bbf252b-37eb-4a19-b83f-31c80c189bdf tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:34 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-6bbf252b-37eb-4a19-b83f-31c80c189bdf tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:34 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-6bbf252b-37eb-4a19-b83f-31c80c189bdf tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-6bbf252b-37eb-4a19-b83f-31c80c189bdf tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6bbf252b-37eb-4a19-b83f-31c80c189bdf tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:34 devstack sudo[102380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:34:34 devstack sudo[102380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:34 devstack sudo[102380]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6bbf252b-37eb-4a19-b83f-31c80c189bdf tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.829s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:35 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-6bbf252b-37eb-4a19-b83f-31c80c189bdf tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:34:35 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-6bbf252b-37eb-4a19-b83f-31c80c189bdf tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Deleted volume successfully. Jul 07 17:34:35 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6bbf252b-37eb-4a19-b83f-31c80c189bdf tempest-VolumesSnapshotNegativeTestJSON-1627007836 None] Lock "cinder-076041f7-028a-4237-a050-414118bfd440-delete_volume" released by "delete_volume" :: held 2.705s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:43 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:34:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:43 devstack sudo[102384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:34:43 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:43 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:UPDATE=137,cinder:SELECT=103,cinder:INSERT=35,cinder:DELETE=9 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:34:43 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:UPDATE=125,cinder:SELECT=93,cinder:INSERT=41,cinder:DELETE=13 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:34:44 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.778s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:44 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:34:44 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:34:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread count: 28 {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:34:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread info: [<_MainThread(MainThread, started 126077716062336)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:34:55 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-bff417ce-20d2-4b88-850b-b37a94da1f21 tempest-SnapshotDependencyTests-675934080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:34:55 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bff417ce-20d2-4b88-850b-b37a94da1f21 tempest-SnapshotDependencyTests-675934080 None] Flow 'volume_create_manager' (5125b829-5097-4646-a338-20401588cf4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:55 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bff417ce-20d2-4b88-850b-b37a94da1f21 tempest-SnapshotDependencyTests-675934080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd548f84-abe1-418c-835f-b53fe44251e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:55 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bff417ce-20d2-4b88-850b-b37a94da1f21 tempest-SnapshotDependencyTests-675934080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd548f84-abe1-418c-835f-b53fe44251e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1879872552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04de307e-86ae-44b1-aaaa-6b137b4819b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27540c5c2beb45f9aa66e2d1b38ea608',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:55Z,use_quota=True,user_id='b9dd08a174cf4f018173cccd9a89f228',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:55 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bff417ce-20d2-4b88-850b-b37a94da1f21 tempest-SnapshotDependencyTests-675934080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a5e1931-d9c3-4178-be64-c96f7ee96b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:55 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bff417ce-20d2-4b88-850b-b37a94da1f21 tempest-SnapshotDependencyTests-675934080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a5e1931-d9c3-4178-be64-c96f7ee96b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:55 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bff417ce-20d2-4b88-850b-b37a94da1f21 tempest-SnapshotDependencyTests-675934080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b9cd75-5f15-402f-9a95-34d1629f27cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:55 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bff417ce-20d2-4b88-850b-b37a94da1f21 tempest-SnapshotDependencyTests-675934080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b9cd75-5f15-402f-9a95-34d1629f27cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04de307e-86ae-44b1-aaaa-6b137b4819b4', 'volume_name': 'volume-04de307e-86ae-44b1-aaaa-6b137b4819b4', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:55 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bff417ce-20d2-4b88-850b-b37a94da1f21 tempest-SnapshotDependencyTests-675934080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e14768ab-9ba4-475a-b00f-98bfd171a87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:55 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bff417ce-20d2-4b88-850b-b37a94da1f21 tempest-SnapshotDependencyTests-675934080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e14768ab-9ba4-475a-b00f-98bfd171a87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:55 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bff417ce-20d2-4b88-850b-b37a94da1f21 tempest-SnapshotDependencyTests-675934080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cef20250-2793-4602-a29a-cdb9e8681636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:55 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-bff417ce-20d2-4b88-850b-b37a94da1f21 tempest-SnapshotDependencyTests-675934080 None] Volume 04de307e-86ae-44b1-aaaa-6b137b4819b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04de307e-86ae-44b1-aaaa-6b137b4819b4', 'volume_size': 1} Jul 07 17:34:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bff417ce-20d2-4b88-850b-b37a94da1f21 tempest-SnapshotDependencyTests-675934080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bff417ce-20d2-4b88-850b-b37a94da1f21 tempest-SnapshotDependencyTests-675934080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:55 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bff417ce-20d2-4b88-850b-b37a94da1f21 tempest-SnapshotDependencyTests-675934080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1879872552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04de307e-86ae-44b1-aaaa-6b137b4819b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27540c5c2beb45f9aa66e2d1b38ea608',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:55Z,use_quota=True,user_id='b9dd08a174cf4f018173cccd9a89f228',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:34:55 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-bff417ce-20d2-4b88-850b-b37a94da1f21 tempest-SnapshotDependencyTests-675934080 None] Creating volume 04de307e-86ae-44b1-aaaa-6b137b4819b4 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:34:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bff417ce-20d2-4b88-850b-b37a94da1f21 tempest-SnapshotDependencyTests-675934080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bff417ce-20d2-4b88-850b-b37a94da1f21 tempest-SnapshotDependencyTests-675934080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:55 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bff417ce-20d2-4b88-850b-b37a94da1f21 tempest-SnapshotDependencyTests-675934080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:55 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bff417ce-20d2-4b88-850b-b37a94da1f21 tempest-SnapshotDependencyTests-675934080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bff417ce-20d2-4b88-850b-b37a94da1f21 tempest-SnapshotDependencyTests-675934080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:55 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bff417ce-20d2-4b88-850b-b37a94da1f21 tempest-SnapshotDependencyTests-675934080 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:34:55 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-bff417ce-20d2-4b88-850b-b37a94da1f21 tempest-SnapshotDependencyTests-675934080 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:34:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bff417ce-20d2-4b88-850b-b37a94da1f21 tempest-SnapshotDependencyTests-675934080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:55 devstack sudo[102393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4 1073741824 Jul 07 17:34:55 devstack sudo[102393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:56 devstack sudo[102393]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bff417ce-20d2-4b88-850b-b37a94da1f21 tempest-SnapshotDependencyTests-675934080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4 1073741824" returned: 0 in 1.023s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bff417ce-20d2-4b88-850b-b37a94da1f21 tempest-SnapshotDependencyTests-675934080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:56 devstack sudo[102400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4 Jul 07 17:34:56 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:57 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bff417ce-20d2-4b88-850b-b37a94da1f21 tempest-SnapshotDependencyTests-675934080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4" returned: 0 in 0.800s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:57 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bff417ce-20d2-4b88-850b-b37a94da1f21 tempest-SnapshotDependencyTests-675934080 None] <== create_volume: return (1895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:34:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bff417ce-20d2-4b88-850b-b37a94da1f21 tempest-SnapshotDependencyTests-675934080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.899s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bff417ce-20d2-4b88-850b-b37a94da1f21 tempest-SnapshotDependencyTests-675934080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cef20250-2793-4602-a29a-cdb9e8681636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04de307e-86ae-44b1-aaaa-6b137b4819b4', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bff417ce-20d2-4b88-850b-b37a94da1f21 tempest-SnapshotDependencyTests-675934080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a25aa300-7525-4eb4-9277-379be2059bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:57 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-bff417ce-20d2-4b88-850b-b37a94da1f21 tempest-SnapshotDependencyTests-675934080 None] Volume volume-04de307e-86ae-44b1-aaaa-6b137b4819b4 (04de307e-86ae-44b1-aaaa-6b137b4819b4): created successfully Jul 07 17:34:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bff417ce-20d2-4b88-850b-b37a94da1f21 tempest-SnapshotDependencyTests-675934080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a25aa300-7525-4eb4-9277-379be2059bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bff417ce-20d2-4b88-850b-b37a94da1f21 tempest-SnapshotDependencyTests-675934080 None] Flow 'volume_create_manager' (5125b829-5097-4646-a338-20401588cf4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:57 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-bff417ce-20d2-4b88-850b-b37a94da1f21 tempest-SnapshotDependencyTests-675934080 None] Created volume successfully. Jul 07 17:34:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e07ee7ef-b9f3-413e-98aa-2b6b8ffe568a tempest-SnapshotDependencyTests-675934080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e07ee7ef-b9f3-413e-98aa-2b6b8ffe568a tempest-SnapshotDependencyTests-675934080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:58 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-e07ee7ef-b9f3-413e-98aa-2b6b8ffe568a tempest-SnapshotDependencyTests-675934080 None] Creating offline snapshot 5bc51595-52f8-43ba-be42-8af0ec48a8b3 of volume 04de307e-86ae-44b1-aaaa-6b137b4819b4 {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:34:58 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14796ec-464d-4fb4-82d7-82a0ab73127a]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e07ee7ef-b9f3-413e-98aa-2b6b8ffe568a tempest-SnapshotDependencyTests-675934080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:58 devstack sudo[102403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4 Jul 07 17:34:58 devstack sudo[102403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:59 devstack sudo[102403]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e07ee7ef-b9f3-413e-98aa-2b6b8ffe568a tempest-SnapshotDependencyTests-675934080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4" returned: 0 in 0.929s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e07ee7ef-b9f3-413e-98aa-2b6b8ffe568a tempest-SnapshotDependencyTests-675934080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4.5bc51595-52f8-43ba-be42-8af0ec48a8b3 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:59 devstack sudo[102408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4.5bc51595-52f8-43ba-be42-8af0ec48a8b3 1G Jul 07 17:34:59 devstack sudo[102408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:00 devstack sudo[102408]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e07ee7ef-b9f3-413e-98aa-2b6b8ffe568a tempest-SnapshotDependencyTests-675934080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4.5bc51595-52f8-43ba-be42-8af0ec48a8b3 1G" returned: 0 in 0.934s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e07ee7ef-b9f3-413e-98aa-2b6b8ffe568a tempest-SnapshotDependencyTests-675934080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04de307e-86ae-44b1-aaaa-6b137b4819b4 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4.5bc51595-52f8-43ba-be42-8af0ec48a8b3 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:00 devstack sudo[102419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04de307e-86ae-44b1-aaaa-6b137b4819b4 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4.5bc51595-52f8-43ba-be42-8af0ec48a8b3 Jul 07 17:35:00 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:01 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e07ee7ef-b9f3-413e-98aa-2b6b8ffe568a tempest-SnapshotDependencyTests-675934080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04de307e-86ae-44b1-aaaa-6b137b4819b4 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4.5bc51595-52f8-43ba-be42-8af0ec48a8b3" returned: 0 in 0.877s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:01 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-e07ee7ef-b9f3-413e-98aa-2b6b8ffe568a tempest-SnapshotDependencyTests-675934080 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4.5bc51595-52f8-43ba-be42-8af0ec48a8b3 is being set with open permissions: ugo+rw Jul 07 17:35:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e07ee7ef-b9f3-413e-98aa-2b6b8ffe568a tempest-SnapshotDependencyTests-675934080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4.5bc51595-52f8-43ba-be42-8af0ec48a8b3 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:01 devstack sudo[102425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4.5bc51595-52f8-43ba-be42-8af0ec48a8b3 Jul 07 17:35:01 devstack sudo[102425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:02 devstack sudo[102425]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e07ee7ef-b9f3-413e-98aa-2b6b8ffe568a tempest-SnapshotDependencyTests-675934080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4.5bc51595-52f8-43ba-be42-8af0ec48a8b3" returned: 0 in 0.732s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e07ee7ef-b9f3-413e-98aa-2b6b8ffe568a tempest-SnapshotDependencyTests-675934080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:02 devstack sudo[102431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4.info Jul 07 17:35:02 devstack sudo[102431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:03 devstack sudo[102431]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e07ee7ef-b9f3-413e-98aa-2b6b8ffe568a tempest-SnapshotDependencyTests-675934080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4.info" returned: 0 in 0.882s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:03 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-e07ee7ef-b9f3-413e-98aa-2b6b8ffe568a tempest-SnapshotDependencyTests-675934080 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4.info is being set with open permissions: ugo+rw Jul 07 17:35:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e07ee7ef-b9f3-413e-98aa-2b6b8ffe568a tempest-SnapshotDependencyTests-675934080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:03 devstack sudo[102434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4.info Jul 07 17:35:03 devstack sudo[102434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:03 devstack sudo[102434]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e07ee7ef-b9f3-413e-98aa-2b6b8ffe568a tempest-SnapshotDependencyTests-675934080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4.info" returned: 0 in 0.732s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e07ee7ef-b9f3-413e-98aa-2b6b8ffe568a tempest-SnapshotDependencyTests-675934080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.242s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:03 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-e07ee7ef-b9f3-413e-98aa-2b6b8ffe568a tempest-SnapshotDependencyTests-675934080 None] Create snapshot completed successfully Jul 07 17:35:05 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-f65161db-5cca-4131-b69f-993f895981e2 tempest-TestStampPattern-823481616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:35:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f65161db-5cca-4131-b69f-993f895981e2 tempest-TestStampPattern-823481616 None] Flow 'volume_create_manager' (d822323a-68b4-420e-8345-3fb33573d343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:35:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f65161db-5cca-4131-b69f-993f895981e2 tempest-TestStampPattern-823481616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e6bcc56-4eaa-407f-bcf6-8e2a6d7b5e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f65161db-5cca-4131-b69f-993f895981e2 tempest-TestStampPattern-823481616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e6bcc56-4eaa-407f-bcf6-8e2a6d7b5e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-320139925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2729b0bd-6b21-4aff-ac1b-6095c4151400,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6091c9caa434ded88e00dbc9c128eb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:35:05Z,use_quota=True,user_id='94b30850028e4b138ced903ecec4d69d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f65161db-5cca-4131-b69f-993f895981e2 tempest-TestStampPattern-823481616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (937c8074-c2de-4e96-ab00-fe8f7ec992ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f65161db-5cca-4131-b69f-993f895981e2 tempest-TestStampPattern-823481616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (937c8074-c2de-4e96-ab00-fe8f7ec992ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f65161db-5cca-4131-b69f-993f895981e2 tempest-TestStampPattern-823481616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0c959de-f060-4eb7-a445-3ea3d0325944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f65161db-5cca-4131-b69f-993f895981e2 tempest-TestStampPattern-823481616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0c959de-f060-4eb7-a445-3ea3d0325944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2729b0bd-6b21-4aff-ac1b-6095c4151400', 'volume_name': 'volume-2729b0bd-6b21-4aff-ac1b-6095c4151400', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f65161db-5cca-4131-b69f-993f895981e2 tempest-TestStampPattern-823481616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d447472b-e647-4f74-975d-f5ae6ddfb947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f65161db-5cca-4131-b69f-993f895981e2 tempest-TestStampPattern-823481616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d447472b-e647-4f74-975d-f5ae6ddfb947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f65161db-5cca-4131-b69f-993f895981e2 tempest-TestStampPattern-823481616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d989c41a-515e-4afe-bdb6-92171e7b8668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:05 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-f65161db-5cca-4131-b69f-993f895981e2 tempest-TestStampPattern-823481616 None] Volume 2729b0bd-6b21-4aff-ac1b-6095c4151400: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2729b0bd-6b21-4aff-ac1b-6095c4151400', 'volume_size': 1} Jul 07 17:35:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f65161db-5cca-4131-b69f-993f895981e2 tempest-TestStampPattern-823481616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f65161db-5cca-4131-b69f-993f895981e2 tempest-TestStampPattern-823481616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:05 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-f65161db-5cca-4131-b69f-993f895981e2 tempest-TestStampPattern-823481616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-320139925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2729b0bd-6b21-4aff-ac1b-6095c4151400,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6091c9caa434ded88e00dbc9c128eb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:35:05Z,use_quota=True,user_id='94b30850028e4b138ced903ecec4d69d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:35:05 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-f65161db-5cca-4131-b69f-993f895981e2 tempest-TestStampPattern-823481616 None] Creating volume 2729b0bd-6b21-4aff-ac1b-6095c4151400 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:35:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f65161db-5cca-4131-b69f-993f895981e2 tempest-TestStampPattern-823481616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f65161db-5cca-4131-b69f-993f895981e2 tempest-TestStampPattern-823481616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:05 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-f65161db-5cca-4131-b69f-993f895981e2 tempest-TestStampPattern-823481616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:35:05 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-f65161db-5cca-4131-b69f-993f895981e2 tempest-TestStampPattern-823481616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:35:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f65161db-5cca-4131-b69f-993f895981e2 tempest-TestStampPattern-823481616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:05 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-f65161db-5cca-4131-b69f-993f895981e2 tempest-TestStampPattern-823481616 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:35:05 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-f65161db-5cca-4131-b69f-993f895981e2 tempest-TestStampPattern-823481616 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:35:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f65161db-5cca-4131-b69f-993f895981e2 tempest-TestStampPattern-823481616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:05 devstack sudo[102438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400 1073741824 Jul 07 17:35:05 devstack sudo[102438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:05 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:35:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Flow 'volume_create_manager' (4574a0b5-4ef1-4821-ae39-b4e584b444a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:35:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9941bc0e-246b-40a7-a495-c6f894ead7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9941bc0e-246b-40a7-a495-c6f894ead7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c219e0d9-a636-4478-bf96-d29d554796f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27540c5c2beb45f9aa66e2d1b38ea608',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:35:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5bc51595-52f8-43ba-be42-8af0ec48a8b3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:35:06Z,use_quota=True,user_id='b9dd08a174cf4f018173cccd9a89f228',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9994567d-4b56-4181-b2b7-333ee03042c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9994567d-4b56-4181-b2b7-333ee03042c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c68d2d74-5304-4c9f-b55f-8d10e663b894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c68d2d74-5304-4c9f-b55f-8d10e663b894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c219e0d9-a636-4478-bf96-d29d554796f9', 'volume_name': 'volume-c219e0d9-a636-4478-bf96-d29d554796f9', 'volume_size': 1, 'snapshot_id': '5bc51595-52f8-43ba-be42-8af0ec48a8b3'}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b152b36a-c8e0-4729-9883-96519dd13ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b152b36a-c8e0-4729-9883-96519dd13ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (555491d0-9dac-4b52-b8bd-5b0c0ad93931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:05 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Volume c219e0d9-a636-4478-bf96-d29d554796f9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c219e0d9-a636-4478-bf96-d29d554796f9', 'volume_size': 1, 'snapshot_id': '5bc51595-52f8-43ba-be42-8af0ec48a8b3'} Jul 07 17:35:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:06 devstack sudo[102438]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f65161db-5cca-4131-b69f-993f895981e2 tempest-TestStampPattern-823481616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400 1073741824" returned: 0 in 1.095s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f65161db-5cca-4131-b69f-993f895981e2 tempest-TestStampPattern-823481616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:06 devstack sudo[102448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400 Jul 07 17:35:06 devstack sudo[102448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:07 devstack sudo[102448]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f65161db-5cca-4131-b69f-993f895981e2 tempest-TestStampPattern-823481616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400" returned: 0 in 0.940s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:07 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-f65161db-5cca-4131-b69f-993f895981e2 tempest-TestStampPattern-823481616 None] <== create_volume: return (2106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:35:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f65161db-5cca-4131-b69f-993f895981e2 tempest-TestStampPattern-823481616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.110s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.756s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:07 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Acquiring lock "cinder-quobyte-5bc51595-52f8-43ba-be42-8af0ec48a8b3-c219e0d9-a636-4478-bf96-d29d554796f9" by "_create_volume_from_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:07 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f65161db-5cca-4131-b69f-993f895981e2 tempest-TestStampPattern-823481616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d989c41a-515e-4afe-bdb6-92171e7b8668) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2729b0bd-6b21-4aff-ac1b-6095c4151400', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:07 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f65161db-5cca-4131-b69f-993f895981e2 tempest-TestStampPattern-823481616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (833152f8-e0c4-4cff-827d-1b2daa2660c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:07 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Lock "cinder-quobyte-5bc51595-52f8-43ba-be42-8af0ec48a8b3-c219e0d9-a636-4478-bf96-d29d554796f9" acquired by "_create_volume_from_snapshot" :: waited 0.052s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:07 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Creating volume c219e0d9-a636-4478-bf96-d29d554796f9 from snapshot 5bc51595-52f8-43ba-be42-8af0ec48a8b3 {{(pid=87233) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 17:35:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:07 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:35:07 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:35:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:07 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:35:07 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Acquiring lock "cinder-quobyte-c219e0d9-a636-4478-bf96-d29d554796f9" by "_copy_volume_from_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:07 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-f65161db-5cca-4131-b69f-993f895981e2 tempest-TestStampPattern-823481616 None] Volume volume-2729b0bd-6b21-4aff-ac1b-6095c4151400 (2729b0bd-6b21-4aff-ac1b-6095c4151400): created successfully Jul 07 17:35:07 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f65161db-5cca-4131-b69f-993f895981e2 tempest-TestStampPattern-823481616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (833152f8-e0c4-4cff-827d-1b2daa2660c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:07 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f65161db-5cca-4131-b69f-993f895981e2 tempest-TestStampPattern-823481616 None] Flow 'volume_create_manager' (d822323a-68b4-420e-8345-3fb33573d343) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:35:07 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Lock "cinder-quobyte-c219e0d9-a636-4478-bf96-d29d554796f9" acquired by "_copy_volume_from_snapshot" :: waited 0.060s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:07 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] snapshot: 5bc51595-52f8-43ba-be42-8af0ec48a8b3, volume: c219e0d9-a636-4478-bf96-d29d554796f9, {{(pid=87233) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 17:35:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:07 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:35:07 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:35:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:07 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-f65161db-5cca-4131-b69f-993f895981e2 tempest-TestStampPattern-823481616 None] Created volume successfully. Jul 07 17:35:07 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[687dda63-e7f0-471e-87f3-8701a0d25de1]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4.5bc51595-52f8-43ba-be42-8af0ec48a8b3 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:07 devstack sudo[102451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4.5bc51595-52f8-43ba-be42-8af0ec48a8b3 Jul 07 17:35:07 devstack sudo[102451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:08 devstack sudo[102451]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4.5bc51595-52f8-43ba-be42-8af0ec48a8b3" returned: 0 in 0.848s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:08 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04de307e-86ae-44b1-aaaa-6b137b4819b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:35:08 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] will copy from snapshot at /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4 {{(pid=87233) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 17:35:08 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Creating direct copy from snapshot {{(pid=87233) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 17:35:08 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78ab20a-724e-4fe7-a56b-4951eaba8857]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:08 devstack sudo[102457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4 Jul 07 17:35:08 devstack sudo[102457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:09 devstack sudo[102457]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4" returned: 0 in 0.861s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:09 devstack cinder-volume[87233]: DEBUG cinder.utils [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Path /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c219e0d9-a636-4478-bf96-d29d554796f9 not found in is_blk_device check {{(pid=87233) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 17:35:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c219e0d9-a636-4478-bf96-d29d554796f9 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:09 devstack sudo[102462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c219e0d9-a636-4478-bf96-d29d554796f9 Jul 07 17:35:09 devstack sudo[102462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:15 devstack sudo[102462]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c219e0d9-a636-4478-bf96-d29d554796f9" returned: 0 in 5.858s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:15 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[543d855d-cb8a-4f55-b56d-9b2301b4b549]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:15 devstack sudo[102495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4 Jul 07 17:35:15 devstack sudo[102495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:16 devstack sudo[102495]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4" returned: 0 in 1.197s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:16 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Image conversion details: src /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4, size 1024.00 MB, duration 5.86 sec, destination /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c219e0d9-a636-4478-bf96-d29d554796f9 {{(pid=87233) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:35:16 devstack cinder-volume[87233]: INFO cinder.image.image_utils [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Converted 1024.00 MB image at 174.76 MB/s Jul 07 17:35:16 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c219e0d9-a636-4478-bf96-d29d554796f9 is being set with open permissions: ugo+rw Jul 07 17:35:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c219e0d9-a636-4478-bf96-d29d554796f9 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:16 devstack sudo[102502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c219e0d9-a636-4478-bf96-d29d554796f9 Jul 07 17:35:16 devstack sudo[102502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:17 devstack sudo[102502]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c219e0d9-a636-4478-bf96-d29d554796f9" returned: 0 in 0.778s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:17 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Lock "cinder-quobyte-c219e0d9-a636-4478-bf96-d29d554796f9" released by "_copy_volume_from_snapshot" :: held 9.719s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:17 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Lock "cinder-quobyte-5bc51595-52f8-43ba-be42-8af0ec48a8b3-c219e0d9-a636-4478-bf96-d29d554796f9" released by "_create_volume_from_snapshot" :: held 9.797s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.850s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:17 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (555491d0-9dac-4b52-b8bd-5b0c0ad93931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c219e0d9-a636-4478-bf96-d29d554796f9', 'volume_size': 1, 'snapshot_id': '5bc51595-52f8-43ba-be42-8af0ec48a8b3'}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:17 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf66def6-9937-4e08-83f1-4a581b276fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:17 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Volume volume-c219e0d9-a636-4478-bf96-d29d554796f9 (c219e0d9-a636-4478-bf96-d29d554796f9): created successfully Jul 07 17:35:17 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf66def6-9937-4e08-83f1-4a581b276fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:17 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Flow 'volume_create_manager' (4574a0b5-4ef1-4821-ae39-b4e584b444a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:35:17 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-c6fad469-5453-419d-8d44-52c71c8793e0 tempest-SnapshotDependencyTests-675934080 None] Created volume successfully. Jul 07 17:35:17 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c11796d4-d868-4205-926d-93bbc50bffaf tempest-SnapshotDependencyTests-675934080 None] Acquiring lock "cinder-5bc51595-52f8-43ba-be42-8af0ec48a8b3-delete_snapshot" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:17 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c11796d4-d868-4205-926d-93bbc50bffaf tempest-SnapshotDependencyTests-675934080 None] Lock "cinder-5bc51595-52f8-43ba-be42-8af0ec48a8b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:17 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c11796d4-d868-4205-926d-93bbc50bffaf tempest-SnapshotDependencyTests-675934080 None] Acquiring lock "cinder-quobyte-04de307e-86ae-44b1-aaaa-6b137b4819b4" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:17 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c11796d4-d868-4205-926d-93bbc50bffaf tempest-SnapshotDependencyTests-675934080 None] Lock "cinder-quobyte-04de307e-86ae-44b1-aaaa-6b137b4819b4" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:17 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c11796d4-d868-4205-926d-93bbc50bffaf tempest-SnapshotDependencyTests-675934080 None] Acquiring lock "cinder-quobyte-5bc51595-52f8-43ba-be42-8af0ec48a8b3" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:17 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c11796d4-d868-4205-926d-93bbc50bffaf tempest-SnapshotDependencyTests-675934080 None] Lock "cinder-quobyte-5bc51595-52f8-43ba-be42-8af0ec48a8b3" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:17 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-c11796d4-d868-4205-926d-93bbc50bffaf tempest-SnapshotDependencyTests-675934080 None] Deleting offline snapshot 5bc51595-52f8-43ba-be42-8af0ec48a8b3 of volume 04de307e-86ae-44b1-aaaa-6b137b4819b4 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:35:17 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-c11796d4-d868-4205-926d-93bbc50bffaf tempest-SnapshotDependencyTests-675934080 None] snapshot_file for this snap is: volume-04de307e-86ae-44b1-aaaa-6b137b4819b4.5bc51595-52f8-43ba-be42-8af0ec48a8b3 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:35:18 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b369bab-6bf1-4aad-8f2d-35e72cf95884]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c11796d4-d868-4205-926d-93bbc50bffaf tempest-SnapshotDependencyTests-675934080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4.5bc51595-52f8-43ba-be42-8af0ec48a8b3 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:18 devstack sudo[102545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4.5bc51595-52f8-43ba-be42-8af0ec48a8b3 Jul 07 17:35:18 devstack sudo[102545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:18 devstack sudo[102545]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c11796d4-d868-4205-926d-93bbc50bffaf tempest-SnapshotDependencyTests-675934080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4.5bc51595-52f8-43ba-be42-8af0ec48a8b3" returned: 0 in 0.802s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:18 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-c11796d4-d868-4205-926d-93bbc50bffaf tempest-SnapshotDependencyTests-675934080 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04de307e-86ae-44b1-aaaa-6b137b4819b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:35:18 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9232354-37bf-4e05-a921-ce5d740bf6c6]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c11796d4-d868-4205-926d-93bbc50bffaf tempest-SnapshotDependencyTests-675934080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:18 devstack sudo[102551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4 Jul 07 17:35:18 devstack sudo[102551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:19 devstack sudo[102551]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c11796d4-d868-4205-926d-93bbc50bffaf tempest-SnapshotDependencyTests-675934080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4" returned: 0 in 0.875s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c11796d4-d868-4205-926d-93bbc50bffaf tempest-SnapshotDependencyTests-675934080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4.5bc51595-52f8-43ba-be42-8af0ec48a8b3 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:19 devstack sudo[102577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4.5bc51595-52f8-43ba-be42-8af0ec48a8b3 Jul 07 17:35:19 devstack sudo[102577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:20 devstack sudo[102577]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c11796d4-d868-4205-926d-93bbc50bffaf tempest-SnapshotDependencyTests-675934080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4.5bc51595-52f8-43ba-be42-8af0ec48a8b3" returned: 0 in 0.896s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c11796d4-d868-4205-926d-93bbc50bffaf tempest-SnapshotDependencyTests-675934080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4.5bc51595-52f8-43ba-be42-8af0ec48a8b3 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:20 devstack sudo[102608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4.5bc51595-52f8-43ba-be42-8af0ec48a8b3 Jul 07 17:35:20 devstack sudo[102608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:21 devstack sudo[102608]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c11796d4-d868-4205-926d-93bbc50bffaf tempest-SnapshotDependencyTests-675934080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4.5bc51595-52f8-43ba-be42-8af0ec48a8b3" returned: 0 in 0.700s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:21 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c11796d4-d868-4205-926d-93bbc50bffaf tempest-SnapshotDependencyTests-675934080 None] Lock "cinder-quobyte-5bc51595-52f8-43ba-be42-8af0ec48a8b3" released by "_delete_snapshot" :: held 3.396s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:21 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c11796d4-d868-4205-926d-93bbc50bffaf tempest-SnapshotDependencyTests-675934080 None] Lock "cinder-quobyte-04de307e-86ae-44b1-aaaa-6b137b4819b4" released by "delete_snapshot" :: held 3.434s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:21 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-c11796d4-d868-4205-926d-93bbc50bffaf tempest-SnapshotDependencyTests-675934080 None] Created reservations ['ad70e346-76e8-4c9e-a369-7f178dbd97bc', '6e79d755-08dd-497c-aa7b-7eae362770bc', '8c9b8919-852c-41a4-92f0-852db496494b', 'ea89b739-5704-4cb0-a337-97dcab4e1e0e'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:35:21 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-c11796d4-d868-4205-926d-93bbc50bffaf tempest-SnapshotDependencyTests-675934080 None] Delete snapshot completed successfully. Jul 07 17:35:21 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c11796d4-d868-4205-926d-93bbc50bffaf tempest-SnapshotDependencyTests-675934080 None] Lock "cinder-5bc51595-52f8-43ba-be42-8af0ec48a8b3-delete_snapshot" released by "delete_snapshot" :: held 3.578s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:22 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-1ae945bc-3b33-4c1a-9fa8-19360627ef1a tempest-SnapshotDependencyTests-675934080 None] Acquiring lock "cinder-04de307e-86ae-44b1-aaaa-6b137b4819b4-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:22 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-1ae945bc-3b33-4c1a-9fa8-19360627ef1a tempest-SnapshotDependencyTests-675934080 None] Lock "cinder-04de307e-86ae-44b1-aaaa-6b137b4819b4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:22 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-1ae945bc-3b33-4c1a-9fa8-19360627ef1a tempest-SnapshotDependencyTests-675934080 None] Acquiring lock "cinder-quobyte-04de307e-86ae-44b1-aaaa-6b137b4819b4" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:22 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-1ae945bc-3b33-4c1a-9fa8-19360627ef1a tempest-SnapshotDependencyTests-675934080 None] Lock "cinder-quobyte-04de307e-86ae-44b1-aaaa-6b137b4819b4" acquired by "delete_volume" :: waited 0.019s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:22 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[165c9943-18c8-4428-8c86-04632b0a3638]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1ae945bc-3b33-4c1a-9fa8-19360627ef1a tempest-SnapshotDependencyTests-675934080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:22 devstack sudo[102639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4 Jul 07 17:35:22 devstack sudo[102639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:23 devstack sudo[102639]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1ae945bc-3b33-4c1a-9fa8-19360627ef1a tempest-SnapshotDependencyTests-675934080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4" returned: 0 in 1.204s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1ae945bc-3b33-4c1a-9fa8-19360627ef1a tempest-SnapshotDependencyTests-675934080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:23 devstack sudo[102646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4 Jul 07 17:35:23 devstack sudo[102646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:24 devstack sudo[102646]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1ae945bc-3b33-4c1a-9fa8-19360627ef1a tempest-SnapshotDependencyTests-675934080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-04de307e-86ae-44b1-aaaa-6b137b4819b4" returned: 0 in 0.915s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:24 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-1ae945bc-3b33-4c1a-9fa8-19360627ef1a tempest-SnapshotDependencyTests-675934080 None] Lock "cinder-quobyte-04de307e-86ae-44b1-aaaa-6b137b4819b4" released by "delete_volume" :: held 2.228s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:24 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-1ae945bc-3b33-4c1a-9fa8-19360627ef1a tempest-SnapshotDependencyTests-675934080 None] Created reservations ['5134995e-cdc7-4c9e-b343-314b80629536', '402d55e5-154b-47e9-aea3-5d7d7d6150d6', '455dff73-84a1-4f73-a278-c350ec6fa008', 'c6118018-b8d3-44e9-9ea9-2b1e8971f734'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:35:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1ae945bc-3b33-4c1a-9fa8-19360627ef1a tempest-SnapshotDependencyTests-675934080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1ae945bc-3b33-4c1a-9fa8-19360627ef1a tempest-SnapshotDependencyTests-675934080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:24 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-1ae945bc-3b33-4c1a-9fa8-19360627ef1a tempest-SnapshotDependencyTests-675934080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:35:24 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-1ae945bc-3b33-4c1a-9fa8-19360627ef1a tempest-SnapshotDependencyTests-675934080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:35:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1ae945bc-3b33-4c1a-9fa8-19360627ef1a tempest-SnapshotDependencyTests-675934080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1ae945bc-3b33-4c1a-9fa8-19360627ef1a tempest-SnapshotDependencyTests-675934080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:24 devstack sudo[102649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:35:24 devstack sudo[102649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:25 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-93f9405c-96a8-461b-ad0d-251cbfde2c4a tempest-SnapshotDependencyTests-675934080 None] Acquiring lock "cinder-c219e0d9-a636-4478-bf96-d29d554796f9-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:25 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-93f9405c-96a8-461b-ad0d-251cbfde2c4a tempest-SnapshotDependencyTests-675934080 None] Lock "cinder-c219e0d9-a636-4478-bf96-d29d554796f9-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:25 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-93f9405c-96a8-461b-ad0d-251cbfde2c4a tempest-SnapshotDependencyTests-675934080 None] Acquiring lock "cinder-quobyte-c219e0d9-a636-4478-bf96-d29d554796f9" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:25 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-93f9405c-96a8-461b-ad0d-251cbfde2c4a tempest-SnapshotDependencyTests-675934080 None] Lock "cinder-quobyte-c219e0d9-a636-4478-bf96-d29d554796f9" acquired by "delete_volume" :: waited 0.034s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:26 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5422d5bc-8aaa-4532-84c7-258bc3485d23]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-93f9405c-96a8-461b-ad0d-251cbfde2c4a tempest-SnapshotDependencyTests-675934080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c219e0d9-a636-4478-bf96-d29d554796f9 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:26 devstack sudo[102667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c219e0d9-a636-4478-bf96-d29d554796f9 Jul 07 17:35:26 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:26 devstack sudo[102649]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1ae945bc-3b33-4c1a-9fa8-19360627ef1a tempest-SnapshotDependencyTests-675934080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 1.481s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:26 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-1ae945bc-3b33-4c1a-9fa8-19360627ef1a tempest-SnapshotDependencyTests-675934080 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:35:26 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-1ae945bc-3b33-4c1a-9fa8-19360627ef1a tempest-SnapshotDependencyTests-675934080 None] Deleted volume successfully. Jul 07 17:35:26 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-1ae945bc-3b33-4c1a-9fa8-19360627ef1a tempest-SnapshotDependencyTests-675934080 None] Lock "cinder-04de307e-86ae-44b1-aaaa-6b137b4819b4-delete_volume" released by "delete_volume" :: held 4.082s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:27 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-93f9405c-96a8-461b-ad0d-251cbfde2c4a tempest-SnapshotDependencyTests-675934080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c219e0d9-a636-4478-bf96-d29d554796f9" returned: 0 in 1.270s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-93f9405c-96a8-461b-ad0d-251cbfde2c4a tempest-SnapshotDependencyTests-675934080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c219e0d9-a636-4478-bf96-d29d554796f9 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:27 devstack sudo[102689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c219e0d9-a636-4478-bf96-d29d554796f9 Jul 07 17:35:27 devstack sudo[102689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:27 devstack sudo[102689]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-93f9405c-96a8-461b-ad0d-251cbfde2c4a tempest-SnapshotDependencyTests-675934080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c219e0d9-a636-4478-bf96-d29d554796f9" returned: 0 in 0.686s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:27 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-93f9405c-96a8-461b-ad0d-251cbfde2c4a tempest-SnapshotDependencyTests-675934080 None] Lock "cinder-quobyte-c219e0d9-a636-4478-bf96-d29d554796f9" released by "delete_volume" :: held 2.029s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:28 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-93f9405c-96a8-461b-ad0d-251cbfde2c4a tempest-SnapshotDependencyTests-675934080 None] Created reservations ['7f416244-5a24-4bd5-80d3-b49da3440976', '22040570-b79e-4552-8f2b-863a61586708', '7acb26c7-cee7-4498-bd44-11d68bc2d6f4', '8677442a-9500-41ba-b338-d90ea0d612e9'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:35:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-93f9405c-96a8-461b-ad0d-251cbfde2c4a tempest-SnapshotDependencyTests-675934080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-93f9405c-96a8-461b-ad0d-251cbfde2c4a tempest-SnapshotDependencyTests-675934080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:28 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-93f9405c-96a8-461b-ad0d-251cbfde2c4a tempest-SnapshotDependencyTests-675934080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:35:28 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-93f9405c-96a8-461b-ad0d-251cbfde2c4a tempest-SnapshotDependencyTests-675934080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:35:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-93f9405c-96a8-461b-ad0d-251cbfde2c4a tempest-SnapshotDependencyTests-675934080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-93f9405c-96a8-461b-ad0d-251cbfde2c4a tempest-SnapshotDependencyTests-675934080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:28 devstack sudo[102692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:35:28 devstack sudo[102692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:28 devstack sudo[102692]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-93f9405c-96a8-461b-ad0d-251cbfde2c4a tempest-SnapshotDependencyTests-675934080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.749s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:28 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-93f9405c-96a8-461b-ad0d-251cbfde2c4a tempest-SnapshotDependencyTests-675934080 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:35:28 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-93f9405c-96a8-461b-ad0d-251cbfde2c4a tempest-SnapshotDependencyTests-675934080 None] Deleted volume successfully. Jul 07 17:35:29 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-93f9405c-96a8-461b-ad0d-251cbfde2c4a tempest-SnapshotDependencyTests-675934080 None] Lock "cinder-c219e0d9-a636-4478-bf96-d29d554796f9-delete_volume" released by "delete_volume" :: held 3.210s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:36 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb95ed08-e362-4762-94eb-e0869806f91d tempest-TestMinimumBasicScenario-25086869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:35:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bb95ed08-e362-4762-94eb-e0869806f91d tempest-TestMinimumBasicScenario-25086869 None] Flow 'volume_create_manager' (0975cc86-b433-4562-ad95-9bb62d2c93a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:35:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bb95ed08-e362-4762-94eb-e0869806f91d tempest-TestMinimumBasicScenario-25086869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1905b05-5934-47c8-87ed-ee9628a1d74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bb95ed08-e362-4762-94eb-e0869806f91d tempest-TestMinimumBasicScenario-25086869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1905b05-5934-47c8-87ed-ee9628a1d74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-496407249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb7e836a-3de1-4de7-85c2-ebf3e72d4d56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9eeeac2c546484c81dedbadef187932',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:35:37Z,use_quota=True,user_id='00a9c9d9236d4121a1f644cb2176db91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bb95ed08-e362-4762-94eb-e0869806f91d tempest-TestMinimumBasicScenario-25086869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a48f2da0-3192-43cf-bd8b-bfb926fa0d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bb95ed08-e362-4762-94eb-e0869806f91d tempest-TestMinimumBasicScenario-25086869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a48f2da0-3192-43cf-bd8b-bfb926fa0d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bb95ed08-e362-4762-94eb-e0869806f91d tempest-TestMinimumBasicScenario-25086869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (879e4a3c-9287-4f57-a3d0-d54bc09c2444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bb95ed08-e362-4762-94eb-e0869806f91d tempest-TestMinimumBasicScenario-25086869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (879e4a3c-9287-4f57-a3d0-d54bc09c2444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb7e836a-3de1-4de7-85c2-ebf3e72d4d56', 'volume_name': 'volume-eb7e836a-3de1-4de7-85c2-ebf3e72d4d56', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bb95ed08-e362-4762-94eb-e0869806f91d tempest-TestMinimumBasicScenario-25086869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (045ea1d9-7fe7-4a8e-b5b3-9a9d1aa6a4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bb95ed08-e362-4762-94eb-e0869806f91d tempest-TestMinimumBasicScenario-25086869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (045ea1d9-7fe7-4a8e-b5b3-9a9d1aa6a4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bb95ed08-e362-4762-94eb-e0869806f91d tempest-TestMinimumBasicScenario-25086869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2889618-1cc8-4e5d-9fe0-1aefc0c4d89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:36 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-bb95ed08-e362-4762-94eb-e0869806f91d tempest-TestMinimumBasicScenario-25086869 None] Volume eb7e836a-3de1-4de7-85c2-ebf3e72d4d56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb7e836a-3de1-4de7-85c2-ebf3e72d4d56', 'volume_size': 1} Jul 07 17:35:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bb95ed08-e362-4762-94eb-e0869806f91d tempest-TestMinimumBasicScenario-25086869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bb95ed08-e362-4762-94eb-e0869806f91d tempest-TestMinimumBasicScenario-25086869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:36 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bb95ed08-e362-4762-94eb-e0869806f91d tempest-TestMinimumBasicScenario-25086869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-496407249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb7e836a-3de1-4de7-85c2-ebf3e72d4d56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9eeeac2c546484c81dedbadef187932',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:35:37Z,use_quota=True,user_id='00a9c9d9236d4121a1f644cb2176db91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:35:36 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-bb95ed08-e362-4762-94eb-e0869806f91d tempest-TestMinimumBasicScenario-25086869 None] Creating volume eb7e836a-3de1-4de7-85c2-ebf3e72d4d56 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:35:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bb95ed08-e362-4762-94eb-e0869806f91d tempest-TestMinimumBasicScenario-25086869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bb95ed08-e362-4762-94eb-e0869806f91d tempest-TestMinimumBasicScenario-25086869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:36 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bb95ed08-e362-4762-94eb-e0869806f91d tempest-TestMinimumBasicScenario-25086869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:35:36 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bb95ed08-e362-4762-94eb-e0869806f91d tempest-TestMinimumBasicScenario-25086869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:35:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bb95ed08-e362-4762-94eb-e0869806f91d tempest-TestMinimumBasicScenario-25086869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:36 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bb95ed08-e362-4762-94eb-e0869806f91d tempest-TestMinimumBasicScenario-25086869 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:35:36 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-bb95ed08-e362-4762-94eb-e0869806f91d tempest-TestMinimumBasicScenario-25086869 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:35:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bb95ed08-e362-4762-94eb-e0869806f91d tempest-TestMinimumBasicScenario-25086869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-eb7e836a-3de1-4de7-85c2-ebf3e72d4d56 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:36 devstack sudo[102805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-eb7e836a-3de1-4de7-85c2-ebf3e72d4d56 1073741824 Jul 07 17:35:36 devstack sudo[102805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:37 devstack sudo[102805]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bb95ed08-e362-4762-94eb-e0869806f91d tempest-TestMinimumBasicScenario-25086869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-eb7e836a-3de1-4de7-85c2-ebf3e72d4d56 1073741824" returned: 0 in 0.999s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bb95ed08-e362-4762-94eb-e0869806f91d tempest-TestMinimumBasicScenario-25086869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-eb7e836a-3de1-4de7-85c2-ebf3e72d4d56 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:37 devstack sudo[102811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-eb7e836a-3de1-4de7-85c2-ebf3e72d4d56 Jul 07 17:35:37 devstack sudo[102811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:38 devstack sudo[102811]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bb95ed08-e362-4762-94eb-e0869806f91d tempest-TestMinimumBasicScenario-25086869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-eb7e836a-3de1-4de7-85c2-ebf3e72d4d56" returned: 0 in 0.994s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:38 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bb95ed08-e362-4762-94eb-e0869806f91d tempest-TestMinimumBasicScenario-25086869 None] <== create_volume: return (2047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:35:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bb95ed08-e362-4762-94eb-e0869806f91d tempest-TestMinimumBasicScenario-25086869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.051s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bb95ed08-e362-4762-94eb-e0869806f91d tempest-TestMinimumBasicScenario-25086869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2889618-1cc8-4e5d-9fe0-1aefc0c4d89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb7e836a-3de1-4de7-85c2-ebf3e72d4d56', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bb95ed08-e362-4762-94eb-e0869806f91d tempest-TestMinimumBasicScenario-25086869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93312210-e477-4388-a177-19f2d124f7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:38 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-bb95ed08-e362-4762-94eb-e0869806f91d tempest-TestMinimumBasicScenario-25086869 None] Volume volume-eb7e836a-3de1-4de7-85c2-ebf3e72d4d56 (eb7e836a-3de1-4de7-85c2-ebf3e72d4d56): created successfully Jul 07 17:35:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bb95ed08-e362-4762-94eb-e0869806f91d tempest-TestMinimumBasicScenario-25086869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93312210-e477-4388-a177-19f2d124f7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bb95ed08-e362-4762-94eb-e0869806f91d tempest-TestMinimumBasicScenario-25086869 None] Flow 'volume_create_manager' (0975cc86-b433-4562-ad95-9bb62d2c93a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:35:38 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-bb95ed08-e362-4762-94eb-e0869806f91d tempest-TestMinimumBasicScenario-25086869 None] Created volume successfully. Jul 07 17:35:43 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:35:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:35:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:35:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:43 devstack sudo[102826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:35:43 devstack sudo[102826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-5a309ea5-32ed-4f5c-9740-0c7a31d9ace5 req-c7001bc3-ed42-4801-911e-b7cedfa242a7 tempest-TestMinimumBasicScenario-25086869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-5a309ea5-32ed-4f5c-9740-0c7a31d9ace5 req-c7001bc3-ed42-4801-911e-b7cedfa242a7 tempest-TestMinimumBasicScenario-25086869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:43 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[330f75b6-7c13-4124-bc64-16234d590553]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-5a309ea5-32ed-4f5c-9740-0c7a31d9ace5 req-c7001bc3-ed42-4801-911e-b7cedfa242a7 tempest-TestMinimumBasicScenario-25086869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-eb7e836a-3de1-4de7-85c2-ebf3e72d4d56 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:43 devstack sudo[102829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-eb7e836a-3de1-4de7-85c2-ebf3e72d4d56 Jul 07 17:35:43 devstack sudo[102829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:44 devstack sudo[102826]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.859s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:44 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:35:44 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:35:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread count: 28 {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:35:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread info: [<_MainThread(MainThread, started 126077716062336)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:35:44 devstack sudo[102829]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-5a309ea5-32ed-4f5c-9740-0c7a31d9ace5 req-c7001bc3-ed42-4801-911e-b7cedfa242a7 tempest-TestMinimumBasicScenario-25086869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-eb7e836a-3de1-4de7-85c2-ebf3e72d4d56" returned: 0 in 1.059s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-5a309ea5-32ed-4f5c-9740-0c7a31d9ace5 req-c7001bc3-ed42-4801-911e-b7cedfa242a7 tempest-TestMinimumBasicScenario-25086869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.080s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-5a309ea5-32ed-4f5c-9740-0c7a31d9ace5 req-c7001bc3-ed42-4801-911e-b7cedfa242a7 tempest-TestMinimumBasicScenario-25086869 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7', 'name': 'volume-eb7e836a-3de1-4de7-85c2-ebf3e72d4d56', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd554e692-0ec7-48e5-863b-76d6313fc82f', 'enforce_multipath': True} {{(pid=87233) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:35:44 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-5a309ea5-32ed-4f5c-9740-0c7a31d9ace5 req-c7001bc3-ed42-4801-911e-b7cedfa242a7 tempest-TestMinimumBasicScenario-25086869 None] attachment_update completed successfully. Jul 07 17:35:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-2b2854dc-98bb-404d-82b9-8af51ca19cc7 req-3933c170-53d3-4ade-ab54-af612e8b07b5 tempest-TestStampPattern-823481616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-2b2854dc-98bb-404d-82b9-8af51ca19cc7 req-3933c170-53d3-4ade-ab54-af612e8b07b5 tempest-TestStampPattern-823481616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:51 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69ba647-7a7d-43dd-b38a-4e8eeb215526]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-2b2854dc-98bb-404d-82b9-8af51ca19cc7 req-3933c170-53d3-4ade-ab54-af612e8b07b5 tempest-TestStampPattern-823481616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:51 devstack sudo[103244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400 Jul 07 17:35:51 devstack sudo[103244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:52 devstack sudo[103244]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-2b2854dc-98bb-404d-82b9-8af51ca19cc7 req-3933c170-53d3-4ade-ab54-af612e8b07b5 tempest-TestStampPattern-823481616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400" returned: 0 in 0.894s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-2b2854dc-98bb-404d-82b9-8af51ca19cc7 req-3933c170-53d3-4ade-ab54-af612e8b07b5 tempest-TestStampPattern-823481616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.914s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:52 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-2b2854dc-98bb-404d-82b9-8af51ca19cc7 req-3933c170-53d3-4ade-ab54-af612e8b07b5 tempest-TestStampPattern-823481616 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7', 'name': 'volume-2729b0bd-6b21-4aff-ac1b-6095c4151400', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7b54df87-67d6-4b6a-8fd6-dfd02f259ad4', 'enforce_multipath': True} {{(pid=87233) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:35:52 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-2b2854dc-98bb-404d-82b9-8af51ca19cc7 req-3933c170-53d3-4ade-ab54-af612e8b07b5 tempest-TestStampPattern-823481616 None] attachment_update completed successfully. Jul 07 17:36:02 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:SELECT=38,cinder:UPDATE=33,cinder:INSERT=10,cinder:DELETE=4 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:36:02 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:UPDATE=41,cinder:SELECT=41,cinder:DELETE=3,cinder:INSERT=6 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:36:02 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-778e0c3f-f220-479c-9ae4-d6cd573b3bba req-075305fe-3a12-406f-917d-4d651ab486bb tempest-TestStampPattern-823481616 None] Terminate volume connection completed successfully. Jul 07 17:36:02 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-778e0c3f-f220-479c-9ae4-d6cd573b3bba req-075305fe-3a12-406f-917d-4d651ab486bb tempest-TestStampPattern-823481616 None] Deleting attachment 7b54df87-67d6-4b6a-8fd6-dfd02f259ad4. {{(pid=87233) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:36:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-8f8d93da-9e33-4e7e-8e01-f3eec10443d3 tempest-TestStampPattern-823481616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-8f8d93da-9e33-4e7e-8e01-f3eec10443d3 tempest-TestStampPattern-823481616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:04 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-8f8d93da-9e33-4e7e-8e01-f3eec10443d3 tempest-TestStampPattern-823481616 None] Creating offline snapshot f0e62401-3871-4bf9-bd28-5c8484e62773 of volume 2729b0bd-6b21-4aff-ac1b-6095c4151400 {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:36:04 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b77b11-e76f-4a2e-919a-81680f2179e7]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:36:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8f8d93da-9e33-4e7e-8e01-f3eec10443d3 tempest-TestStampPattern-823481616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:04 devstack sudo[103300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400 Jul 07 17:36:04 devstack sudo[103300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:05 devstack sudo[103300]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8f8d93da-9e33-4e7e-8e01-f3eec10443d3 tempest-TestStampPattern-823481616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400" returned: 0 in 0.779s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8f8d93da-9e33-4e7e-8e01-f3eec10443d3 tempest-TestStampPattern-823481616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400.f0e62401-3871-4bf9-bd28-5c8484e62773 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:05 devstack sudo[103329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400.f0e62401-3871-4bf9-bd28-5c8484e62773 1G Jul 07 17:36:05 devstack sudo[103329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:06 devstack sudo[103329]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8f8d93da-9e33-4e7e-8e01-f3eec10443d3 tempest-TestStampPattern-823481616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400.f0e62401-3871-4bf9-bd28-5c8484e62773 1G" returned: 0 in 0.833s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8f8d93da-9e33-4e7e-8e01-f3eec10443d3 tempest-TestStampPattern-823481616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2729b0bd-6b21-4aff-ac1b-6095c4151400 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400.f0e62401-3871-4bf9-bd28-5c8484e62773 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:06 devstack sudo[103334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2729b0bd-6b21-4aff-ac1b-6095c4151400 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400.f0e62401-3871-4bf9-bd28-5c8484e62773 Jul 07 17:36:06 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:06 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8f8d93da-9e33-4e7e-8e01-f3eec10443d3 tempest-TestStampPattern-823481616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2729b0bd-6b21-4aff-ac1b-6095c4151400 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400.f0e62401-3871-4bf9-bd28-5c8484e62773" returned: 0 in 0.683s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:06 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-8f8d93da-9e33-4e7e-8e01-f3eec10443d3 tempest-TestStampPattern-823481616 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400.f0e62401-3871-4bf9-bd28-5c8484e62773 is being set with open permissions: ugo+rw Jul 07 17:36:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8f8d93da-9e33-4e7e-8e01-f3eec10443d3 tempest-TestStampPattern-823481616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400.f0e62401-3871-4bf9-bd28-5c8484e62773 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:06 devstack sudo[103339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400.f0e62401-3871-4bf9-bd28-5c8484e62773 Jul 07 17:36:06 devstack sudo[103339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:07 devstack sudo[103339]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8f8d93da-9e33-4e7e-8e01-f3eec10443d3 tempest-TestStampPattern-823481616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400.f0e62401-3871-4bf9-bd28-5c8484e62773" returned: 0 in 0.615s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8f8d93da-9e33-4e7e-8e01-f3eec10443d3 tempest-TestStampPattern-823481616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:07 devstack sudo[103342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400.info Jul 07 17:36:07 devstack sudo[103342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:08 devstack sudo[103342]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8f8d93da-9e33-4e7e-8e01-f3eec10443d3 tempest-TestStampPattern-823481616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400.info" returned: 0 in 0.616s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:08 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-8f8d93da-9e33-4e7e-8e01-f3eec10443d3 tempest-TestStampPattern-823481616 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400.info is being set with open permissions: ugo+rw Jul 07 17:36:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8f8d93da-9e33-4e7e-8e01-f3eec10443d3 tempest-TestStampPattern-823481616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:08 devstack sudo[103345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400.info Jul 07 17:36:08 devstack sudo[103345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:08 devstack sudo[103345]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8f8d93da-9e33-4e7e-8e01-f3eec10443d3 tempest-TestStampPattern-823481616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400.info" returned: 0 in 0.633s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-8f8d93da-9e33-4e7e-8e01-f3eec10443d3 tempest-TestStampPattern-823481616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.244s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:08 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-8f8d93da-9e33-4e7e-8e01-f3eec10443d3 tempest-TestStampPattern-823481616 None] Create snapshot completed successfully Jul 07 17:36:17 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:SELECT=4,cinder:INSERT=1 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:36:18 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:UPDATE=3,cinder:SELECT=3,cinder:DELETE=1 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:36:19 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:36:19 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Flow 'volume_create_manager' (b05f71f5-4991-4341-bacd-ff527e2a2607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:36:19 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7ca5cec-b655-4180-aad3-bbe301a76796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:19 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7ca5cec-b655-4180-aad3-bbe301a76796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-795725972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de0955ec-15e0-44a8-a630-b85a0415c2de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6091c9caa434ded88e00dbc9c128eb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f0e62401-3871-4bf9-bd28-5c8484e62773,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:36:20Z,use_quota=True,user_id='94b30850028e4b138ced903ecec4d69d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:19 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dcff6f7-3b24-472b-9a64-a38877ff95bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:19 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dcff6f7-3b24-472b-9a64-a38877ff95bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:19 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e7d307b-4792-4d34-97e8-5540a04bed3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:19 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e7d307b-4792-4d34-97e8-5540a04bed3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'de0955ec-15e0-44a8-a630-b85a0415c2de', 'volume_name': 'volume-de0955ec-15e0-44a8-a630-b85a0415c2de', 'volume_size': 1, 'snapshot_id': 'f0e62401-3871-4bf9-bd28-5c8484e62773'}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:19 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6dbcb91-a503-4c94-8385-c1ab0e9e4cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:19 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6dbcb91-a503-4c94-8385-c1ab0e9e4cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:19 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b168b791-2788-4c8c-97c3-2ba6a1c53acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:19 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Volume de0955ec-15e0-44a8-a630-b85a0415c2de: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-de0955ec-15e0-44a8-a630-b85a0415c2de', 'volume_size': 1, 'snapshot_id': 'f0e62401-3871-4bf9-bd28-5c8484e62773'} Jul 07 17:36:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:19 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Acquiring lock "cinder-quobyte-f0e62401-3871-4bf9-bd28-5c8484e62773-de0955ec-15e0-44a8-a630-b85a0415c2de" by "_create_volume_from_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:19 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Lock "cinder-quobyte-f0e62401-3871-4bf9-bd28-5c8484e62773-de0955ec-15e0-44a8-a630-b85a0415c2de" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:19 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Creating volume de0955ec-15e0-44a8-a630-b85a0415c2de from snapshot f0e62401-3871-4bf9-bd28-5c8484e62773 {{(pid=87233) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 17:36:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:19 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:36:19 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:36:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:19 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:36:19 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Acquiring lock "cinder-quobyte-de0955ec-15e0-44a8-a630-b85a0415c2de" by "_copy_volume_from_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:19 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Lock "cinder-quobyte-de0955ec-15e0-44a8-a630-b85a0415c2de" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:19 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] snapshot: f0e62401-3871-4bf9-bd28-5c8484e62773, volume: de0955ec-15e0-44a8-a630-b85a0415c2de, {{(pid=87233) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 17:36:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:19 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:36:19 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:36:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:19 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[207e12a1-4fbe-41b2-a0f7-1bc965b438dd]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:36:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400.f0e62401-3871-4bf9-bd28-5c8484e62773 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:20 devstack sudo[103442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400.f0e62401-3871-4bf9-bd28-5c8484e62773 Jul 07 17:36:20 devstack sudo[103442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:20 devstack sudo[103442]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400.f0e62401-3871-4bf9-bd28-5c8484e62773" returned: 0 in 0.965s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:20 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2729b0bd-6b21-4aff-ac1b-6095c4151400(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:36:20 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] will copy from snapshot at /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400 {{(pid=87233) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 17:36:20 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Creating direct copy from snapshot {{(pid=87233) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 17:36:20 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[56361eb4-3acc-4d89-9b0f-d411b0362ad7]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:36:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:21 devstack sudo[103452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400 Jul 07 17:36:21 devstack sudo[103452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:21 devstack sudo[103452]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400" returned: 0 in 1.000s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:21 devstack cinder-volume[87233]: DEBUG cinder.utils [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Path /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-de0955ec-15e0-44a8-a630-b85a0415c2de not found in is_blk_device check {{(pid=87233) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 17:36:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-de0955ec-15e0-44a8-a630-b85a0415c2de {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:21 devstack sudo[103463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-de0955ec-15e0-44a8-a630-b85a0415c2de Jul 07 17:36:21 devstack sudo[103463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:27 devstack sudo[103463]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-de0955ec-15e0-44a8-a630-b85a0415c2de" returned: 0 in 5.814s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:27 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9b735b-a2c8-4e15-aa0d-7a47220c83b6]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:36:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:27 devstack sudo[103481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400 Jul 07 17:36:27 devstack sudo[103481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:28 devstack sudo[103481]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400" returned: 0 in 1.166s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:28 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Image conversion details: src /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400, size 1024.00 MB, duration 5.82 sec, destination /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-de0955ec-15e0-44a8-a630-b85a0415c2de {{(pid=87233) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:36:28 devstack cinder-volume[87233]: INFO cinder.image.image_utils [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Converted 1024.00 MB image at 176.06 MB/s Jul 07 17:36:28 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-de0955ec-15e0-44a8-a630-b85a0415c2de is being set with open permissions: ugo+rw Jul 07 17:36:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-de0955ec-15e0-44a8-a630-b85a0415c2de {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:28 devstack sudo[103486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-de0955ec-15e0-44a8-a630-b85a0415c2de Jul 07 17:36:28 devstack sudo[103486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:29 devstack sudo[103486]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-de0955ec-15e0-44a8-a630-b85a0415c2de" returned: 0 in 0.806s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:29 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Lock "cinder-quobyte-de0955ec-15e0-44a8-a630-b85a0415c2de" released by "_copy_volume_from_snapshot" :: held 9.889s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:29 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:SELECT=1 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:36:29 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Lock "cinder-quobyte-f0e62401-3871-4bf9-bd28-5c8484e62773-de0955ec-15e0-44a8-a630-b85a0415c2de" released by "_create_volume_from_snapshot" :: held 9.927s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.946s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b168b791-2788-4c8c-97c3-2ba6a1c53acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de0955ec-15e0-44a8-a630-b85a0415c2de', 'volume_size': 1, 'snapshot_id': 'f0e62401-3871-4bf9-bd28-5c8484e62773'}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74710dc8-cc9b-4900-82b3-9e754af40382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:29 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Volume volume-de0955ec-15e0-44a8-a630-b85a0415c2de (de0955ec-15e0-44a8-a630-b85a0415c2de): created successfully Jul 07 17:36:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74710dc8-cc9b-4900-82b3-9e754af40382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Flow 'volume_create_manager' (b05f71f5-4991-4341-bacd-ff527e2a2607) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:36:29 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-bae2d2c2-62bd-4c81-af87-a37ebcf77078 tempest-TestStampPattern-823481616 None] Created volume successfully. Jul 07 17:36:39 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:UPDATE=2 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:36:39 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:36:43 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:36:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:36:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:36:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:43 devstack sudo[103560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:36:43 devstack sudo[103560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:44 devstack sudo[103560]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.693s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:44 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:36:44 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:36:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread count: 28 {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:36:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread info: [<_MainThread(MainThread, started 126077716062336)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:36:50 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-731cd9d6-046a-4332-a3d7-6a3d2108cf99 req-a434f98c-7fcb-4ac0-8741-339dc9c0f3cb tempest-TestMinimumBasicScenario-25086869 None] Terminate volume connection completed successfully. Jul 07 17:36:50 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-731cd9d6-046a-4332-a3d7-6a3d2108cf99 req-a434f98c-7fcb-4ac0-8741-339dc9c0f3cb tempest-TestMinimumBasicScenario-25086869 None] Deleting attachment d554e692-0ec7-48e5-863b-76d6313fc82f. {{(pid=87233) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:36:52 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9fe38065-0ce1-410b-b39b-1ecaf2dbcbe4 tempest-TestMinimumBasicScenario-25086869 None] Acquiring lock "cinder-eb7e836a-3de1-4de7-85c2-ebf3e72d4d56-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:52 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9fe38065-0ce1-410b-b39b-1ecaf2dbcbe4 tempest-TestMinimumBasicScenario-25086869 None] Lock "cinder-eb7e836a-3de1-4de7-85c2-ebf3e72d4d56-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:52 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9fe38065-0ce1-410b-b39b-1ecaf2dbcbe4 tempest-TestMinimumBasicScenario-25086869 None] Acquiring lock "cinder-quobyte-eb7e836a-3de1-4de7-85c2-ebf3e72d4d56" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:52 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9fe38065-0ce1-410b-b39b-1ecaf2dbcbe4 tempest-TestMinimumBasicScenario-25086869 None] Lock "cinder-quobyte-eb7e836a-3de1-4de7-85c2-ebf3e72d4d56" acquired by "delete_volume" :: waited 0.017s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:52 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[83af171a-37de-4346-b795-64a82379d267]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:36:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9fe38065-0ce1-410b-b39b-1ecaf2dbcbe4 tempest-TestMinimumBasicScenario-25086869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-eb7e836a-3de1-4de7-85c2-ebf3e72d4d56 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:52 devstack sudo[103583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-eb7e836a-3de1-4de7-85c2-ebf3e72d4d56 Jul 07 17:36:52 devstack sudo[103583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:53 devstack sudo[103583]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9fe38065-0ce1-410b-b39b-1ecaf2dbcbe4 tempest-TestMinimumBasicScenario-25086869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-eb7e836a-3de1-4de7-85c2-ebf3e72d4d56" returned: 0 in 0.818s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9fe38065-0ce1-410b-b39b-1ecaf2dbcbe4 tempest-TestMinimumBasicScenario-25086869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-eb7e836a-3de1-4de7-85c2-ebf3e72d4d56 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:53 devstack sudo[103588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-eb7e836a-3de1-4de7-85c2-ebf3e72d4d56 Jul 07 17:36:53 devstack sudo[103588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:54 devstack sudo[103588]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9fe38065-0ce1-410b-b39b-1ecaf2dbcbe4 tempest-TestMinimumBasicScenario-25086869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-eb7e836a-3de1-4de7-85c2-ebf3e72d4d56" returned: 0 in 0.654s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:54 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9fe38065-0ce1-410b-b39b-1ecaf2dbcbe4 tempest-TestMinimumBasicScenario-25086869 None] Lock "cinder-quobyte-eb7e836a-3de1-4de7-85c2-ebf3e72d4d56" released by "delete_volume" :: held 1.511s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:54 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-9fe38065-0ce1-410b-b39b-1ecaf2dbcbe4 tempest-TestMinimumBasicScenario-25086869 None] Created reservations ['a55237ab-a151-4b01-bbac-13d9fc8ea915', '66fa471f-140d-4a56-b7f3-16c55e4bf4a4', 'd04eb16a-013e-4990-8c93-6f696d13b75e', '43d60f31-4580-4336-b841-624bfc6dbdc2'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:36:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9fe38065-0ce1-410b-b39b-1ecaf2dbcbe4 tempest-TestMinimumBasicScenario-25086869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9fe38065-0ce1-410b-b39b-1ecaf2dbcbe4 tempest-TestMinimumBasicScenario-25086869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:54 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-9fe38065-0ce1-410b-b39b-1ecaf2dbcbe4 tempest-TestMinimumBasicScenario-25086869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:36:54 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-9fe38065-0ce1-410b-b39b-1ecaf2dbcbe4 tempest-TestMinimumBasicScenario-25086869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:36:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9fe38065-0ce1-410b-b39b-1ecaf2dbcbe4 tempest-TestMinimumBasicScenario-25086869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9fe38065-0ce1-410b-b39b-1ecaf2dbcbe4 tempest-TestMinimumBasicScenario-25086869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:54 devstack sudo[103591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:36:54 devstack sudo[103591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:54 devstack sudo[103591]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9fe38065-0ce1-410b-b39b-1ecaf2dbcbe4 tempest-TestMinimumBasicScenario-25086869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.665s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:54 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-9fe38065-0ce1-410b-b39b-1ecaf2dbcbe4 tempest-TestMinimumBasicScenario-25086869 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:36:54 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-9fe38065-0ce1-410b-b39b-1ecaf2dbcbe4 tempest-TestMinimumBasicScenario-25086869 None] Deleted volume successfully. Jul 07 17:36:54 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9fe38065-0ce1-410b-b39b-1ecaf2dbcbe4 tempest-TestMinimumBasicScenario-25086869 None] Lock "cinder-eb7e836a-3de1-4de7-85c2-ebf3e72d4d56-delete_volume" released by "delete_volume" :: held 2.421s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:37:04 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:UPDATE=9,cinder:SELECT=8,cinder:INSERT=2 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:37:04 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:37:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-bb925b91-6351-4f50-b9bb-afddc4838b63 req-9621e0a0-1bc9-405d-8de1-075043d01451 tempest-TestStampPattern-823481616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:37:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-bb925b91-6351-4f50-b9bb-afddc4838b63 req-9621e0a0-1bc9-405d-8de1-075043d01451 tempest-TestStampPattern-823481616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:37:19 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[569177c3-eacf-4774-b2ce-69b4cf6119e5]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:37:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-bb925b91-6351-4f50-b9bb-afddc4838b63 req-9621e0a0-1bc9-405d-8de1-075043d01451 tempest-TestStampPattern-823481616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-de0955ec-15e0-44a8-a630-b85a0415c2de {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:19 devstack sudo[103689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-de0955ec-15e0-44a8-a630-b85a0415c2de Jul 07 17:37:19 devstack sudo[103689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:20 devstack sudo[103689]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-bb925b91-6351-4f50-b9bb-afddc4838b63 req-9621e0a0-1bc9-405d-8de1-075043d01451 tempest-TestStampPattern-823481616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-de0955ec-15e0-44a8-a630-b85a0415c2de" returned: 0 in 0.813s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-bb925b91-6351-4f50-b9bb-afddc4838b63 req-9621e0a0-1bc9-405d-8de1-075043d01451 tempest-TestStampPattern-823481616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.835s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:37:20 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-bb925b91-6351-4f50-b9bb-afddc4838b63 req-9621e0a0-1bc9-405d-8de1-075043d01451 tempest-TestStampPattern-823481616 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7', 'name': 'volume-de0955ec-15e0-44a8-a630-b85a0415c2de', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '03b99578-2274-4531-8153-6f0b69d1310b', 'enforce_multipath': True} {{(pid=87233) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:37:20 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-bb925b91-6351-4f50-b9bb-afddc4838b63 req-9621e0a0-1bc9-405d-8de1-075043d01451 tempest-TestStampPattern-823481616 None] attachment_update completed successfully. Jul 07 17:37:27 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-5d245ca9-699e-42f4-80f5-649ab9ad85b2 req-c3485d54-be70-4205-8f74-fe6c7dc980bb tempest-TestStampPattern-823481616 None] Terminate volume connection completed successfully. Jul 07 17:37:27 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-5d245ca9-699e-42f4-80f5-649ab9ad85b2 req-c3485d54-be70-4205-8f74-fe6c7dc980bb tempest-TestStampPattern-823481616 None] Deleting attachment 03b99578-2274-4531-8153-6f0b69d1310b. {{(pid=87233) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:37:30 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:SELECT=8 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:37:34 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7546180-cfd1-4ed4-97ee-4b90db71d2ef tempest-TestServerVolumeAttachmentScenario-491295297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:37:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d7546180-cfd1-4ed4-97ee-4b90db71d2ef tempest-TestServerVolumeAttachmentScenario-491295297 None] Flow 'volume_create_manager' (76939207-cb47-4713-a24c-4bbd5d239cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:37:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d7546180-cfd1-4ed4-97ee-4b90db71d2ef tempest-TestServerVolumeAttachmentScenario-491295297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (686c408a-dc29-4aa0-912b-742d9232f066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d7546180-cfd1-4ed4-97ee-4b90db71d2ef tempest-TestServerVolumeAttachmentScenario-491295297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (686c408a-dc29-4aa0-912b-742d9232f066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1300023030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5115ca8a-3479-4ade-b8aa-a641def16157,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7165f568157b4952baeaee51e7740eae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:37:34Z,use_quota=True,user_id='d975d0cf5baf41f3a4bc75781a04bb6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d7546180-cfd1-4ed4-97ee-4b90db71d2ef tempest-TestServerVolumeAttachmentScenario-491295297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4129ea63-006a-4277-89ac-1368193128e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d7546180-cfd1-4ed4-97ee-4b90db71d2ef tempest-TestServerVolumeAttachmentScenario-491295297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4129ea63-006a-4277-89ac-1368193128e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d7546180-cfd1-4ed4-97ee-4b90db71d2ef tempest-TestServerVolumeAttachmentScenario-491295297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f521d360-4ec3-47cf-8286-31aa7bf5e46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d7546180-cfd1-4ed4-97ee-4b90db71d2ef tempest-TestServerVolumeAttachmentScenario-491295297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f521d360-4ec3-47cf-8286-31aa7bf5e46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5115ca8a-3479-4ade-b8aa-a641def16157', 'volume_name': 'volume-5115ca8a-3479-4ade-b8aa-a641def16157', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d7546180-cfd1-4ed4-97ee-4b90db71d2ef tempest-TestServerVolumeAttachmentScenario-491295297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a16d646e-b01f-40fe-b846-79133c935b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d7546180-cfd1-4ed4-97ee-4b90db71d2ef tempest-TestServerVolumeAttachmentScenario-491295297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a16d646e-b01f-40fe-b846-79133c935b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d7546180-cfd1-4ed4-97ee-4b90db71d2ef tempest-TestServerVolumeAttachmentScenario-491295297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45cbe2f6-e49a-4960-9fcf-c37822302e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:34 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-d7546180-cfd1-4ed4-97ee-4b90db71d2ef tempest-TestServerVolumeAttachmentScenario-491295297 None] Volume 5115ca8a-3479-4ade-b8aa-a641def16157: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5115ca8a-3479-4ade-b8aa-a641def16157', 'volume_size': 1} Jul 07 17:37:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d7546180-cfd1-4ed4-97ee-4b90db71d2ef tempest-TestServerVolumeAttachmentScenario-491295297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:37:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d7546180-cfd1-4ed4-97ee-4b90db71d2ef tempest-TestServerVolumeAttachmentScenario-491295297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:37:34 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d7546180-cfd1-4ed4-97ee-4b90db71d2ef tempest-TestServerVolumeAttachmentScenario-491295297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1300023030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5115ca8a-3479-4ade-b8aa-a641def16157,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7165f568157b4952baeaee51e7740eae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:37:34Z,use_quota=True,user_id='d975d0cf5baf41f3a4bc75781a04bb6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:37:34 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-d7546180-cfd1-4ed4-97ee-4b90db71d2ef tempest-TestServerVolumeAttachmentScenario-491295297 None] Creating volume 5115ca8a-3479-4ade-b8aa-a641def16157 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:37:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d7546180-cfd1-4ed4-97ee-4b90db71d2ef tempest-TestServerVolumeAttachmentScenario-491295297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:37:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d7546180-cfd1-4ed4-97ee-4b90db71d2ef tempest-TestServerVolumeAttachmentScenario-491295297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:37:34 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d7546180-cfd1-4ed4-97ee-4b90db71d2ef tempest-TestServerVolumeAttachmentScenario-491295297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:37:34 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d7546180-cfd1-4ed4-97ee-4b90db71d2ef tempest-TestServerVolumeAttachmentScenario-491295297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:37:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d7546180-cfd1-4ed4-97ee-4b90db71d2ef tempest-TestServerVolumeAttachmentScenario-491295297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:37:34 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d7546180-cfd1-4ed4-97ee-4b90db71d2ef tempest-TestServerVolumeAttachmentScenario-491295297 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:37:34 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-d7546180-cfd1-4ed4-97ee-4b90db71d2ef tempest-TestServerVolumeAttachmentScenario-491295297 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:37:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d7546180-cfd1-4ed4-97ee-4b90db71d2ef tempest-TestServerVolumeAttachmentScenario-491295297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5115ca8a-3479-4ade-b8aa-a641def16157 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:34 devstack sudo[104161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5115ca8a-3479-4ade-b8aa-a641def16157 1073741824 Jul 07 17:37:34 devstack sudo[104161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:34 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-70c3cebb-40f9-4a3e-aed6-91ce807b8fe6 tempest-TestServerVolumeAttachmentScenario-491295297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:37:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-70c3cebb-40f9-4a3e-aed6-91ce807b8fe6 tempest-TestServerVolumeAttachmentScenario-491295297 None] Flow 'volume_create_manager' (4b6bc471-fcf0-42ba-aa67-186644d3785d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:37:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-70c3cebb-40f9-4a3e-aed6-91ce807b8fe6 tempest-TestServerVolumeAttachmentScenario-491295297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84b4140e-c5ee-4c46-8c14-60a2c3969b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-70c3cebb-40f9-4a3e-aed6-91ce807b8fe6 tempest-TestServerVolumeAttachmentScenario-491295297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84b4140e-c5ee-4c46-8c14-60a2c3969b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1638923355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebf1af63-829e-4068-8671-ec20200b51f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7165f568157b4952baeaee51e7740eae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:37:35Z,use_quota=True,user_id='d975d0cf5baf41f3a4bc75781a04bb6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-70c3cebb-40f9-4a3e-aed6-91ce807b8fe6 tempest-TestServerVolumeAttachmentScenario-491295297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e21f11e-6ae0-46a7-a96b-01e3d79e3f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-70c3cebb-40f9-4a3e-aed6-91ce807b8fe6 tempest-TestServerVolumeAttachmentScenario-491295297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e21f11e-6ae0-46a7-a96b-01e3d79e3f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-70c3cebb-40f9-4a3e-aed6-91ce807b8fe6 tempest-TestServerVolumeAttachmentScenario-491295297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c13a470a-9e53-4631-866a-8f5e13dd1f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-70c3cebb-40f9-4a3e-aed6-91ce807b8fe6 tempest-TestServerVolumeAttachmentScenario-491295297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c13a470a-9e53-4631-866a-8f5e13dd1f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebf1af63-829e-4068-8671-ec20200b51f4', 'volume_name': 'volume-ebf1af63-829e-4068-8671-ec20200b51f4', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-70c3cebb-40f9-4a3e-aed6-91ce807b8fe6 tempest-TestServerVolumeAttachmentScenario-491295297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cef4c0a-76b3-4575-b949-2921760cc85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-70c3cebb-40f9-4a3e-aed6-91ce807b8fe6 tempest-TestServerVolumeAttachmentScenario-491295297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cef4c0a-76b3-4575-b949-2921760cc85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-70c3cebb-40f9-4a3e-aed6-91ce807b8fe6 tempest-TestServerVolumeAttachmentScenario-491295297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (691ed5a3-489e-4859-81f3-c3128f0412a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:34 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-70c3cebb-40f9-4a3e-aed6-91ce807b8fe6 tempest-TestServerVolumeAttachmentScenario-491295297 None] Volume ebf1af63-829e-4068-8671-ec20200b51f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebf1af63-829e-4068-8671-ec20200b51f4', 'volume_size': 1} Jul 07 17:37:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-70c3cebb-40f9-4a3e-aed6-91ce807b8fe6 tempest-TestServerVolumeAttachmentScenario-491295297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:37:35 devstack sudo[104161]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d7546180-cfd1-4ed4-97ee-4b90db71d2ef tempest-TestServerVolumeAttachmentScenario-491295297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5115ca8a-3479-4ade-b8aa-a641def16157 1073741824" returned: 0 in 1.039s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d7546180-cfd1-4ed4-97ee-4b90db71d2ef tempest-TestServerVolumeAttachmentScenario-491295297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5115ca8a-3479-4ade-b8aa-a641def16157 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:35 devstack sudo[104167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5115ca8a-3479-4ade-b8aa-a641def16157 Jul 07 17:37:35 devstack sudo[104167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:36 devstack sudo[104167]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d7546180-cfd1-4ed4-97ee-4b90db71d2ef tempest-TestServerVolumeAttachmentScenario-491295297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5115ca8a-3479-4ade-b8aa-a641def16157" returned: 0 in 0.650s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:36 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d7546180-cfd1-4ed4-97ee-4b90db71d2ef tempest-TestServerVolumeAttachmentScenario-491295297 None] <== create_volume: return (1742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:37:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d7546180-cfd1-4ed4-97ee-4b90db71d2ef tempest-TestServerVolumeAttachmentScenario-491295297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.745s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:37:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-70c3cebb-40f9-4a3e-aed6-91ce807b8fe6 tempest-TestServerVolumeAttachmentScenario-491295297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.172s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:37:36 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-70c3cebb-40f9-4a3e-aed6-91ce807b8fe6 tempest-TestServerVolumeAttachmentScenario-491295297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1638923355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebf1af63-829e-4068-8671-ec20200b51f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7165f568157b4952baeaee51e7740eae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:37:35Z,use_quota=True,user_id='d975d0cf5baf41f3a4bc75781a04bb6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:37:36 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-70c3cebb-40f9-4a3e-aed6-91ce807b8fe6 tempest-TestServerVolumeAttachmentScenario-491295297 None] Creating volume ebf1af63-829e-4068-8671-ec20200b51f4 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:37:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-70c3cebb-40f9-4a3e-aed6-91ce807b8fe6 tempest-TestServerVolumeAttachmentScenario-491295297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:37:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-70c3cebb-40f9-4a3e-aed6-91ce807b8fe6 tempest-TestServerVolumeAttachmentScenario-491295297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:37:36 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-70c3cebb-40f9-4a3e-aed6-91ce807b8fe6 tempest-TestServerVolumeAttachmentScenario-491295297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:37:36 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-70c3cebb-40f9-4a3e-aed6-91ce807b8fe6 tempest-TestServerVolumeAttachmentScenario-491295297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:37:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-70c3cebb-40f9-4a3e-aed6-91ce807b8fe6 tempest-TestServerVolumeAttachmentScenario-491295297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:37:36 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-70c3cebb-40f9-4a3e-aed6-91ce807b8fe6 tempest-TestServerVolumeAttachmentScenario-491295297 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:37:36 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-70c3cebb-40f9-4a3e-aed6-91ce807b8fe6 tempest-TestServerVolumeAttachmentScenario-491295297 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:37:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-70c3cebb-40f9-4a3e-aed6-91ce807b8fe6 tempest-TestServerVolumeAttachmentScenario-491295297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ebf1af63-829e-4068-8671-ec20200b51f4 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d7546180-cfd1-4ed4-97ee-4b90db71d2ef tempest-TestServerVolumeAttachmentScenario-491295297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45cbe2f6-e49a-4960-9fcf-c37822302e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5115ca8a-3479-4ade-b8aa-a641def16157', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d7546180-cfd1-4ed4-97ee-4b90db71d2ef tempest-TestServerVolumeAttachmentScenario-491295297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c07c1350-b33f-4106-abf4-97b2329547d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:36 devstack sudo[104170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ebf1af63-829e-4068-8671-ec20200b51f4 1073741824 Jul 07 17:37:36 devstack sudo[104170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:36 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-d7546180-cfd1-4ed4-97ee-4b90db71d2ef tempest-TestServerVolumeAttachmentScenario-491295297 None] Volume volume-5115ca8a-3479-4ade-b8aa-a641def16157 (5115ca8a-3479-4ade-b8aa-a641def16157): created successfully Jul 07 17:37:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d7546180-cfd1-4ed4-97ee-4b90db71d2ef tempest-TestServerVolumeAttachmentScenario-491295297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c07c1350-b33f-4106-abf4-97b2329547d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d7546180-cfd1-4ed4-97ee-4b90db71d2ef tempest-TestServerVolumeAttachmentScenario-491295297 None] Flow 'volume_create_manager' (76939207-cb47-4713-a24c-4bbd5d239cab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:37:36 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-d7546180-cfd1-4ed4-97ee-4b90db71d2ef tempest-TestServerVolumeAttachmentScenario-491295297 None] Created volume successfully. Jul 07 17:37:36 devstack sudo[104170]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-70c3cebb-40f9-4a3e-aed6-91ce807b8fe6 tempest-TestServerVolumeAttachmentScenario-491295297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ebf1af63-829e-4068-8671-ec20200b51f4 1073741824" returned: 0 in 0.913s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-70c3cebb-40f9-4a3e-aed6-91ce807b8fe6 tempest-TestServerVolumeAttachmentScenario-491295297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ebf1af63-829e-4068-8671-ec20200b51f4 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:37 devstack sudo[104176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ebf1af63-829e-4068-8671-ec20200b51f4 Jul 07 17:37:37 devstack sudo[104176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:37 devstack sudo[104176]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-70c3cebb-40f9-4a3e-aed6-91ce807b8fe6 tempest-TestServerVolumeAttachmentScenario-491295297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ebf1af63-829e-4068-8671-ec20200b51f4" returned: 0 in 0.721s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:37 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-70c3cebb-40f9-4a3e-aed6-91ce807b8fe6 tempest-TestServerVolumeAttachmentScenario-491295297 None] <== create_volume: return (1702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:37:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-70c3cebb-40f9-4a3e-aed6-91ce807b8fe6 tempest-TestServerVolumeAttachmentScenario-491295297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:37:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-70c3cebb-40f9-4a3e-aed6-91ce807b8fe6 tempest-TestServerVolumeAttachmentScenario-491295297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (691ed5a3-489e-4859-81f3-c3128f0412a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebf1af63-829e-4068-8671-ec20200b51f4', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-70c3cebb-40f9-4a3e-aed6-91ce807b8fe6 tempest-TestServerVolumeAttachmentScenario-491295297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1d4bc52-1819-4db0-8c78-0671cdc57dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:37 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-70c3cebb-40f9-4a3e-aed6-91ce807b8fe6 tempest-TestServerVolumeAttachmentScenario-491295297 None] Volume volume-ebf1af63-829e-4068-8671-ec20200b51f4 (ebf1af63-829e-4068-8671-ec20200b51f4): created successfully Jul 07 17:37:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-70c3cebb-40f9-4a3e-aed6-91ce807b8fe6 tempest-TestServerVolumeAttachmentScenario-491295297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1d4bc52-1819-4db0-8c78-0671cdc57dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-70c3cebb-40f9-4a3e-aed6-91ce807b8fe6 tempest-TestServerVolumeAttachmentScenario-491295297 None] Flow 'volume_create_manager' (4b6bc471-fcf0-42ba-aa67-186644d3785d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:37:37 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-70c3cebb-40f9-4a3e-aed6-91ce807b8fe6 tempest-TestServerVolumeAttachmentScenario-491295297 None] Created volume successfully. Jul 07 17:37:38 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c2c594de-56cc-4b52-8011-5110741d72f9 tempest-TestStampPattern-823481616 None] Acquiring lock "cinder-de0955ec-15e0-44a8-a630-b85a0415c2de-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:37:38 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c2c594de-56cc-4b52-8011-5110741d72f9 tempest-TestStampPattern-823481616 None] Lock "cinder-de0955ec-15e0-44a8-a630-b85a0415c2de-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:37:38 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c2c594de-56cc-4b52-8011-5110741d72f9 tempest-TestStampPattern-823481616 None] Acquiring lock "cinder-quobyte-de0955ec-15e0-44a8-a630-b85a0415c2de" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:37:38 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c2c594de-56cc-4b52-8011-5110741d72f9 tempest-TestStampPattern-823481616 None] Lock "cinder-quobyte-de0955ec-15e0-44a8-a630-b85a0415c2de" acquired by "delete_volume" :: waited 0.016s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:37:38 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d13773-973d-457f-961c-0741899a453d]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:37:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c2c594de-56cc-4b52-8011-5110741d72f9 tempest-TestStampPattern-823481616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-de0955ec-15e0-44a8-a630-b85a0415c2de {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:38 devstack sudo[104182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-de0955ec-15e0-44a8-a630-b85a0415c2de Jul 07 17:37:38 devstack sudo[104182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:39 devstack sudo[104182]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c2c594de-56cc-4b52-8011-5110741d72f9 tempest-TestStampPattern-823481616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-de0955ec-15e0-44a8-a630-b85a0415c2de" returned: 0 in 0.800s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c2c594de-56cc-4b52-8011-5110741d72f9 tempest-TestStampPattern-823481616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-de0955ec-15e0-44a8-a630-b85a0415c2de {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:39 devstack sudo[104187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-de0955ec-15e0-44a8-a630-b85a0415c2de Jul 07 17:37:39 devstack sudo[104187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:39 devstack sudo[104187]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c2c594de-56cc-4b52-8011-5110741d72f9 tempest-TestStampPattern-823481616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-de0955ec-15e0-44a8-a630-b85a0415c2de" returned: 0 in 0.694s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:39 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c2c594de-56cc-4b52-8011-5110741d72f9 tempest-TestStampPattern-823481616 None] Lock "cinder-quobyte-de0955ec-15e0-44a8-a630-b85a0415c2de" released by "delete_volume" :: held 1.533s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:37:39 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-c2c594de-56cc-4b52-8011-5110741d72f9 tempest-TestStampPattern-823481616 None] Created reservations ['ea5d68bc-5053-4075-8342-2dd53c1ebca8', 'ea291965-0f4e-4c0c-82fa-c24d442fb54c', '4ee45d74-1ee7-419e-861c-e30c70c11400', 'c96b75cd-3097-482e-b901-a40f51ff1fcc'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:37:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c2c594de-56cc-4b52-8011-5110741d72f9 tempest-TestStampPattern-823481616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:37:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c2c594de-56cc-4b52-8011-5110741d72f9 tempest-TestStampPattern-823481616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:37:39 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c2c594de-56cc-4b52-8011-5110741d72f9 tempest-TestStampPattern-823481616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:37:39 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c2c594de-56cc-4b52-8011-5110741d72f9 tempest-TestStampPattern-823481616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:37:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c2c594de-56cc-4b52-8011-5110741d72f9 tempest-TestStampPattern-823481616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:37:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c2c594de-56cc-4b52-8011-5110741d72f9 tempest-TestStampPattern-823481616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:40 devstack sudo[104190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:37:40 devstack sudo[104190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:40 devstack sudo[104190]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c2c594de-56cc-4b52-8011-5110741d72f9 tempest-TestStampPattern-823481616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.698s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:40 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-c2c594de-56cc-4b52-8011-5110741d72f9 tempest-TestStampPattern-823481616 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:37:40 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-c2c594de-56cc-4b52-8011-5110741d72f9 tempest-TestStampPattern-823481616 None] Deleted volume successfully. Jul 07 17:37:40 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c2c594de-56cc-4b52-8011-5110741d72f9 tempest-TestStampPattern-823481616 None] Lock "cinder-de0955ec-15e0-44a8-a630-b85a0415c2de-delete_volume" released by "delete_volume" :: held 2.453s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:37:40 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-7dd90128-9e92-4dc8-9514-9ffe58e79d92 tempest-TestStampPattern-823481616 None] Acquiring lock "cinder-f0e62401-3871-4bf9-bd28-5c8484e62773-delete_snapshot" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:37:40 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-7dd90128-9e92-4dc8-9514-9ffe58e79d92 tempest-TestStampPattern-823481616 None] Lock "cinder-f0e62401-3871-4bf9-bd28-5c8484e62773-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:37:40 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-7dd90128-9e92-4dc8-9514-9ffe58e79d92 tempest-TestStampPattern-823481616 None] Acquiring lock "cinder-quobyte-2729b0bd-6b21-4aff-ac1b-6095c4151400" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:37:40 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-7dd90128-9e92-4dc8-9514-9ffe58e79d92 tempest-TestStampPattern-823481616 None] Lock "cinder-quobyte-2729b0bd-6b21-4aff-ac1b-6095c4151400" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:37:40 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-7dd90128-9e92-4dc8-9514-9ffe58e79d92 tempest-TestStampPattern-823481616 None] Acquiring lock "cinder-quobyte-f0e62401-3871-4bf9-bd28-5c8484e62773" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:37:40 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-7dd90128-9e92-4dc8-9514-9ffe58e79d92 tempest-TestStampPattern-823481616 None] Lock "cinder-quobyte-f0e62401-3871-4bf9-bd28-5c8484e62773" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:37:40 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-7dd90128-9e92-4dc8-9514-9ffe58e79d92 tempest-TestStampPattern-823481616 None] Deleting offline snapshot f0e62401-3871-4bf9-bd28-5c8484e62773 of volume 2729b0bd-6b21-4aff-ac1b-6095c4151400 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:37:40 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-7dd90128-9e92-4dc8-9514-9ffe58e79d92 tempest-TestStampPattern-823481616 None] snapshot_file for this snap is: volume-2729b0bd-6b21-4aff-ac1b-6095c4151400.f0e62401-3871-4bf9-bd28-5c8484e62773 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:37:40 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff672be-67a1-434e-a1ba-b197486a95a3]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:37:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7dd90128-9e92-4dc8-9514-9ffe58e79d92 tempest-TestStampPattern-823481616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400.f0e62401-3871-4bf9-bd28-5c8484e62773 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:40 devstack sudo[104194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400.f0e62401-3871-4bf9-bd28-5c8484e62773 Jul 07 17:37:40 devstack sudo[104194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:41 devstack sudo[104194]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7dd90128-9e92-4dc8-9514-9ffe58e79d92 tempest-TestStampPattern-823481616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400.f0e62401-3871-4bf9-bd28-5c8484e62773" returned: 0 in 0.764s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:41 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-7dd90128-9e92-4dc8-9514-9ffe58e79d92 tempest-TestStampPattern-823481616 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2729b0bd-6b21-4aff-ac1b-6095c4151400(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:37:41 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52d4c95-6ba3-4792-9221-0aacc939e67d]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:37:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7dd90128-9e92-4dc8-9514-9ffe58e79d92 tempest-TestStampPattern-823481616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:41 devstack sudo[104199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400 Jul 07 17:37:41 devstack sudo[104199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:42 devstack sudo[104199]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7dd90128-9e92-4dc8-9514-9ffe58e79d92 tempest-TestStampPattern-823481616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400" returned: 0 in 0.873s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7dd90128-9e92-4dc8-9514-9ffe58e79d92 tempest-TestStampPattern-823481616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400.f0e62401-3871-4bf9-bd28-5c8484e62773 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:42 devstack sudo[104204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400.f0e62401-3871-4bf9-bd28-5c8484e62773 Jul 07 17:37:42 devstack sudo[104204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:43 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:37:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:37:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:37:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:37:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:37:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:37:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:43 devstack sudo[104204]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:43 devstack sudo[104210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:37:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7dd90128-9e92-4dc8-9514-9ffe58e79d92 tempest-TestStampPattern-823481616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400.f0e62401-3871-4bf9-bd28-5c8484e62773" returned: 0 in 0.887s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:43 devstack sudo[104210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7dd90128-9e92-4dc8-9514-9ffe58e79d92 tempest-TestStampPattern-823481616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400.f0e62401-3871-4bf9-bd28-5c8484e62773 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:43 devstack sudo[104212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400.f0e62401-3871-4bf9-bd28-5c8484e62773 Jul 07 17:37:43 devstack sudo[104212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:44 devstack sudo[104210]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.759s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:44 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:37:44 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:37:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread count: 28 {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:37:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread info: [<_MainThread(MainThread, started 126077716062336)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:37:44 devstack sudo[104212]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7dd90128-9e92-4dc8-9514-9ffe58e79d92 tempest-TestStampPattern-823481616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400.f0e62401-3871-4bf9-bd28-5c8484e62773" returned: 0 in 0.768s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:44 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-7dd90128-9e92-4dc8-9514-9ffe58e79d92 tempest-TestStampPattern-823481616 None] Lock "cinder-quobyte-f0e62401-3871-4bf9-bd28-5c8484e62773" released by "_delete_snapshot" :: held 3.408s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:37:44 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-7dd90128-9e92-4dc8-9514-9ffe58e79d92 tempest-TestStampPattern-823481616 None] Lock "cinder-quobyte-2729b0bd-6b21-4aff-ac1b-6095c4151400" released by "delete_snapshot" :: held 3.433s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:37:44 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-7dd90128-9e92-4dc8-9514-9ffe58e79d92 tempest-TestStampPattern-823481616 None] Created reservations ['5ea47ae2-c7bd-4444-a674-a925be60f8bf', '3f7c89c4-68f1-4c02-994b-d68b862afba6', '06b15850-4f88-4ce0-babb-2873d1cbb742', 'c62290d6-d10c-4f42-bf08-4e5c2f08d069'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:37:44 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-7dd90128-9e92-4dc8-9514-9ffe58e79d92 tempest-TestStampPattern-823481616 None] Delete snapshot completed successfully. Jul 07 17:37:44 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-7dd90128-9e92-4dc8-9514-9ffe58e79d92 tempest-TestStampPattern-823481616 None] Lock "cinder-f0e62401-3871-4bf9-bd28-5c8484e62773-delete_snapshot" released by "delete_snapshot" :: held 3.589s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:37:52 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-fe1f24f1-90c7-4082-ad2a-840d960a2875 tempest-TestStampPattern-823481616 None] Acquiring lock "cinder-2729b0bd-6b21-4aff-ac1b-6095c4151400-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:37:52 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-fe1f24f1-90c7-4082-ad2a-840d960a2875 tempest-TestStampPattern-823481616 None] Lock "cinder-2729b0bd-6b21-4aff-ac1b-6095c4151400-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:37:52 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-fe1f24f1-90c7-4082-ad2a-840d960a2875 tempest-TestStampPattern-823481616 None] Acquiring lock "cinder-quobyte-2729b0bd-6b21-4aff-ac1b-6095c4151400" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:37:52 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-fe1f24f1-90c7-4082-ad2a-840d960a2875 tempest-TestStampPattern-823481616 None] Lock "cinder-quobyte-2729b0bd-6b21-4aff-ac1b-6095c4151400" acquired by "delete_volume" :: waited 0.036s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:37:52 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f58c12a-7757-40d0-b0cf-2230a3fdd724]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:37:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fe1f24f1-90c7-4082-ad2a-840d960a2875 tempest-TestStampPattern-823481616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:53 devstack sudo[104327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400 Jul 07 17:37:53 devstack sudo[104327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:53 devstack sudo[104327]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fe1f24f1-90c7-4082-ad2a-840d960a2875 tempest-TestStampPattern-823481616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400" returned: 0 in 0.848s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fe1f24f1-90c7-4082-ad2a-840d960a2875 tempest-TestStampPattern-823481616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:53 devstack sudo[104333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400 Jul 07 17:37:53 devstack sudo[104333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:54 devstack sudo[104333]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fe1f24f1-90c7-4082-ad2a-840d960a2875 tempest-TestStampPattern-823481616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2729b0bd-6b21-4aff-ac1b-6095c4151400" returned: 0 in 0.749s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:54 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-fe1f24f1-90c7-4082-ad2a-840d960a2875 tempest-TestStampPattern-823481616 None] Lock "cinder-quobyte-2729b0bd-6b21-4aff-ac1b-6095c4151400" released by "delete_volume" :: held 1.698s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:37:54 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-fe1f24f1-90c7-4082-ad2a-840d960a2875 tempest-TestStampPattern-823481616 None] Created reservations ['ee9d768d-3aa8-44d7-be00-e78afbf9184c', 'f6de779f-2bef-421c-83d6-e448f8dbc04d', 'b6faa4cb-a9b5-4a70-8e47-580ceab3178a', '273fc69f-3d4b-441f-a06b-e3a898cc6d4a'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:37:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-fe1f24f1-90c7-4082-ad2a-840d960a2875 tempest-TestStampPattern-823481616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:37:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-fe1f24f1-90c7-4082-ad2a-840d960a2875 tempest-TestStampPattern-823481616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:37:54 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-fe1f24f1-90c7-4082-ad2a-840d960a2875 tempest-TestStampPattern-823481616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:37:54 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-fe1f24f1-90c7-4082-ad2a-840d960a2875 tempest-TestStampPattern-823481616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:37:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-fe1f24f1-90c7-4082-ad2a-840d960a2875 tempest-TestStampPattern-823481616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:37:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fe1f24f1-90c7-4082-ad2a-840d960a2875 tempest-TestStampPattern-823481616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:54 devstack sudo[104338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:37:54 devstack sudo[104338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:55 devstack sudo[104338]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fe1f24f1-90c7-4082-ad2a-840d960a2875 tempest-TestStampPattern-823481616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.710s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:55 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-fe1f24f1-90c7-4082-ad2a-840d960a2875 tempest-TestStampPattern-823481616 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:37:55 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-fe1f24f1-90c7-4082-ad2a-840d960a2875 tempest-TestStampPattern-823481616 None] Deleted volume successfully. Jul 07 17:37:55 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-fe1f24f1-90c7-4082-ad2a-840d960a2875 tempest-TestStampPattern-823481616 None] Lock "cinder-2729b0bd-6b21-4aff-ac1b-6095c4151400-delete_volume" released by "delete_volume" :: held 2.650s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:38:04 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:SELECT=20,cinder:UPDATE=28,cinder:DELETE=2,cinder:INSERT=6 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:38:05 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:SELECT=24,cinder:UPDATE=30,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:38:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-5fd575ef-674f-4bd7-8742-2d482700f2ff req-8814a41a-d108-47d3-b384-1cf4b229f190 tempest-TestServerVolumeAttachmentScenario-491295297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:38:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-5fd575ef-674f-4bd7-8742-2d482700f2ff req-8814a41a-d108-47d3-b384-1cf4b229f190 tempest-TestServerVolumeAttachmentScenario-491295297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:38:17 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd22d6d-8d70-4a57-a4c5-ed335290492d]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:38:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-5fd575ef-674f-4bd7-8742-2d482700f2ff req-8814a41a-d108-47d3-b384-1cf4b229f190 tempest-TestServerVolumeAttachmentScenario-491295297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5115ca8a-3479-4ade-b8aa-a641def16157 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:17 devstack sudo[104389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5115ca8a-3479-4ade-b8aa-a641def16157 Jul 07 17:38:17 devstack sudo[104389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:18 devstack sudo[104389]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-5fd575ef-674f-4bd7-8742-2d482700f2ff req-8814a41a-d108-47d3-b384-1cf4b229f190 tempest-TestServerVolumeAttachmentScenario-491295297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5115ca8a-3479-4ade-b8aa-a641def16157" returned: 0 in 0.780s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-5fd575ef-674f-4bd7-8742-2d482700f2ff req-8814a41a-d108-47d3-b384-1cf4b229f190 tempest-TestServerVolumeAttachmentScenario-491295297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.797s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:38:18 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-5fd575ef-674f-4bd7-8742-2d482700f2ff req-8814a41a-d108-47d3-b384-1cf4b229f190 tempest-TestServerVolumeAttachmentScenario-491295297 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7', 'name': 'volume-5115ca8a-3479-4ade-b8aa-a641def16157', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7849b2fc-0cd8-49cd-9eeb-3e3f512226d2', 'enforce_multipath': True} {{(pid=87233) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:38:18 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-5fd575ef-674f-4bd7-8742-2d482700f2ff req-8814a41a-d108-47d3-b384-1cf4b229f190 tempest-TestServerVolumeAttachmentScenario-491295297 None] attachment_update completed successfully. Jul 07 17:38:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-70381fda-b678-496f-9a5f-212d4bb76486 req-44475669-03ae-447b-8696-3e675d4c0125 tempest-TestServerVolumeAttachmentScenario-491295297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:38:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-70381fda-b678-496f-9a5f-212d4bb76486 req-44475669-03ae-447b-8696-3e675d4c0125 tempest-TestServerVolumeAttachmentScenario-491295297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:38:27 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5406cd58-eb39-4e77-b1e9-3e3e31fbae15]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:38:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-70381fda-b678-496f-9a5f-212d4bb76486 req-44475669-03ae-447b-8696-3e675d4c0125 tempest-TestServerVolumeAttachmentScenario-491295297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ebf1af63-829e-4068-8671-ec20200b51f4 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:27 devstack sudo[104833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ebf1af63-829e-4068-8671-ec20200b51f4 Jul 07 17:38:27 devstack sudo[104833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:28 devstack sudo[104833]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [req-70381fda-b678-496f-9a5f-212d4bb76486 req-44475669-03ae-447b-8696-3e675d4c0125 tempest-TestServerVolumeAttachmentScenario-491295297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ebf1af63-829e-4068-8671-ec20200b51f4" returned: 0 in 0.781s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [req-70381fda-b678-496f-9a5f-212d4bb76486 req-44475669-03ae-447b-8696-3e675d4c0125 tempest-TestServerVolumeAttachmentScenario-491295297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.799s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:38:28 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-70381fda-b678-496f-9a5f-212d4bb76486 req-44475669-03ae-447b-8696-3e675d4c0125 tempest-TestServerVolumeAttachmentScenario-491295297 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7', 'name': 'volume-ebf1af63-829e-4068-8671-ec20200b51f4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a145ac72-9730-4be0-931c-f557294975b0', 'enforce_multipath': True} {{(pid=87233) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:38:28 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-70381fda-b678-496f-9a5f-212d4bb76486 req-44475669-03ae-447b-8696-3e675d4c0125 tempest-TestServerVolumeAttachmentScenario-491295297 None] attachment_update completed successfully. Jul 07 17:38:34 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-52be2370-db04-4783-85c7-6604194b3586 req-800aa0b1-f428-40d4-a2c2-a4c65d072395 tempest-TestServerVolumeAttachmentScenario-491295297 None] Terminate volume connection completed successfully. Jul 07 17:38:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-52be2370-db04-4783-85c7-6604194b3586 req-800aa0b1-f428-40d4-a2c2-a4c65d072395 tempest-TestServerVolumeAttachmentScenario-491295297 None] Deleting attachment a145ac72-9730-4be0-931c-f557294975b0. {{(pid=87233) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:38:37 devstack cinder-volume[87233]: INFO cinder.volume.manager [req-d820699a-13ee-4358-bd46-d42adf6b8965 req-6d4493f4-fd13-4871-9ffe-42f8c8ef7b82 tempest-TestServerVolumeAttachmentScenario-491295297 None] Terminate volume connection completed successfully. Jul 07 17:38:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [req-d820699a-13ee-4358-bd46-d42adf6b8965 req-6d4493f4-fd13-4871-9ffe-42f8c8ef7b82 tempest-TestServerVolumeAttachmentScenario-491295297 None] Deleting attachment 7849b2fc-0cd8-49cd-9eeb-3e3f512226d2. {{(pid=87233) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:38:43 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:38:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:38:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:38:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:38:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:38:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:38:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:43 devstack sudo[104895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:38:43 devstack sudo[104895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:44 devstack sudo[104895]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.642s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:44 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:38:44 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:38:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread count: 28 {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:38:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread info: [<_MainThread(MainThread, started 126077716062336)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:38:47 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-212c9d08-ee67-4c23-ad33-c3cce4ecff11 tempest-TestServerVolumeAttachmentScenario-491295297 None] Acquiring lock "cinder-ebf1af63-829e-4068-8671-ec20200b51f4-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:38:47 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-212c9d08-ee67-4c23-ad33-c3cce4ecff11 tempest-TestServerVolumeAttachmentScenario-491295297 None] Lock "cinder-ebf1af63-829e-4068-8671-ec20200b51f4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:38:47 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-212c9d08-ee67-4c23-ad33-c3cce4ecff11 tempest-TestServerVolumeAttachmentScenario-491295297 None] Acquiring lock "cinder-quobyte-ebf1af63-829e-4068-8671-ec20200b51f4" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:38:47 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-212c9d08-ee67-4c23-ad33-c3cce4ecff11 tempest-TestServerVolumeAttachmentScenario-491295297 None] Lock "cinder-quobyte-ebf1af63-829e-4068-8671-ec20200b51f4" acquired by "delete_volume" :: waited 0.015s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:38:47 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c42aab-f628-4caf-bc1e-011ea47b8533]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:38:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-212c9d08-ee67-4c23-ad33-c3cce4ecff11 tempest-TestServerVolumeAttachmentScenario-491295297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ebf1af63-829e-4068-8671-ec20200b51f4 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:48 devstack sudo[104899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ebf1af63-829e-4068-8671-ec20200b51f4 Jul 07 17:38:48 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:48 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-212c9d08-ee67-4c23-ad33-c3cce4ecff11 tempest-TestServerVolumeAttachmentScenario-491295297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ebf1af63-829e-4068-8671-ec20200b51f4" returned: 0 in 0.776s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-212c9d08-ee67-4c23-ad33-c3cce4ecff11 tempest-TestServerVolumeAttachmentScenario-491295297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ebf1af63-829e-4068-8671-ec20200b51f4 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:48 devstack sudo[104904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ebf1af63-829e-4068-8671-ec20200b51f4 Jul 07 17:38:48 devstack sudo[104904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:49 devstack sudo[104904]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-212c9d08-ee67-4c23-ad33-c3cce4ecff11 tempest-TestServerVolumeAttachmentScenario-491295297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ebf1af63-829e-4068-8671-ec20200b51f4" returned: 0 in 0.664s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:49 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-212c9d08-ee67-4c23-ad33-c3cce4ecff11 tempest-TestServerVolumeAttachmentScenario-491295297 None] Lock "cinder-quobyte-ebf1af63-829e-4068-8671-ec20200b51f4" released by "delete_volume" :: held 1.477s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:38:49 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-212c9d08-ee67-4c23-ad33-c3cce4ecff11 tempest-TestServerVolumeAttachmentScenario-491295297 None] Created reservations ['694b7324-19b1-4cb8-a1bf-fba090391ba9', '417d0753-67f9-43a9-bd07-2df5254e5553', '5f74a0dd-78fd-4491-8994-6f4f9fd6f6ff', 'b0afe570-91c0-410a-8aba-9190db4f04f9'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:38:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-212c9d08-ee67-4c23-ad33-c3cce4ecff11 tempest-TestServerVolumeAttachmentScenario-491295297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:38:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-212c9d08-ee67-4c23-ad33-c3cce4ecff11 tempest-TestServerVolumeAttachmentScenario-491295297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:38:49 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-212c9d08-ee67-4c23-ad33-c3cce4ecff11 tempest-TestServerVolumeAttachmentScenario-491295297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:38:49 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-212c9d08-ee67-4c23-ad33-c3cce4ecff11 tempest-TestServerVolumeAttachmentScenario-491295297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:38:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-212c9d08-ee67-4c23-ad33-c3cce4ecff11 tempest-TestServerVolumeAttachmentScenario-491295297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:38:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-212c9d08-ee67-4c23-ad33-c3cce4ecff11 tempest-TestServerVolumeAttachmentScenario-491295297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:49 devstack sudo[104907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:38:49 devstack sudo[104907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:50 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-939fa094-fae6-4564-aa67-d31c8790e55a tempest-TestServerVolumeAttachmentScenario-491295297 None] Acquiring lock "cinder-5115ca8a-3479-4ade-b8aa-a641def16157-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:38:50 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-939fa094-fae6-4564-aa67-d31c8790e55a tempest-TestServerVolumeAttachmentScenario-491295297 None] Lock "cinder-5115ca8a-3479-4ade-b8aa-a641def16157-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:38:50 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-939fa094-fae6-4564-aa67-d31c8790e55a tempest-TestServerVolumeAttachmentScenario-491295297 None] Acquiring lock "cinder-quobyte-5115ca8a-3479-4ade-b8aa-a641def16157" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:38:50 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-939fa094-fae6-4564-aa67-d31c8790e55a tempest-TestServerVolumeAttachmentScenario-491295297 None] Lock "cinder-quobyte-5115ca8a-3479-4ade-b8aa-a641def16157" acquired by "delete_volume" :: waited 0.027s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:38:50 devstack sudo[104907]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-212c9d08-ee67-4c23-ad33-c3cce4ecff11 tempest-TestServerVolumeAttachmentScenario-491295297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.676s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:50 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-212c9d08-ee67-4c23-ad33-c3cce4ecff11 tempest-TestServerVolumeAttachmentScenario-491295297 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:38:50 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-212c9d08-ee67-4c23-ad33-c3cce4ecff11 tempest-TestServerVolumeAttachmentScenario-491295297 None] Deleted volume successfully. Jul 07 17:38:50 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8807650-0b15-4e01-80e3-b1ab70739358]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:38:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-939fa094-fae6-4564-aa67-d31c8790e55a tempest-TestServerVolumeAttachmentScenario-491295297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5115ca8a-3479-4ade-b8aa-a641def16157 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:50 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-212c9d08-ee67-4c23-ad33-c3cce4ecff11 tempest-TestServerVolumeAttachmentScenario-491295297 None] Lock "cinder-ebf1af63-829e-4068-8671-ec20200b51f4-delete_volume" released by "delete_volume" :: held 2.365s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:38:50 devstack sudo[104910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5115ca8a-3479-4ade-b8aa-a641def16157 Jul 07 17:38:50 devstack sudo[104910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:51 devstack sudo[104910]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-939fa094-fae6-4564-aa67-d31c8790e55a tempest-TestServerVolumeAttachmentScenario-491295297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5115ca8a-3479-4ade-b8aa-a641def16157" returned: 0 in 0.757s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-939fa094-fae6-4564-aa67-d31c8790e55a tempest-TestServerVolumeAttachmentScenario-491295297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5115ca8a-3479-4ade-b8aa-a641def16157 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:51 devstack sudo[104916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5115ca8a-3479-4ade-b8aa-a641def16157 Jul 07 17:38:51 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:51 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-939fa094-fae6-4564-aa67-d31c8790e55a tempest-TestServerVolumeAttachmentScenario-491295297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5115ca8a-3479-4ade-b8aa-a641def16157" returned: 0 in 0.634s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:51 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-939fa094-fae6-4564-aa67-d31c8790e55a tempest-TestServerVolumeAttachmentScenario-491295297 None] Lock "cinder-quobyte-5115ca8a-3479-4ade-b8aa-a641def16157" released by "delete_volume" :: held 1.441s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:38:51 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-939fa094-fae6-4564-aa67-d31c8790e55a tempest-TestServerVolumeAttachmentScenario-491295297 None] Created reservations ['e2feb054-d006-4f49-9dc8-18c80104ef2d', '014c724a-22ce-4bd9-8281-ba4eb2b60f26', 'ec555670-85d3-4799-a7ab-4d545a917752', '4285bd5c-fe11-47b1-aabf-d70b52284476'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:38:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-939fa094-fae6-4564-aa67-d31c8790e55a tempest-TestServerVolumeAttachmentScenario-491295297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:38:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-939fa094-fae6-4564-aa67-d31c8790e55a tempest-TestServerVolumeAttachmentScenario-491295297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:38:51 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-939fa094-fae6-4564-aa67-d31c8790e55a tempest-TestServerVolumeAttachmentScenario-491295297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:38:51 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-939fa094-fae6-4564-aa67-d31c8790e55a tempest-TestServerVolumeAttachmentScenario-491295297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:38:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-939fa094-fae6-4564-aa67-d31c8790e55a tempest-TestServerVolumeAttachmentScenario-491295297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:38:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-939fa094-fae6-4564-aa67-d31c8790e55a tempest-TestServerVolumeAttachmentScenario-491295297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:51 devstack sudo[104919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:38:51 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:52 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-939fa094-fae6-4564-aa67-d31c8790e55a tempest-TestServerVolumeAttachmentScenario-491295297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.640s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:52 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-939fa094-fae6-4564-aa67-d31c8790e55a tempest-TestServerVolumeAttachmentScenario-491295297 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:38:52 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-939fa094-fae6-4564-aa67-d31c8790e55a tempest-TestServerVolumeAttachmentScenario-491295297 None] Deleted volume successfully. Jul 07 17:38:52 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-939fa094-fae6-4564-aa67-d31c8790e55a tempest-TestServerVolumeAttachmentScenario-491295297 None] Lock "cinder-5115ca8a-3479-4ade-b8aa-a641def16157-delete_volume" released by "delete_volume" :: held 2.299s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:39:01 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:SELECT=17,cinder:UPDATE=21,cinder:INSERT=4 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:39:02 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac8883b8-b583-4037-adfc-f42d855f6261 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:39:02 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ac8883b8-b583-4037-adfc-f42d855f6261 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Flow 'volume_create_manager' (acff66c7-6b56-4eec-9898-c8a324f5f32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:39:02 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ac8883b8-b583-4037-adfc-f42d855f6261 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c12c60e8-9760-4165-8f9b-24fcf68b5222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:02 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ac8883b8-b583-4037-adfc-f42d855f6261 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c12c60e8-9760-4165-8f9b-24fcf68b5222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:39:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-135956292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58721164-3bd3-4f5c-9725-3a481058567a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='287711faf0354990b850bea9f066546d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:39:02Z,use_quota=True,user_id='1a1b7fffc98540b38675e07cdabd533d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:02 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ac8883b8-b583-4037-adfc-f42d855f6261 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4842cf8-327d-42e2-b9ad-c1025c3052f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:02 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ac8883b8-b583-4037-adfc-f42d855f6261 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4842cf8-327d-42e2-b9ad-c1025c3052f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:02 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ac8883b8-b583-4037-adfc-f42d855f6261 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2b1fccc-4f46-4e5c-9b64-7ac85baa8d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:02 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ac8883b8-b583-4037-adfc-f42d855f6261 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2b1fccc-4f46-4e5c-9b64-7ac85baa8d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58721164-3bd3-4f5c-9725-3a481058567a', 'volume_name': 'volume-58721164-3bd3-4f5c-9725-3a481058567a', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:02 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ac8883b8-b583-4037-adfc-f42d855f6261 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ebf92be-6789-485e-bf9e-ee16d550f3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:02 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ac8883b8-b583-4037-adfc-f42d855f6261 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ebf92be-6789-485e-bf9e-ee16d550f3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:02 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ac8883b8-b583-4037-adfc-f42d855f6261 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a8485d0-8937-4d66-ae68-4bf39221692c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:02 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-ac8883b8-b583-4037-adfc-f42d855f6261 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Volume 58721164-3bd3-4f5c-9725-3a481058567a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58721164-3bd3-4f5c-9725-3a481058567a', 'volume_size': 1} Jul 07 17:39:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ac8883b8-b583-4037-adfc-f42d855f6261 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ac8883b8-b583-4037-adfc-f42d855f6261 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:02 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ac8883b8-b583-4037-adfc-f42d855f6261 tempest-CreateVolumesFromSnapshotTest-1668345459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:39:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-135956292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58721164-3bd3-4f5c-9725-3a481058567a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='287711faf0354990b850bea9f066546d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:39:02Z,use_quota=True,user_id='1a1b7fffc98540b38675e07cdabd533d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:39:02 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-ac8883b8-b583-4037-adfc-f42d855f6261 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Creating volume 58721164-3bd3-4f5c-9725-3a481058567a {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:39:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ac8883b8-b583-4037-adfc-f42d855f6261 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ac8883b8-b583-4037-adfc-f42d855f6261 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:02 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ac8883b8-b583-4037-adfc-f42d855f6261 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:39:02 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ac8883b8-b583-4037-adfc-f42d855f6261 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:39:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ac8883b8-b583-4037-adfc-f42d855f6261 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:02 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ac8883b8-b583-4037-adfc-f42d855f6261 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:39:02 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-ac8883b8-b583-4037-adfc-f42d855f6261 tempest-CreateVolumesFromSnapshotTest-1668345459 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:39:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ac8883b8-b583-4037-adfc-f42d855f6261 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-58721164-3bd3-4f5c-9725-3a481058567a 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:02 devstack sudo[104929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-58721164-3bd3-4f5c-9725-3a481058567a 1073741824 Jul 07 17:39:02 devstack sudo[104929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:03 devstack sudo[104929]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ac8883b8-b583-4037-adfc-f42d855f6261 tempest-CreateVolumesFromSnapshotTest-1668345459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-58721164-3bd3-4f5c-9725-3a481058567a 1073741824" returned: 0 in 0.810s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ac8883b8-b583-4037-adfc-f42d855f6261 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-58721164-3bd3-4f5c-9725-3a481058567a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:03 devstack sudo[104934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-58721164-3bd3-4f5c-9725-3a481058567a Jul 07 17:39:03 devstack sudo[104934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:03 devstack sudo[104934]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ac8883b8-b583-4037-adfc-f42d855f6261 tempest-CreateVolumesFromSnapshotTest-1668345459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-58721164-3bd3-4f5c-9725-3a481058567a" returned: 0 in 0.667s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:03 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ac8883b8-b583-4037-adfc-f42d855f6261 tempest-CreateVolumesFromSnapshotTest-1668345459 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:39:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ac8883b8-b583-4037-adfc-f42d855f6261 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.523s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:03 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ac8883b8-b583-4037-adfc-f42d855f6261 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a8485d0-8937-4d66-ae68-4bf39221692c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58721164-3bd3-4f5c-9725-3a481058567a', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:03 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ac8883b8-b583-4037-adfc-f42d855f6261 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85445720-8f37-4c42-9150-fb507264dc93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:03 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-ac8883b8-b583-4037-adfc-f42d855f6261 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Volume volume-58721164-3bd3-4f5c-9725-3a481058567a (58721164-3bd3-4f5c-9725-3a481058567a): created successfully Jul 07 17:39:03 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ac8883b8-b583-4037-adfc-f42d855f6261 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85445720-8f37-4c42-9150-fb507264dc93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:03 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ac8883b8-b583-4037-adfc-f42d855f6261 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Flow 'volume_create_manager' (acff66c7-6b56-4eec-9898-c8a324f5f32a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:39:03 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-ac8883b8-b583-4037-adfc-f42d855f6261 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Created volume successfully. Jul 07 17:39:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b640b507-2f94-43f5-aa2a-8bbe11cbd7be tempest-CreateVolumesFromSnapshotTest-1668345459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b640b507-2f94-43f5-aa2a-8bbe11cbd7be tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:04 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-b640b507-2f94-43f5-aa2a-8bbe11cbd7be tempest-CreateVolumesFromSnapshotTest-1668345459 None] Creating offline snapshot e0095fb0-d10d-4382-9f2c-48df0204f050 of volume 58721164-3bd3-4f5c-9725-3a481058567a {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:39:04 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0007be7-50f3-4ee5-a110-1ded23bbc3d2]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:39:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b640b507-2f94-43f5-aa2a-8bbe11cbd7be tempest-CreateVolumesFromSnapshotTest-1668345459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-58721164-3bd3-4f5c-9725-3a481058567a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:04 devstack sudo[104938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-58721164-3bd3-4f5c-9725-3a481058567a Jul 07 17:39:04 devstack sudo[104938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:05 devstack sudo[104938]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b640b507-2f94-43f5-aa2a-8bbe11cbd7be tempest-CreateVolumesFromSnapshotTest-1668345459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-58721164-3bd3-4f5c-9725-3a481058567a" returned: 0 in 0.744s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b640b507-2f94-43f5-aa2a-8bbe11cbd7be tempest-CreateVolumesFromSnapshotTest-1668345459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-58721164-3bd3-4f5c-9725-3a481058567a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-58721164-3bd3-4f5c-9725-3a481058567a.e0095fb0-d10d-4382-9f2c-48df0204f050 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:05 devstack sudo[104943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-58721164-3bd3-4f5c-9725-3a481058567a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-58721164-3bd3-4f5c-9725-3a481058567a.e0095fb0-d10d-4382-9f2c-48df0204f050 1G Jul 07 17:39:05 devstack sudo[104943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:06 devstack sudo[104943]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b640b507-2f94-43f5-aa2a-8bbe11cbd7be tempest-CreateVolumesFromSnapshotTest-1668345459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-58721164-3bd3-4f5c-9725-3a481058567a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-58721164-3bd3-4f5c-9725-3a481058567a.e0095fb0-d10d-4382-9f2c-48df0204f050 1G" returned: 0 in 0.808s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b640b507-2f94-43f5-aa2a-8bbe11cbd7be tempest-CreateVolumesFromSnapshotTest-1668345459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58721164-3bd3-4f5c-9725-3a481058567a -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-58721164-3bd3-4f5c-9725-3a481058567a.e0095fb0-d10d-4382-9f2c-48df0204f050 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:06 devstack sudo[104948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58721164-3bd3-4f5c-9725-3a481058567a -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-58721164-3bd3-4f5c-9725-3a481058567a.e0095fb0-d10d-4382-9f2c-48df0204f050 Jul 07 17:39:06 devstack sudo[104948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:06 devstack sudo[104948]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b640b507-2f94-43f5-aa2a-8bbe11cbd7be tempest-CreateVolumesFromSnapshotTest-1668345459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58721164-3bd3-4f5c-9725-3a481058567a -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-58721164-3bd3-4f5c-9725-3a481058567a.e0095fb0-d10d-4382-9f2c-48df0204f050" returned: 0 in 0.686s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:06 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-b640b507-2f94-43f5-aa2a-8bbe11cbd7be tempest-CreateVolumesFromSnapshotTest-1668345459 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-58721164-3bd3-4f5c-9725-3a481058567a.e0095fb0-d10d-4382-9f2c-48df0204f050 is being set with open permissions: ugo+rw Jul 07 17:39:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b640b507-2f94-43f5-aa2a-8bbe11cbd7be tempest-CreateVolumesFromSnapshotTest-1668345459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-58721164-3bd3-4f5c-9725-3a481058567a.e0095fb0-d10d-4382-9f2c-48df0204f050 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:06 devstack sudo[104953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-58721164-3bd3-4f5c-9725-3a481058567a.e0095fb0-d10d-4382-9f2c-48df0204f050 Jul 07 17:39:06 devstack sudo[104953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:07 devstack sudo[104953]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b640b507-2f94-43f5-aa2a-8bbe11cbd7be tempest-CreateVolumesFromSnapshotTest-1668345459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-58721164-3bd3-4f5c-9725-3a481058567a.e0095fb0-d10d-4382-9f2c-48df0204f050" returned: 0 in 0.611s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b640b507-2f94-43f5-aa2a-8bbe11cbd7be tempest-CreateVolumesFromSnapshotTest-1668345459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-58721164-3bd3-4f5c-9725-3a481058567a.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:07 devstack sudo[104956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-58721164-3bd3-4f5c-9725-3a481058567a.info Jul 07 17:39:07 devstack sudo[104956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:07 devstack sudo[104956]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b640b507-2f94-43f5-aa2a-8bbe11cbd7be tempest-CreateVolumesFromSnapshotTest-1668345459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-58721164-3bd3-4f5c-9725-3a481058567a.info" returned: 0 in 0.636s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:07 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-b640b507-2f94-43f5-aa2a-8bbe11cbd7be tempest-CreateVolumesFromSnapshotTest-1668345459 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-58721164-3bd3-4f5c-9725-3a481058567a.info is being set with open permissions: ugo+rw Jul 07 17:39:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b640b507-2f94-43f5-aa2a-8bbe11cbd7be tempest-CreateVolumesFromSnapshotTest-1668345459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-58721164-3bd3-4f5c-9725-3a481058567a.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:08 devstack sudo[104959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-58721164-3bd3-4f5c-9725-3a481058567a.info Jul 07 17:39:08 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:08 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b640b507-2f94-43f5-aa2a-8bbe11cbd7be tempest-CreateVolumesFromSnapshotTest-1668345459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-58721164-3bd3-4f5c-9725-3a481058567a.info" returned: 0 in 0.612s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b640b507-2f94-43f5-aa2a-8bbe11cbd7be tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.177s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:08 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-b640b507-2f94-43f5-aa2a-8bbe11cbd7be tempest-CreateVolumesFromSnapshotTest-1668345459 None] Create snapshot completed successfully Jul 07 17:39:10 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-a89ac3e6-350d-49a3-93d3-4c7cd3381a61 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:39:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a89ac3e6-350d-49a3-93d3-4c7cd3381a61 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Flow 'volume_create_manager' (4292a9a5-0e4b-4eec-8489-bd8cf26bfcd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:39:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a89ac3e6-350d-49a3-93d3-4c7cd3381a61 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f08c960-a577-4f9e-a8ef-e43ad609a68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a89ac3e6-350d-49a3-93d3-4c7cd3381a61 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f08c960-a577-4f9e-a8ef-e43ad609a68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-827235462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a233f7c9-0ec2-43a3-a898-3440542e3ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='287711faf0354990b850bea9f066546d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:39:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:39:10Z,use_quota=True,user_id='1a1b7fffc98540b38675e07cdabd533d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a89ac3e6-350d-49a3-93d3-4c7cd3381a61 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0984d074-f391-427b-9e23-009c8282c5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a89ac3e6-350d-49a3-93d3-4c7cd3381a61 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0984d074-f391-427b-9e23-009c8282c5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a89ac3e6-350d-49a3-93d3-4c7cd3381a61 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfcaa35f-5c3b-4efd-84c0-da63bf3a9ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a89ac3e6-350d-49a3-93d3-4c7cd3381a61 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfcaa35f-5c3b-4efd-84c0-da63bf3a9ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a233f7c9-0ec2-43a3-a898-3440542e3ca5', 'volume_name': 'volume-a233f7c9-0ec2-43a3-a898-3440542e3ca5', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a89ac3e6-350d-49a3-93d3-4c7cd3381a61 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1401d02-f95d-422f-8f07-13a946313cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a89ac3e6-350d-49a3-93d3-4c7cd3381a61 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1401d02-f95d-422f-8f07-13a946313cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a89ac3e6-350d-49a3-93d3-4c7cd3381a61 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0154ec8a-3184-4cd2-8810-31005fb5aa69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:10 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-a89ac3e6-350d-49a3-93d3-4c7cd3381a61 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Volume a233f7c9-0ec2-43a3-a898-3440542e3ca5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a233f7c9-0ec2-43a3-a898-3440542e3ca5', 'volume_size': 1} Jul 07 17:39:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a89ac3e6-350d-49a3-93d3-4c7cd3381a61 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a89ac3e6-350d-49a3-93d3-4c7cd3381a61 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:10 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-a89ac3e6-350d-49a3-93d3-4c7cd3381a61 tempest-CreateVolumesFromSnapshotTest-1668345459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-827235462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a233f7c9-0ec2-43a3-a898-3440542e3ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='287711faf0354990b850bea9f066546d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:39:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:39:10Z,use_quota=True,user_id='1a1b7fffc98540b38675e07cdabd533d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:39:10 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-a89ac3e6-350d-49a3-93d3-4c7cd3381a61 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Creating volume a233f7c9-0ec2-43a3-a898-3440542e3ca5 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:39:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a89ac3e6-350d-49a3-93d3-4c7cd3381a61 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a89ac3e6-350d-49a3-93d3-4c7cd3381a61 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:10 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-a89ac3e6-350d-49a3-93d3-4c7cd3381a61 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:39:10 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-a89ac3e6-350d-49a3-93d3-4c7cd3381a61 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:39:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a89ac3e6-350d-49a3-93d3-4c7cd3381a61 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:10 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-a89ac3e6-350d-49a3-93d3-4c7cd3381a61 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:39:10 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-a89ac3e6-350d-49a3-93d3-4c7cd3381a61 tempest-CreateVolumesFromSnapshotTest-1668345459 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:39:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a89ac3e6-350d-49a3-93d3-4c7cd3381a61 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a233f7c9-0ec2-43a3-a898-3440542e3ca5 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:10 devstack sudo[104962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a233f7c9-0ec2-43a3-a898-3440542e3ca5 1073741824 Jul 07 17:39:10 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:10 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8977cdf-a1fb-4617-997b-3e26e666677e tempest-CreateVolumesFromSnapshotTest-1668345459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:39:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f8977cdf-a1fb-4617-997b-3e26e666677e tempest-CreateVolumesFromSnapshotTest-1668345459 None] Flow 'volume_create_manager' (d545f256-5621-4bac-a87c-652794c842c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:39:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f8977cdf-a1fb-4617-997b-3e26e666677e tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fc44fb2-082c-4656-af09-46f4fcf8e6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f8977cdf-a1fb-4617-997b-3e26e666677e tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fc44fb2-082c-4656-af09-46f4fcf8e6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-517180651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95f4d57d-9a81-493f-824d-bcc37fa7e68f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='287711faf0354990b850bea9f066546d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:39:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:39:10Z,use_quota=True,user_id='1a1b7fffc98540b38675e07cdabd533d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f8977cdf-a1fb-4617-997b-3e26e666677e tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7d14978-09e8-4b5f-8beb-2b9ccf300563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f8977cdf-a1fb-4617-997b-3e26e666677e tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7d14978-09e8-4b5f-8beb-2b9ccf300563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f8977cdf-a1fb-4617-997b-3e26e666677e tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f31b9bdb-6d05-41ba-b273-2564ae267851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f8977cdf-a1fb-4617-997b-3e26e666677e tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f31b9bdb-6d05-41ba-b273-2564ae267851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95f4d57d-9a81-493f-824d-bcc37fa7e68f', 'volume_name': 'volume-95f4d57d-9a81-493f-824d-bcc37fa7e68f', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f8977cdf-a1fb-4617-997b-3e26e666677e tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8247d6a5-2303-4508-9621-5225de56d5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f8977cdf-a1fb-4617-997b-3e26e666677e tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8247d6a5-2303-4508-9621-5225de56d5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f8977cdf-a1fb-4617-997b-3e26e666677e tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (747f52e8-4ab2-40b0-b18b-79e239c69487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:10 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-f8977cdf-a1fb-4617-997b-3e26e666677e tempest-CreateVolumesFromSnapshotTest-1668345459 None] Volume 95f4d57d-9a81-493f-824d-bcc37fa7e68f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95f4d57d-9a81-493f-824d-bcc37fa7e68f', 'volume_size': 1} Jul 07 17:39:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f8977cdf-a1fb-4617-997b-3e26e666677e tempest-CreateVolumesFromSnapshotTest-1668345459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:10 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-4db4ce7a-03d5-43a3-9284-564b071c9ea1 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:39:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4db4ce7a-03d5-43a3-9284-564b071c9ea1 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Flow 'volume_create_manager' (f86e6c77-4774-4103-b815-724681dc927f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:39:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4db4ce7a-03d5-43a3-9284-564b071c9ea1 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a45563d-16d2-45a7-b48f-f73a87a974f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4db4ce7a-03d5-43a3-9284-564b071c9ea1 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a45563d-16d2-45a7-b48f-f73a87a974f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1583243422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40f0e376-1443-4480-a0e2-726bca08b7ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='287711faf0354990b850bea9f066546d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:39:11Z,use_quota=True,user_id='1a1b7fffc98540b38675e07cdabd533d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4db4ce7a-03d5-43a3-9284-564b071c9ea1 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (726d64af-d82b-43c5-a685-3254821ea25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4db4ce7a-03d5-43a3-9284-564b071c9ea1 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (726d64af-d82b-43c5-a685-3254821ea25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4db4ce7a-03d5-43a3-9284-564b071c9ea1 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6022c2ce-9673-42c2-882f-ac9eb51473c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4db4ce7a-03d5-43a3-9284-564b071c9ea1 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6022c2ce-9673-42c2-882f-ac9eb51473c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40f0e376-1443-4480-a0e2-726bca08b7ca', 'volume_name': 'volume-40f0e376-1443-4480-a0e2-726bca08b7ca', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4db4ce7a-03d5-43a3-9284-564b071c9ea1 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f224e1a5-ad42-4127-b86a-e9b54c3ed416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4db4ce7a-03d5-43a3-9284-564b071c9ea1 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f224e1a5-ad42-4127-b86a-e9b54c3ed416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4db4ce7a-03d5-43a3-9284-564b071c9ea1 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9552419-be52-421c-b8c9-d9ee29771d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:10 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-4db4ce7a-03d5-43a3-9284-564b071c9ea1 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Volume 40f0e376-1443-4480-a0e2-726bca08b7ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40f0e376-1443-4480-a0e2-726bca08b7ca', 'volume_size': 1} Jul 07 17:39:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4db4ce7a-03d5-43a3-9284-564b071c9ea1 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:11 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a89ac3e6-350d-49a3-93d3-4c7cd3381a61 tempest-CreateVolumesFromSnapshotTest-1668345459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a233f7c9-0ec2-43a3-a898-3440542e3ca5 1073741824" returned: 0 in 0.904s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a89ac3e6-350d-49a3-93d3-4c7cd3381a61 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a233f7c9-0ec2-43a3-a898-3440542e3ca5 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:11 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a233f7c9-0ec2-43a3-a898-3440542e3ca5 Jul 07 17:39:11 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:11 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9033259-1c59-4840-b4f5-ea13470c76cd tempest-CreateVolumesFromSnapshotTest-1668345459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:39:11 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c9033259-1c59-4840-b4f5-ea13470c76cd tempest-CreateVolumesFromSnapshotTest-1668345459 None] Flow 'volume_create_manager' (a1a0452f-f1f6-444e-94dc-3853653de5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:39:11 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c9033259-1c59-4840-b4f5-ea13470c76cd tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71430c94-1034-405c-9719-feb33ebbb5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:11 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c9033259-1c59-4840-b4f5-ea13470c76cd tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71430c94-1034-405c-9719-feb33ebbb5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-843860929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d68cdd75-4858-44e7-9df8-2f2f21201e78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='287711faf0354990b850bea9f066546d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:39:11Z,use_quota=True,user_id='1a1b7fffc98540b38675e07cdabd533d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:11 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c9033259-1c59-4840-b4f5-ea13470c76cd tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a47b709f-0beb-460a-adc2-e234f3f46119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:11 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c9033259-1c59-4840-b4f5-ea13470c76cd tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a47b709f-0beb-460a-adc2-e234f3f46119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:11 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c9033259-1c59-4840-b4f5-ea13470c76cd tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (882073ef-fd49-41a3-ba9b-aa2d0df4df66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:11 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c9033259-1c59-4840-b4f5-ea13470c76cd tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (882073ef-fd49-41a3-ba9b-aa2d0df4df66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd68cdd75-4858-44e7-9df8-2f2f21201e78', 'volume_name': 'volume-d68cdd75-4858-44e7-9df8-2f2f21201e78', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:11 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c9033259-1c59-4840-b4f5-ea13470c76cd tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7de507bb-95b8-4036-bb99-7bb6a57d9ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:11 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c9033259-1c59-4840-b4f5-ea13470c76cd tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7de507bb-95b8-4036-bb99-7bb6a57d9ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:11 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c9033259-1c59-4840-b4f5-ea13470c76cd tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3606ebd-8ebe-4142-9942-2f10f4d3261f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:11 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-c9033259-1c59-4840-b4f5-ea13470c76cd tempest-CreateVolumesFromSnapshotTest-1668345459 None] Volume d68cdd75-4858-44e7-9df8-2f2f21201e78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d68cdd75-4858-44e7-9df8-2f2f21201e78', 'volume_size': 1} Jul 07 17:39:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c9033259-1c59-4840-b4f5-ea13470c76cd tempest-CreateVolumesFromSnapshotTest-1668345459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:11 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-fde284c1-0f55-4f3b-a69c-ca8388ba1606 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:39:11 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fde284c1-0f55-4f3b-a69c-ca8388ba1606 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Flow 'volume_create_manager' (df7a2599-c78d-4e6d-af8b-3c956d05bed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:39:11 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fde284c1-0f55-4f3b-a69c-ca8388ba1606 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf248d3c-15c7-40bd-bc4d-68c132ccdbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:11 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fde284c1-0f55-4f3b-a69c-ca8388ba1606 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf248d3c-15c7-40bd-bc4d-68c132ccdbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1354874819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b34ca5eb-63ec-45e0-87b9-f6c828636e92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='287711faf0354990b850bea9f066546d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:39:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:39:12Z,use_quota=True,user_id='1a1b7fffc98540b38675e07cdabd533d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:11 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fde284c1-0f55-4f3b-a69c-ca8388ba1606 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11bf6bc4-a8c8-49e2-bff5-23baf4121276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:11 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fde284c1-0f55-4f3b-a69c-ca8388ba1606 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11bf6bc4-a8c8-49e2-bff5-23baf4121276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:11 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fde284c1-0f55-4f3b-a69c-ca8388ba1606 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac8bdb24-6925-4a9e-8aaa-ed2f6c674226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:11 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fde284c1-0f55-4f3b-a69c-ca8388ba1606 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac8bdb24-6925-4a9e-8aaa-ed2f6c674226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b34ca5eb-63ec-45e0-87b9-f6c828636e92', 'volume_name': 'volume-b34ca5eb-63ec-45e0-87b9-f6c828636e92', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:11 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fde284c1-0f55-4f3b-a69c-ca8388ba1606 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfb0587b-08b3-494e-976f-1ffe2bce7f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:11 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fde284c1-0f55-4f3b-a69c-ca8388ba1606 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfb0587b-08b3-494e-976f-1ffe2bce7f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:11 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fde284c1-0f55-4f3b-a69c-ca8388ba1606 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c101a96a-0d19-4dca-b2a6-eaca5baba281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:11 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-fde284c1-0f55-4f3b-a69c-ca8388ba1606 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Volume b34ca5eb-63ec-45e0-87b9-f6c828636e92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b34ca5eb-63ec-45e0-87b9-f6c828636e92', 'volume_size': 1} Jul 07 17:39:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-fde284c1-0f55-4f3b-a69c-ca8388ba1606 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:11 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a89ac3e6-350d-49a3-93d3-4c7cd3381a61 tempest-CreateVolumesFromSnapshotTest-1668345459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a233f7c9-0ec2-43a3-a898-3440542e3ca5" returned: 0 in 0.683s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:11 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-a89ac3e6-350d-49a3-93d3-4c7cd3381a61 tempest-CreateVolumesFromSnapshotTest-1668345459 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:39:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a89ac3e6-350d-49a3-93d3-4c7cd3381a61 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f8977cdf-a1fb-4617-997b-3e26e666677e tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.267s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:11 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-f8977cdf-a1fb-4617-997b-3e26e666677e tempest-CreateVolumesFromSnapshotTest-1668345459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-517180651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95f4d57d-9a81-493f-824d-bcc37fa7e68f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='287711faf0354990b850bea9f066546d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:39:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:39:10Z,use_quota=True,user_id='1a1b7fffc98540b38675e07cdabd533d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:39:11 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-f8977cdf-a1fb-4617-997b-3e26e666677e tempest-CreateVolumesFromSnapshotTest-1668345459 None] Creating volume 95f4d57d-9a81-493f-824d-bcc37fa7e68f {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:39:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f8977cdf-a1fb-4617-997b-3e26e666677e tempest-CreateVolumesFromSnapshotTest-1668345459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f8977cdf-a1fb-4617-997b-3e26e666677e tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:11 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-f8977cdf-a1fb-4617-997b-3e26e666677e tempest-CreateVolumesFromSnapshotTest-1668345459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:39:11 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-f8977cdf-a1fb-4617-997b-3e26e666677e tempest-CreateVolumesFromSnapshotTest-1668345459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:39:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f8977cdf-a1fb-4617-997b-3e26e666677e tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:11 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-f8977cdf-a1fb-4617-997b-3e26e666677e tempest-CreateVolumesFromSnapshotTest-1668345459 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:39:11 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-f8977cdf-a1fb-4617-997b-3e26e666677e tempest-CreateVolumesFromSnapshotTest-1668345459 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:39:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f8977cdf-a1fb-4617-997b-3e26e666677e tempest-CreateVolumesFromSnapshotTest-1668345459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-95f4d57d-9a81-493f-824d-bcc37fa7e68f 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:11 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a89ac3e6-350d-49a3-93d3-4c7cd3381a61 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0154ec8a-3184-4cd2-8810-31005fb5aa69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a233f7c9-0ec2-43a3-a898-3440542e3ca5', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:11 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a89ac3e6-350d-49a3-93d3-4c7cd3381a61 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79221beb-f005-42d6-89fe-88279b31fda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:11 devstack sudo[104972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-95f4d57d-9a81-493f-824d-bcc37fa7e68f 1073741824 Jul 07 17:39:11 devstack sudo[104972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:11 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-a89ac3e6-350d-49a3-93d3-4c7cd3381a61 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Volume volume-a233f7c9-0ec2-43a3-a898-3440542e3ca5 (a233f7c9-0ec2-43a3-a898-3440542e3ca5): created successfully Jul 07 17:39:11 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a89ac3e6-350d-49a3-93d3-4c7cd3381a61 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79221beb-f005-42d6-89fe-88279b31fda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:11 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-a89ac3e6-350d-49a3-93d3-4c7cd3381a61 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Flow 'volume_create_manager' (4292a9a5-0e4b-4eec-8489-bd8cf26bfcd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:39:11 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-a89ac3e6-350d-49a3-93d3-4c7cd3381a61 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Created volume successfully. Jul 07 17:39:12 devstack sudo[104972]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f8977cdf-a1fb-4617-997b-3e26e666677e tempest-CreateVolumesFromSnapshotTest-1668345459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-95f4d57d-9a81-493f-824d-bcc37fa7e68f 1073741824" returned: 0 in 0.805s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f8977cdf-a1fb-4617-997b-3e26e666677e tempest-CreateVolumesFromSnapshotTest-1668345459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-95f4d57d-9a81-493f-824d-bcc37fa7e68f {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:12 devstack sudo[104978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-95f4d57d-9a81-493f-824d-bcc37fa7e68f Jul 07 17:39:12 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:13 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f8977cdf-a1fb-4617-997b-3e26e666677e tempest-CreateVolumesFromSnapshotTest-1668345459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-95f4d57d-9a81-493f-824d-bcc37fa7e68f" returned: 0 in 0.610s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:13 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-f8977cdf-a1fb-4617-997b-3e26e666677e tempest-CreateVolumesFromSnapshotTest-1668345459 None] <== create_volume: return (1455ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:39:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f8977cdf-a1fb-4617-997b-3e26e666677e tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.458s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4db4ce7a-03d5-43a3-9284-564b071c9ea1 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.366s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:13 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-4db4ce7a-03d5-43a3-9284-564b071c9ea1 tempest-CreateVolumesFromSnapshotTest-1668345459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1583243422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40f0e376-1443-4480-a0e2-726bca08b7ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='287711faf0354990b850bea9f066546d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:39:11Z,use_quota=True,user_id='1a1b7fffc98540b38675e07cdabd533d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:39:13 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-4db4ce7a-03d5-43a3-9284-564b071c9ea1 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Creating volume 40f0e376-1443-4480-a0e2-726bca08b7ca {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:39:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4db4ce7a-03d5-43a3-9284-564b071c9ea1 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4db4ce7a-03d5-43a3-9284-564b071c9ea1 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:13 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-4db4ce7a-03d5-43a3-9284-564b071c9ea1 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:39:13 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-4db4ce7a-03d5-43a3-9284-564b071c9ea1 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:39:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4db4ce7a-03d5-43a3-9284-564b071c9ea1 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:13 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-4db4ce7a-03d5-43a3-9284-564b071c9ea1 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:39:13 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-4db4ce7a-03d5-43a3-9284-564b071c9ea1 tempest-CreateVolumesFromSnapshotTest-1668345459 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:39:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4db4ce7a-03d5-43a3-9284-564b071c9ea1 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-40f0e376-1443-4480-a0e2-726bca08b7ca 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f8977cdf-a1fb-4617-997b-3e26e666677e tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (747f52e8-4ab2-40b0-b18b-79e239c69487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95f4d57d-9a81-493f-824d-bcc37fa7e68f', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:13 devstack sudo[104981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-40f0e376-1443-4480-a0e2-726bca08b7ca 1073741824 Jul 07 17:39:13 devstack sudo[104981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f8977cdf-a1fb-4617-997b-3e26e666677e tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e208a43-43f1-4f4f-999b-494fddddbdbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:13 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-f8977cdf-a1fb-4617-997b-3e26e666677e tempest-CreateVolumesFromSnapshotTest-1668345459 None] Volume volume-95f4d57d-9a81-493f-824d-bcc37fa7e68f (95f4d57d-9a81-493f-824d-bcc37fa7e68f): created successfully Jul 07 17:39:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f8977cdf-a1fb-4617-997b-3e26e666677e tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e208a43-43f1-4f4f-999b-494fddddbdbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-f8977cdf-a1fb-4617-997b-3e26e666677e tempest-CreateVolumesFromSnapshotTest-1668345459 None] Flow 'volume_create_manager' (d545f256-5621-4bac-a87c-652794c842c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:39:13 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-f8977cdf-a1fb-4617-997b-3e26e666677e tempest-CreateVolumesFromSnapshotTest-1668345459 None] Created volume successfully. Jul 07 17:39:14 devstack sudo[104981]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4db4ce7a-03d5-43a3-9284-564b071c9ea1 tempest-CreateVolumesFromSnapshotTest-1668345459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-40f0e376-1443-4480-a0e2-726bca08b7ca 1073741824" returned: 0 in 0.859s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4db4ce7a-03d5-43a3-9284-564b071c9ea1 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-40f0e376-1443-4480-a0e2-726bca08b7ca {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:14 devstack sudo[104986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-40f0e376-1443-4480-a0e2-726bca08b7ca Jul 07 17:39:14 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:14 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4db4ce7a-03d5-43a3-9284-564b071c9ea1 tempest-CreateVolumesFromSnapshotTest-1668345459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-40f0e376-1443-4480-a0e2-726bca08b7ca" returned: 0 in 0.715s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:14 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-4db4ce7a-03d5-43a3-9284-564b071c9ea1 tempest-CreateVolumesFromSnapshotTest-1668345459 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:39:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4db4ce7a-03d5-43a3-9284-564b071c9ea1 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c9033259-1c59-4840-b4f5-ea13470c76cd tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.615s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:14 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c9033259-1c59-4840-b4f5-ea13470c76cd tempest-CreateVolumesFromSnapshotTest-1668345459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-843860929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d68cdd75-4858-44e7-9df8-2f2f21201e78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='287711faf0354990b850bea9f066546d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:39:11Z,use_quota=True,user_id='1a1b7fffc98540b38675e07cdabd533d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:39:14 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-c9033259-1c59-4840-b4f5-ea13470c76cd tempest-CreateVolumesFromSnapshotTest-1668345459 None] Creating volume d68cdd75-4858-44e7-9df8-2f2f21201e78 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:39:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c9033259-1c59-4840-b4f5-ea13470c76cd tempest-CreateVolumesFromSnapshotTest-1668345459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c9033259-1c59-4840-b4f5-ea13470c76cd tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:14 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c9033259-1c59-4840-b4f5-ea13470c76cd tempest-CreateVolumesFromSnapshotTest-1668345459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:39:14 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c9033259-1c59-4840-b4f5-ea13470c76cd tempest-CreateVolumesFromSnapshotTest-1668345459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:39:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c9033259-1c59-4840-b4f5-ea13470c76cd tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:14 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c9033259-1c59-4840-b4f5-ea13470c76cd tempest-CreateVolumesFromSnapshotTest-1668345459 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:39:14 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-c9033259-1c59-4840-b4f5-ea13470c76cd tempest-CreateVolumesFromSnapshotTest-1668345459 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:39:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c9033259-1c59-4840-b4f5-ea13470c76cd tempest-CreateVolumesFromSnapshotTest-1668345459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d68cdd75-4858-44e7-9df8-2f2f21201e78 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:14 devstack sudo[104989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d68cdd75-4858-44e7-9df8-2f2f21201e78 1073741824 Jul 07 17:39:14 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4db4ce7a-03d5-43a3-9284-564b071c9ea1 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9552419-be52-421c-b8c9-d9ee29771d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40f0e376-1443-4480-a0e2-726bca08b7ca', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:14 devstack sudo[104989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:14 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4db4ce7a-03d5-43a3-9284-564b071c9ea1 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25b9881c-032a-4cbb-945a-f2f63ed5498a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:14 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:SELECT=43,cinder:UPDATE=31,cinder:INSERT=6,cinder:DELETE=5 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:39:14 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-4db4ce7a-03d5-43a3-9284-564b071c9ea1 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Volume volume-40f0e376-1443-4480-a0e2-726bca08b7ca (40f0e376-1443-4480-a0e2-726bca08b7ca): created successfully Jul 07 17:39:14 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4db4ce7a-03d5-43a3-9284-564b071c9ea1 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25b9881c-032a-4cbb-945a-f2f63ed5498a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:14 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4db4ce7a-03d5-43a3-9284-564b071c9ea1 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Flow 'volume_create_manager' (f86e6c77-4774-4103-b815-724681dc927f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:39:14 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-4db4ce7a-03d5-43a3-9284-564b071c9ea1 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Created volume successfully. Jul 07 17:39:15 devstack sudo[104989]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c9033259-1c59-4840-b4f5-ea13470c76cd tempest-CreateVolumesFromSnapshotTest-1668345459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d68cdd75-4858-44e7-9df8-2f2f21201e78 1073741824" returned: 0 in 0.783s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c9033259-1c59-4840-b4f5-ea13470c76cd tempest-CreateVolumesFromSnapshotTest-1668345459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d68cdd75-4858-44e7-9df8-2f2f21201e78 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:15 devstack sudo[104995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d68cdd75-4858-44e7-9df8-2f2f21201e78 Jul 07 17:39:15 devstack sudo[104995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:16 devstack sudo[104995]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c9033259-1c59-4840-b4f5-ea13470c76cd tempest-CreateVolumesFromSnapshotTest-1668345459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d68cdd75-4858-44e7-9df8-2f2f21201e78" returned: 0 in 0.622s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:16 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c9033259-1c59-4840-b4f5-ea13470c76cd tempest-CreateVolumesFromSnapshotTest-1668345459 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:39:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c9033259-1c59-4840-b4f5-ea13470c76cd tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.446s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-fde284c1-0f55-4f3b-a69c-ca8388ba1606 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.685s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:16 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-fde284c1-0f55-4f3b-a69c-ca8388ba1606 tempest-CreateVolumesFromSnapshotTest-1668345459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1354874819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b34ca5eb-63ec-45e0-87b9-f6c828636e92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='287711faf0354990b850bea9f066546d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:39:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:39:12Z,use_quota=True,user_id='1a1b7fffc98540b38675e07cdabd533d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:39:16 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-fde284c1-0f55-4f3b-a69c-ca8388ba1606 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Creating volume b34ca5eb-63ec-45e0-87b9-f6c828636e92 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:39:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-fde284c1-0f55-4f3b-a69c-ca8388ba1606 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-fde284c1-0f55-4f3b-a69c-ca8388ba1606 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:16 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-fde284c1-0f55-4f3b-a69c-ca8388ba1606 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:39:16 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-fde284c1-0f55-4f3b-a69c-ca8388ba1606 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:39:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-fde284c1-0f55-4f3b-a69c-ca8388ba1606 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:16 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-fde284c1-0f55-4f3b-a69c-ca8388ba1606 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:39:16 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-fde284c1-0f55-4f3b-a69c-ca8388ba1606 tempest-CreateVolumesFromSnapshotTest-1668345459 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:39:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fde284c1-0f55-4f3b-a69c-ca8388ba1606 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b34ca5eb-63ec-45e0-87b9-f6c828636e92 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:16 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c9033259-1c59-4840-b4f5-ea13470c76cd tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3606ebd-8ebe-4142-9942-2f10f4d3261f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d68cdd75-4858-44e7-9df8-2f2f21201e78', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:16 devstack sudo[104998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b34ca5eb-63ec-45e0-87b9-f6c828636e92 1073741824 Jul 07 17:39:16 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:16 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c9033259-1c59-4840-b4f5-ea13470c76cd tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (127ee2ac-2261-4bbc-9498-1f31a4d8a8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:16 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-c9033259-1c59-4840-b4f5-ea13470c76cd tempest-CreateVolumesFromSnapshotTest-1668345459 None] Volume volume-d68cdd75-4858-44e7-9df8-2f2f21201e78 (d68cdd75-4858-44e7-9df8-2f2f21201e78): created successfully Jul 07 17:39:16 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c9033259-1c59-4840-b4f5-ea13470c76cd tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (127ee2ac-2261-4bbc-9498-1f31a4d8a8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:16 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c9033259-1c59-4840-b4f5-ea13470c76cd tempest-CreateVolumesFromSnapshotTest-1668345459 None] Flow 'volume_create_manager' (a1a0452f-f1f6-444e-94dc-3853653de5dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:39:16 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-c9033259-1c59-4840-b4f5-ea13470c76cd tempest-CreateVolumesFromSnapshotTest-1668345459 None] Created volume successfully. Jul 07 17:39:17 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fde284c1-0f55-4f3b-a69c-ca8388ba1606 tempest-CreateVolumesFromSnapshotTest-1668345459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b34ca5eb-63ec-45e0-87b9-f6c828636e92 1073741824" returned: 0 in 0.898s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fde284c1-0f55-4f3b-a69c-ca8388ba1606 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b34ca5eb-63ec-45e0-87b9-f6c828636e92 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:17 devstack sudo[105004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b34ca5eb-63ec-45e0-87b9-f6c828636e92 Jul 07 17:39:17 devstack sudo[105004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:17 devstack sudo[105004]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fde284c1-0f55-4f3b-a69c-ca8388ba1606 tempest-CreateVolumesFromSnapshotTest-1668345459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b34ca5eb-63ec-45e0-87b9-f6c828636e92" returned: 0 in 0.651s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:17 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-fde284c1-0f55-4f3b-a69c-ca8388ba1606 tempest-CreateVolumesFromSnapshotTest-1668345459 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:39:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-fde284c1-0f55-4f3b-a69c-ca8388ba1606 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.589s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:17 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fde284c1-0f55-4f3b-a69c-ca8388ba1606 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c101a96a-0d19-4dca-b2a6-eaca5baba281) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b34ca5eb-63ec-45e0-87b9-f6c828636e92', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:17 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fde284c1-0f55-4f3b-a69c-ca8388ba1606 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b49e545-7c20-4ed5-a50d-828f75c80f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:17 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-fde284c1-0f55-4f3b-a69c-ca8388ba1606 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Volume volume-b34ca5eb-63ec-45e0-87b9-f6c828636e92 (b34ca5eb-63ec-45e0-87b9-f6c828636e92): created successfully Jul 07 17:39:17 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fde284c1-0f55-4f3b-a69c-ca8388ba1606 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b49e545-7c20-4ed5-a50d-828f75c80f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:17 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fde284c1-0f55-4f3b-a69c-ca8388ba1606 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Flow 'volume_create_manager' (df7a2599-c78d-4e6d-af8b-3c956d05bed6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:39:17 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-fde284c1-0f55-4f3b-a69c-ca8388ba1606 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Created volume successfully. Jul 07 17:39:18 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a67709ad-a946-428b-9059-bcec6d69c493 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Acquiring lock "cinder-b34ca5eb-63ec-45e0-87b9-f6c828636e92-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:39:18 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a67709ad-a946-428b-9059-bcec6d69c493 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "cinder-b34ca5eb-63ec-45e0-87b9-f6c828636e92-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:39:18 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a67709ad-a946-428b-9059-bcec6d69c493 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Acquiring lock "cinder-quobyte-b34ca5eb-63ec-45e0-87b9-f6c828636e92" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:39:18 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a67709ad-a946-428b-9059-bcec6d69c493 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "cinder-quobyte-b34ca5eb-63ec-45e0-87b9-f6c828636e92" acquired by "delete_volume" :: waited 0.017s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:39:18 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[396e71db-af4b-4dce-955f-0af1554e271a]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:39:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a67709ad-a946-428b-9059-bcec6d69c493 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b34ca5eb-63ec-45e0-87b9-f6c828636e92 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:18 devstack sudo[105007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b34ca5eb-63ec-45e0-87b9-f6c828636e92 Jul 07 17:39:18 devstack sudo[105007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:18 devstack sudo[105007]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a67709ad-a946-428b-9059-bcec6d69c493 tempest-CreateVolumesFromSnapshotTest-1668345459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b34ca5eb-63ec-45e0-87b9-f6c828636e92" returned: 0 in 0.755s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a67709ad-a946-428b-9059-bcec6d69c493 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b34ca5eb-63ec-45e0-87b9-f6c828636e92 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:19 devstack sudo[105012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b34ca5eb-63ec-45e0-87b9-f6c828636e92 Jul 07 17:39:19 devstack sudo[105012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:19 devstack sudo[105012]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a67709ad-a946-428b-9059-bcec6d69c493 tempest-CreateVolumesFromSnapshotTest-1668345459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-b34ca5eb-63ec-45e0-87b9-f6c828636e92" returned: 0 in 0.689s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:19 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a67709ad-a946-428b-9059-bcec6d69c493 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "cinder-quobyte-b34ca5eb-63ec-45e0-87b9-f6c828636e92" released by "delete_volume" :: held 1.489s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:39:19 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-a67709ad-a946-428b-9059-bcec6d69c493 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Created reservations ['a06c78c8-e85c-45af-8f25-3f035de32463', 'ac4589b9-7548-4d87-83d5-b2e194ce113d', '0572650c-f5b1-49f6-b1d7-1b27352aa0a3', 'f09ae106-29b3-4140-861f-97f9ac2c0b63'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:39:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a67709ad-a946-428b-9059-bcec6d69c493 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a67709ad-a946-428b-9059-bcec6d69c493 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:19 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-a67709ad-a946-428b-9059-bcec6d69c493 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:39:19 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-a67709ad-a946-428b-9059-bcec6d69c493 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:39:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a67709ad-a946-428b-9059-bcec6d69c493 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a67709ad-a946-428b-9059-bcec6d69c493 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:19 devstack sudo[105051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:39:19 devstack sudo[105051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:20 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a84e24f4-25bd-4e4a-b871-6903dea9e330 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Acquiring lock "cinder-d68cdd75-4858-44e7-9df8-2f2f21201e78-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:39:20 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a84e24f4-25bd-4e4a-b871-6903dea9e330 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "cinder-d68cdd75-4858-44e7-9df8-2f2f21201e78-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:39:20 devstack sudo[105051]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a67709ad-a946-428b-9059-bcec6d69c493 tempest-CreateVolumesFromSnapshotTest-1668345459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.645s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:20 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-a67709ad-a946-428b-9059-bcec6d69c493 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:39:20 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a84e24f4-25bd-4e4a-b871-6903dea9e330 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Acquiring lock "cinder-quobyte-d68cdd75-4858-44e7-9df8-2f2f21201e78" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:39:20 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-a67709ad-a946-428b-9059-bcec6d69c493 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Deleted volume successfully. Jul 07 17:39:20 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a84e24f4-25bd-4e4a-b871-6903dea9e330 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "cinder-quobyte-d68cdd75-4858-44e7-9df8-2f2f21201e78" acquired by "delete_volume" :: waited 0.023s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:39:20 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a67709ad-a946-428b-9059-bcec6d69c493 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "cinder-b34ca5eb-63ec-45e0-87b9-f6c828636e92-delete_volume" released by "delete_volume" :: held 2.351s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:39:20 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92c92ed-f211-4688-a937-b664dc178fc4]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:39:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a84e24f4-25bd-4e4a-b871-6903dea9e330 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d68cdd75-4858-44e7-9df8-2f2f21201e78 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:20 devstack sudo[105054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d68cdd75-4858-44e7-9df8-2f2f21201e78 Jul 07 17:39:20 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:21 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a84e24f4-25bd-4e4a-b871-6903dea9e330 tempest-CreateVolumesFromSnapshotTest-1668345459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d68cdd75-4858-44e7-9df8-2f2f21201e78" returned: 0 in 0.749s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a84e24f4-25bd-4e4a-b871-6903dea9e330 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d68cdd75-4858-44e7-9df8-2f2f21201e78 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:21 devstack sudo[105061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d68cdd75-4858-44e7-9df8-2f2f21201e78 Jul 07 17:39:21 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:21 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a84e24f4-25bd-4e4a-b871-6903dea9e330 tempest-CreateVolumesFromSnapshotTest-1668345459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d68cdd75-4858-44e7-9df8-2f2f21201e78" returned: 0 in 0.636s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:21 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a84e24f4-25bd-4e4a-b871-6903dea9e330 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "cinder-quobyte-d68cdd75-4858-44e7-9df8-2f2f21201e78" released by "delete_volume" :: held 1.428s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:39:21 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-a84e24f4-25bd-4e4a-b871-6903dea9e330 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Created reservations ['674cb5b4-7130-45bf-ab71-7128c351e642', 'a995c3b3-c094-4d4b-846e-a4394ba61007', 'f5fc73bf-9302-499e-b6f7-3973aabade17', '1f0c3f1e-d5fa-447a-a393-094b70432ad7'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:39:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a84e24f4-25bd-4e4a-b871-6903dea9e330 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a84e24f4-25bd-4e4a-b871-6903dea9e330 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:22 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-a84e24f4-25bd-4e4a-b871-6903dea9e330 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:39:22 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-a84e24f4-25bd-4e4a-b871-6903dea9e330 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:39:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a84e24f4-25bd-4e4a-b871-6903dea9e330 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a84e24f4-25bd-4e4a-b871-6903dea9e330 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:22 devstack sudo[105070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:39:22 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:22 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6e31cc3b-1c64-44b4-a2d4-03d9f3b47e8d tempest-CreateVolumesFromSnapshotTest-1668345459 None] Acquiring lock "cinder-40f0e376-1443-4480-a0e2-726bca08b7ca-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:39:22 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a84e24f4-25bd-4e4a-b871-6903dea9e330 tempest-CreateVolumesFromSnapshotTest-1668345459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.675s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:22 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-a84e24f4-25bd-4e4a-b871-6903dea9e330 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:39:22 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6e31cc3b-1c64-44b4-a2d4-03d9f3b47e8d tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "cinder-40f0e376-1443-4480-a0e2-726bca08b7ca-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:39:22 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-a84e24f4-25bd-4e4a-b871-6903dea9e330 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Deleted volume successfully. Jul 07 17:39:22 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a84e24f4-25bd-4e4a-b871-6903dea9e330 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "cinder-d68cdd75-4858-44e7-9df8-2f2f21201e78-delete_volume" released by "delete_volume" :: held 2.342s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:39:22 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6e31cc3b-1c64-44b4-a2d4-03d9f3b47e8d tempest-CreateVolumesFromSnapshotTest-1668345459 None] Acquiring lock "cinder-quobyte-40f0e376-1443-4480-a0e2-726bca08b7ca" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:39:22 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6e31cc3b-1c64-44b4-a2d4-03d9f3b47e8d tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "cinder-quobyte-40f0e376-1443-4480-a0e2-726bca08b7ca" acquired by "delete_volume" :: waited 0.014s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:39:22 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35dbd72-d85a-4902-afd4-8f906f2a7e8e]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:39:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6e31cc3b-1c64-44b4-a2d4-03d9f3b47e8d tempest-CreateVolumesFromSnapshotTest-1668345459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-40f0e376-1443-4480-a0e2-726bca08b7ca {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:22 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-40f0e376-1443-4480-a0e2-726bca08b7ca Jul 07 17:39:22 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:23 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6e31cc3b-1c64-44b4-a2d4-03d9f3b47e8d tempest-CreateVolumesFromSnapshotTest-1668345459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-40f0e376-1443-4480-a0e2-726bca08b7ca" returned: 0 in 0.742s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6e31cc3b-1c64-44b4-a2d4-03d9f3b47e8d tempest-CreateVolumesFromSnapshotTest-1668345459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-40f0e376-1443-4480-a0e2-726bca08b7ca {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:23 devstack sudo[105080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-40f0e376-1443-4480-a0e2-726bca08b7ca Jul 07 17:39:23 devstack sudo[105080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:24 devstack sudo[105080]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6e31cc3b-1c64-44b4-a2d4-03d9f3b47e8d tempest-CreateVolumesFromSnapshotTest-1668345459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-40f0e376-1443-4480-a0e2-726bca08b7ca" returned: 0 in 0.618s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:24 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6e31cc3b-1c64-44b4-a2d4-03d9f3b47e8d tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "cinder-quobyte-40f0e376-1443-4480-a0e2-726bca08b7ca" released by "delete_volume" :: held 1.399s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:39:24 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-6e31cc3b-1c64-44b4-a2d4-03d9f3b47e8d tempest-CreateVolumesFromSnapshotTest-1668345459 None] Created reservations ['f2b10bfa-4d31-4512-a1a4-f97ec6a63eaf', '51d90ce2-7105-4224-8789-06bddb422a4a', '223b72e8-b6d2-4f4e-a784-7d6b15a94384', '65cd3a52-05b4-4623-8947-09ddb5fab8c6'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:39:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-6e31cc3b-1c64-44b4-a2d4-03d9f3b47e8d tempest-CreateVolumesFromSnapshotTest-1668345459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-6e31cc3b-1c64-44b4-a2d4-03d9f3b47e8d tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:24 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-6e31cc3b-1c64-44b4-a2d4-03d9f3b47e8d tempest-CreateVolumesFromSnapshotTest-1668345459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:39:24 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-6e31cc3b-1c64-44b4-a2d4-03d9f3b47e8d tempest-CreateVolumesFromSnapshotTest-1668345459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:39:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-6e31cc3b-1c64-44b4-a2d4-03d9f3b47e8d tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6e31cc3b-1c64-44b4-a2d4-03d9f3b47e8d tempest-CreateVolumesFromSnapshotTest-1668345459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:24 devstack sudo[105083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:39:24 devstack sudo[105083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:24 devstack sudo[105083]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:24 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-af294b3c-cd9e-4e7a-a481-a07c71ee7083 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Acquiring lock "cinder-95f4d57d-9a81-493f-824d-bcc37fa7e68f-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:39:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6e31cc3b-1c64-44b4-a2d4-03d9f3b47e8d tempest-CreateVolumesFromSnapshotTest-1668345459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.656s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:24 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-6e31cc3b-1c64-44b4-a2d4-03d9f3b47e8d tempest-CreateVolumesFromSnapshotTest-1668345459 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:39:24 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-6e31cc3b-1c64-44b4-a2d4-03d9f3b47e8d tempest-CreateVolumesFromSnapshotTest-1668345459 None] Deleted volume successfully. Jul 07 17:39:24 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-af294b3c-cd9e-4e7a-a481-a07c71ee7083 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "cinder-95f4d57d-9a81-493f-824d-bcc37fa7e68f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:39:25 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6e31cc3b-1c64-44b4-a2d4-03d9f3b47e8d tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "cinder-40f0e376-1443-4480-a0e2-726bca08b7ca-delete_volume" released by "delete_volume" :: held 2.291s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:39:25 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-af294b3c-cd9e-4e7a-a481-a07c71ee7083 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Acquiring lock "cinder-quobyte-95f4d57d-9a81-493f-824d-bcc37fa7e68f" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:39:25 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-af294b3c-cd9e-4e7a-a481-a07c71ee7083 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "cinder-quobyte-95f4d57d-9a81-493f-824d-bcc37fa7e68f" acquired by "delete_volume" :: waited 0.020s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:39:25 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc1cf19-9df6-4879-bf10-a85d6dbd7eb7]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:39:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-af294b3c-cd9e-4e7a-a481-a07c71ee7083 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-95f4d57d-9a81-493f-824d-bcc37fa7e68f {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:25 devstack sudo[105086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-95f4d57d-9a81-493f-824d-bcc37fa7e68f Jul 07 17:39:25 devstack sudo[105086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:25 devstack sudo[105086]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-af294b3c-cd9e-4e7a-a481-a07c71ee7083 tempest-CreateVolumesFromSnapshotTest-1668345459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-95f4d57d-9a81-493f-824d-bcc37fa7e68f" returned: 0 in 0.747s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-af294b3c-cd9e-4e7a-a481-a07c71ee7083 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-95f4d57d-9a81-493f-824d-bcc37fa7e68f {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:25 devstack sudo[105091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-95f4d57d-9a81-493f-824d-bcc37fa7e68f Jul 07 17:39:25 devstack sudo[105091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:26 devstack sudo[105091]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-af294b3c-cd9e-4e7a-a481-a07c71ee7083 tempest-CreateVolumesFromSnapshotTest-1668345459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-95f4d57d-9a81-493f-824d-bcc37fa7e68f" returned: 0 in 0.655s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:26 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-af294b3c-cd9e-4e7a-a481-a07c71ee7083 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "cinder-quobyte-95f4d57d-9a81-493f-824d-bcc37fa7e68f" released by "delete_volume" :: held 1.441s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:39:26 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-af294b3c-cd9e-4e7a-a481-a07c71ee7083 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Created reservations ['f6fa49a4-f047-4fc2-9168-249f8487eeaa', 'fc088a72-5ace-44dd-bc7b-aad4d03e15d4', '1d9d503a-0e03-46c9-952d-fe4626ef9ad3', 'eff4925f-d596-4df7-b6a9-251ee887a51a'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:39:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-af294b3c-cd9e-4e7a-a481-a07c71ee7083 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-af294b3c-cd9e-4e7a-a481-a07c71ee7083 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:26 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-af294b3c-cd9e-4e7a-a481-a07c71ee7083 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:39:26 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-af294b3c-cd9e-4e7a-a481-a07c71ee7083 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:39:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-af294b3c-cd9e-4e7a-a481-a07c71ee7083 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-af294b3c-cd9e-4e7a-a481-a07c71ee7083 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:26 devstack sudo[105094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:39:26 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:27 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9773bab8-fa30-4fe7-88df-0217a3a6bb19 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Acquiring lock "cinder-a233f7c9-0ec2-43a3-a898-3440542e3ca5-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:39:27 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9773bab8-fa30-4fe7-88df-0217a3a6bb19 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "cinder-a233f7c9-0ec2-43a3-a898-3440542e3ca5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:39:27 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9773bab8-fa30-4fe7-88df-0217a3a6bb19 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Acquiring lock "cinder-quobyte-a233f7c9-0ec2-43a3-a898-3440542e3ca5" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:39:27 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9773bab8-fa30-4fe7-88df-0217a3a6bb19 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "cinder-quobyte-a233f7c9-0ec2-43a3-a898-3440542e3ca5" acquired by "delete_volume" :: waited 0.020s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:39:27 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-af294b3c-cd9e-4e7a-a481-a07c71ee7083 tempest-CreateVolumesFromSnapshotTest-1668345459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.705s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:27 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-af294b3c-cd9e-4e7a-a481-a07c71ee7083 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:39:27 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-af294b3c-cd9e-4e7a-a481-a07c71ee7083 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Deleted volume successfully. Jul 07 17:39:27 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[160120f6-35ea-4db8-ba0d-6236777e7e8a]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:39:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9773bab8-fa30-4fe7-88df-0217a3a6bb19 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a233f7c9-0ec2-43a3-a898-3440542e3ca5 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:27 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-af294b3c-cd9e-4e7a-a481-a07c71ee7083 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "cinder-95f4d57d-9a81-493f-824d-bcc37fa7e68f-delete_volume" released by "delete_volume" :: held 2.388s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:39:27 devstack sudo[105097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a233f7c9-0ec2-43a3-a898-3440542e3ca5 Jul 07 17:39:27 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:28 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9773bab8-fa30-4fe7-88df-0217a3a6bb19 tempest-CreateVolumesFromSnapshotTest-1668345459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a233f7c9-0ec2-43a3-a898-3440542e3ca5" returned: 0 in 0.722s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9773bab8-fa30-4fe7-88df-0217a3a6bb19 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a233f7c9-0ec2-43a3-a898-3440542e3ca5 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:28 devstack sudo[105102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a233f7c9-0ec2-43a3-a898-3440542e3ca5 Jul 07 17:39:28 devstack sudo[105102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:28 devstack sudo[105102]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9773bab8-fa30-4fe7-88df-0217a3a6bb19 tempest-CreateVolumesFromSnapshotTest-1668345459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a233f7c9-0ec2-43a3-a898-3440542e3ca5" returned: 0 in 0.635s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:28 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9773bab8-fa30-4fe7-88df-0217a3a6bb19 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "cinder-quobyte-a233f7c9-0ec2-43a3-a898-3440542e3ca5" released by "delete_volume" :: held 1.409s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:39:28 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-9773bab8-fa30-4fe7-88df-0217a3a6bb19 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Created reservations ['0df4fe67-35ad-4305-a296-57c24dacaf24', 'e8b631ad-ef7c-4e9e-a782-5b2a5f5dc0da', '5519667c-e724-45f1-8d23-f28fe4a83b3e', 'e1132e2d-a8ad-48b9-9c1c-ab81fa35494b'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:39:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9773bab8-fa30-4fe7-88df-0217a3a6bb19 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9773bab8-fa30-4fe7-88df-0217a3a6bb19 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:28 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-9773bab8-fa30-4fe7-88df-0217a3a6bb19 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:39:28 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-9773bab8-fa30-4fe7-88df-0217a3a6bb19 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:39:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9773bab8-fa30-4fe7-88df-0217a3a6bb19 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9773bab8-fa30-4fe7-88df-0217a3a6bb19 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:28 devstack sudo[105105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:39:28 devstack sudo[105105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:29 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ffd90736-fcef-48c2-8c75-4a998d2435de tempest-CreateVolumesFromSnapshotTest-1668345459 None] Acquiring lock "cinder-e0095fb0-d10d-4382-9f2c-48df0204f050-delete_snapshot" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:39:29 devstack sudo[105105]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9773bab8-fa30-4fe7-88df-0217a3a6bb19 tempest-CreateVolumesFromSnapshotTest-1668345459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.643s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:29 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-9773bab8-fa30-4fe7-88df-0217a3a6bb19 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:39:29 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-9773bab8-fa30-4fe7-88df-0217a3a6bb19 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Deleted volume successfully. Jul 07 17:39:29 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ffd90736-fcef-48c2-8c75-4a998d2435de tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "cinder-e0095fb0-d10d-4382-9f2c-48df0204f050-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:39:29 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ffd90736-fcef-48c2-8c75-4a998d2435de tempest-CreateVolumesFromSnapshotTest-1668345459 None] Acquiring lock "cinder-quobyte-58721164-3bd3-4f5c-9725-3a481058567a" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:39:29 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9773bab8-fa30-4fe7-88df-0217a3a6bb19 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "cinder-a233f7c9-0ec2-43a3-a898-3440542e3ca5-delete_volume" released by "delete_volume" :: held 2.257s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:39:29 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ffd90736-fcef-48c2-8c75-4a998d2435de tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "cinder-quobyte-58721164-3bd3-4f5c-9725-3a481058567a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:39:29 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ffd90736-fcef-48c2-8c75-4a998d2435de tempest-CreateVolumesFromSnapshotTest-1668345459 None] Acquiring lock "cinder-quobyte-e0095fb0-d10d-4382-9f2c-48df0204f050" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:39:29 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ffd90736-fcef-48c2-8c75-4a998d2435de tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "cinder-quobyte-e0095fb0-d10d-4382-9f2c-48df0204f050" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:39:29 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-ffd90736-fcef-48c2-8c75-4a998d2435de tempest-CreateVolumesFromSnapshotTest-1668345459 None] Deleting offline snapshot e0095fb0-d10d-4382-9f2c-48df0204f050 of volume 58721164-3bd3-4f5c-9725-3a481058567a {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:39:29 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-ffd90736-fcef-48c2-8c75-4a998d2435de tempest-CreateVolumesFromSnapshotTest-1668345459 None] snapshot_file for this snap is: volume-58721164-3bd3-4f5c-9725-3a481058567a.e0095fb0-d10d-4382-9f2c-48df0204f050 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:39:29 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a363236-0e32-4dbb-b35f-4ba248e3bc5a]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:39:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ffd90736-fcef-48c2-8c75-4a998d2435de tempest-CreateVolumesFromSnapshotTest-1668345459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-58721164-3bd3-4f5c-9725-3a481058567a.e0095fb0-d10d-4382-9f2c-48df0204f050 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:29 devstack sudo[105108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-58721164-3bd3-4f5c-9725-3a481058567a.e0095fb0-d10d-4382-9f2c-48df0204f050 Jul 07 17:39:29 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:30 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ffd90736-fcef-48c2-8c75-4a998d2435de tempest-CreateVolumesFromSnapshotTest-1668345459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-58721164-3bd3-4f5c-9725-3a481058567a.e0095fb0-d10d-4382-9f2c-48df0204f050" returned: 0 in 0.721s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:30 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-ffd90736-fcef-48c2-8c75-4a998d2435de tempest-CreateVolumesFromSnapshotTest-1668345459 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58721164-3bd3-4f5c-9725-3a481058567a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:39:30 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8ef808-2682-4879-ab44-905a645f5a89]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:39:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ffd90736-fcef-48c2-8c75-4a998d2435de tempest-CreateVolumesFromSnapshotTest-1668345459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-58721164-3bd3-4f5c-9725-3a481058567a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:30 devstack sudo[105113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-58721164-3bd3-4f5c-9725-3a481058567a Jul 07 17:39:30 devstack sudo[105113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:31 devstack sudo[105113]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ffd90736-fcef-48c2-8c75-4a998d2435de tempest-CreateVolumesFromSnapshotTest-1668345459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-58721164-3bd3-4f5c-9725-3a481058567a" returned: 0 in 0.721s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ffd90736-fcef-48c2-8c75-4a998d2435de tempest-CreateVolumesFromSnapshotTest-1668345459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-58721164-3bd3-4f5c-9725-3a481058567a.e0095fb0-d10d-4382-9f2c-48df0204f050 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:31 devstack sudo[105119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-58721164-3bd3-4f5c-9725-3a481058567a.e0095fb0-d10d-4382-9f2c-48df0204f050 Jul 07 17:39:31 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:31 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ffd90736-fcef-48c2-8c75-4a998d2435de tempest-CreateVolumesFromSnapshotTest-1668345459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-58721164-3bd3-4f5c-9725-3a481058567a.e0095fb0-d10d-4382-9f2c-48df0204f050" returned: 0 in 0.711s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ffd90736-fcef-48c2-8c75-4a998d2435de tempest-CreateVolumesFromSnapshotTest-1668345459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-58721164-3bd3-4f5c-9725-3a481058567a.e0095fb0-d10d-4382-9f2c-48df0204f050 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:31 devstack sudo[105124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-58721164-3bd3-4f5c-9725-3a481058567a.e0095fb0-d10d-4382-9f2c-48df0204f050 Jul 07 17:39:31 devstack sudo[105124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:32 devstack sudo[105124]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ffd90736-fcef-48c2-8c75-4a998d2435de tempest-CreateVolumesFromSnapshotTest-1668345459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-58721164-3bd3-4f5c-9725-3a481058567a.e0095fb0-d10d-4382-9f2c-48df0204f050" returned: 0 in 0.650s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:32 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ffd90736-fcef-48c2-8c75-4a998d2435de tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "cinder-quobyte-e0095fb0-d10d-4382-9f2c-48df0204f050" released by "_delete_snapshot" :: held 2.900s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:39:32 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ffd90736-fcef-48c2-8c75-4a998d2435de tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "cinder-quobyte-58721164-3bd3-4f5c-9725-3a481058567a" released by "delete_snapshot" :: held 2.926s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:39:32 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-ffd90736-fcef-48c2-8c75-4a998d2435de tempest-CreateVolumesFromSnapshotTest-1668345459 None] Created reservations ['36ea273a-c43f-4610-bd1e-2484e2468f49', '79cba5ba-e7de-4bed-bf72-0c9cb830d6a3', '5e845d51-27fa-4a8c-aa0d-674ea50d6263', '023be5d6-a983-4dc3-ab44-9cf2f1d3fadf'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:39:32 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-ffd90736-fcef-48c2-8c75-4a998d2435de tempest-CreateVolumesFromSnapshotTest-1668345459 None] Delete snapshot completed successfully. Jul 07 17:39:32 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ffd90736-fcef-48c2-8c75-4a998d2435de tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "cinder-e0095fb0-d10d-4382-9f2c-48df0204f050-delete_snapshot" released by "delete_snapshot" :: held 3.063s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:39:32 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d5977bbc-9a35-41a1-a439-012427b51677 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Acquiring lock "cinder-58721164-3bd3-4f5c-9725-3a481058567a-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:39:32 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d5977bbc-9a35-41a1-a439-012427b51677 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "cinder-58721164-3bd3-4f5c-9725-3a481058567a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:39:32 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d5977bbc-9a35-41a1-a439-012427b51677 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Acquiring lock "cinder-quobyte-58721164-3bd3-4f5c-9725-3a481058567a" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:39:32 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d5977bbc-9a35-41a1-a439-012427b51677 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "cinder-quobyte-58721164-3bd3-4f5c-9725-3a481058567a" acquired by "delete_volume" :: waited 0.014s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:39:32 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08055c9-6812-4641-8e4f-4e925339b73a]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:39:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d5977bbc-9a35-41a1-a439-012427b51677 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-58721164-3bd3-4f5c-9725-3a481058567a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:32 devstack sudo[105127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-58721164-3bd3-4f5c-9725-3a481058567a Jul 07 17:39:32 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:33 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d5977bbc-9a35-41a1-a439-012427b51677 tempest-CreateVolumesFromSnapshotTest-1668345459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-58721164-3bd3-4f5c-9725-3a481058567a" returned: 0 in 0.750s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d5977bbc-9a35-41a1-a439-012427b51677 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-58721164-3bd3-4f5c-9725-3a481058567a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:33 devstack sudo[105132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-58721164-3bd3-4f5c-9725-3a481058567a Jul 07 17:39:33 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:34 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d5977bbc-9a35-41a1-a439-012427b51677 tempest-CreateVolumesFromSnapshotTest-1668345459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-58721164-3bd3-4f5c-9725-3a481058567a" returned: 0 in 0.655s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:34 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d5977bbc-9a35-41a1-a439-012427b51677 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "cinder-quobyte-58721164-3bd3-4f5c-9725-3a481058567a" released by "delete_volume" :: held 1.460s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:39:34 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-d5977bbc-9a35-41a1-a439-012427b51677 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Created reservations ['599f2cf7-126e-47a4-a577-d13f3413e883', '4418023c-216b-4318-9acb-c70d1546a2a5', '17c8f8eb-00b4-4548-9401-eb22a90582c8', '0ef27c8d-434c-4ad8-bff7-4a76e30bff70'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:39:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d5977bbc-9a35-41a1-a439-012427b51677 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d5977bbc-9a35-41a1-a439-012427b51677 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:34 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d5977bbc-9a35-41a1-a439-012427b51677 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:39:34 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d5977bbc-9a35-41a1-a439-012427b51677 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:39:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d5977bbc-9a35-41a1-a439-012427b51677 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d5977bbc-9a35-41a1-a439-012427b51677 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:34 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:39:34 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:34 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d5977bbc-9a35-41a1-a439-012427b51677 tempest-CreateVolumesFromSnapshotTest-1668345459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.687s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:34 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-d5977bbc-9a35-41a1-a439-012427b51677 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:39:34 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-d5977bbc-9a35-41a1-a439-012427b51677 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Deleted volume successfully. Jul 07 17:39:35 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d5977bbc-9a35-41a1-a439-012427b51677 tempest-CreateVolumesFromSnapshotTest-1668345459 None] Lock "cinder-58721164-3bd3-4f5c-9725-3a481058567a-delete_volume" released by "delete_volume" :: held 2.360s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:39:37 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-c12c6aa6-9ba7-49f4-b1c3-a4680890082a tempest-VolumeDependencyTests-207758820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:39:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c12c6aa6-9ba7-49f4-b1c3-a4680890082a tempest-VolumeDependencyTests-207758820 None] Flow 'volume_create_manager' (2e8a87ed-ae76-47b0-a58c-093c1e442040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:39:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c12c6aa6-9ba7-49f4-b1c3-a4680890082a tempest-VolumeDependencyTests-207758820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aec2b203-5a88-4ba3-8409-9353791fefc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c12c6aa6-9ba7-49f4-b1c3-a4680890082a tempest-VolumeDependencyTests-207758820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aec2b203-5a88-4ba3-8409-9353791fefc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1500745875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=193c9f7c-bbdb-47ec-b13b-0faeade67c31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a65b54e31ec4c4992284cc996d73dfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:39:38Z,use_quota=True,user_id='2f582212b464425c9188a9cc3d5e94c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c12c6aa6-9ba7-49f4-b1c3-a4680890082a tempest-VolumeDependencyTests-207758820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fade56a5-215d-4ab6-94e9-b99c42e84421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c12c6aa6-9ba7-49f4-b1c3-a4680890082a tempest-VolumeDependencyTests-207758820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fade56a5-215d-4ab6-94e9-b99c42e84421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c12c6aa6-9ba7-49f4-b1c3-a4680890082a tempest-VolumeDependencyTests-207758820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fb09df3-dd5f-4af4-b490-d56a63e5adbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c12c6aa6-9ba7-49f4-b1c3-a4680890082a tempest-VolumeDependencyTests-207758820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fb09df3-dd5f-4af4-b490-d56a63e5adbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '193c9f7c-bbdb-47ec-b13b-0faeade67c31', 'volume_name': 'volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c12c6aa6-9ba7-49f4-b1c3-a4680890082a tempest-VolumeDependencyTests-207758820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f393f6db-06e6-4212-8096-c52844c70c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c12c6aa6-9ba7-49f4-b1c3-a4680890082a tempest-VolumeDependencyTests-207758820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f393f6db-06e6-4212-8096-c52844c70c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c12c6aa6-9ba7-49f4-b1c3-a4680890082a tempest-VolumeDependencyTests-207758820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d819597-734b-4516-a3ef-57f44fb21ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:37 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-c12c6aa6-9ba7-49f4-b1c3-a4680890082a tempest-VolumeDependencyTests-207758820 None] Volume 193c9f7c-bbdb-47ec-b13b-0faeade67c31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31', 'volume_size': 1} Jul 07 17:39:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c12c6aa6-9ba7-49f4-b1c3-a4680890082a tempest-VolumeDependencyTests-207758820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c12c6aa6-9ba7-49f4-b1c3-a4680890082a tempest-VolumeDependencyTests-207758820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:37 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c12c6aa6-9ba7-49f4-b1c3-a4680890082a tempest-VolumeDependencyTests-207758820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1500745875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=193c9f7c-bbdb-47ec-b13b-0faeade67c31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a65b54e31ec4c4992284cc996d73dfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:39:38Z,use_quota=True,user_id='2f582212b464425c9188a9cc3d5e94c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:39:37 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-c12c6aa6-9ba7-49f4-b1c3-a4680890082a tempest-VolumeDependencyTests-207758820 None] Creating volume 193c9f7c-bbdb-47ec-b13b-0faeade67c31 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:39:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c12c6aa6-9ba7-49f4-b1c3-a4680890082a tempest-VolumeDependencyTests-207758820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c12c6aa6-9ba7-49f4-b1c3-a4680890082a tempest-VolumeDependencyTests-207758820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:37 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c12c6aa6-9ba7-49f4-b1c3-a4680890082a tempest-VolumeDependencyTests-207758820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:39:37 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c12c6aa6-9ba7-49f4-b1c3-a4680890082a tempest-VolumeDependencyTests-207758820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:39:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c12c6aa6-9ba7-49f4-b1c3-a4680890082a tempest-VolumeDependencyTests-207758820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:37 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c12c6aa6-9ba7-49f4-b1c3-a4680890082a tempest-VolumeDependencyTests-207758820 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:39:37 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-c12c6aa6-9ba7-49f4-b1c3-a4680890082a tempest-VolumeDependencyTests-207758820 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:39:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c12c6aa6-9ba7-49f4-b1c3-a4680890082a tempest-VolumeDependencyTests-207758820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:37 devstack sudo[105138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31 1073741824 Jul 07 17:39:37 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:38 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c12c6aa6-9ba7-49f4-b1c3-a4680890082a tempest-VolumeDependencyTests-207758820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31 1073741824" returned: 0 in 0.830s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c12c6aa6-9ba7-49f4-b1c3-a4680890082a tempest-VolumeDependencyTests-207758820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:38 devstack sudo[105144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31 Jul 07 17:39:38 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:39 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c12c6aa6-9ba7-49f4-b1c3-a4680890082a tempest-VolumeDependencyTests-207758820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31" returned: 0 in 0.656s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:39 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c12c6aa6-9ba7-49f4-b1c3-a4680890082a tempest-VolumeDependencyTests-207758820 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:39:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c12c6aa6-9ba7-49f4-b1c3-a4680890082a tempest-VolumeDependencyTests-207758820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:39 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c12c6aa6-9ba7-49f4-b1c3-a4680890082a tempest-VolumeDependencyTests-207758820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d819597-734b-4516-a3ef-57f44fb21ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:39 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c12c6aa6-9ba7-49f4-b1c3-a4680890082a tempest-VolumeDependencyTests-207758820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc186df8-b138-435f-a081-59328d7f51c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:39 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-c12c6aa6-9ba7-49f4-b1c3-a4680890082a tempest-VolumeDependencyTests-207758820 None] Volume volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31 (193c9f7c-bbdb-47ec-b13b-0faeade67c31): created successfully Jul 07 17:39:39 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c12c6aa6-9ba7-49f4-b1c3-a4680890082a tempest-VolumeDependencyTests-207758820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc186df8-b138-435f-a081-59328d7f51c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:39 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c12c6aa6-9ba7-49f4-b1c3-a4680890082a tempest-VolumeDependencyTests-207758820 None] Flow 'volume_create_manager' (2e8a87ed-ae76-47b0-a58c-093c1e442040) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:39:39 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-c12c6aa6-9ba7-49f4-b1c3-a4680890082a tempest-VolumeDependencyTests-207758820 None] Created volume successfully. Jul 07 17:39:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-565d0d18-00d9-4c0c-8e72-e22be608c133 tempest-VolumeDependencyTests-207758820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-565d0d18-00d9-4c0c-8e72-e22be608c133 tempest-VolumeDependencyTests-207758820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:39 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-565d0d18-00d9-4c0c-8e72-e22be608c133 tempest-VolumeDependencyTests-207758820 None] Creating offline snapshot d17ceab0-6060-44b4-b715-2a3ef39e2644 of volume 193c9f7c-bbdb-47ec-b13b-0faeade67c31 {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:39:39 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[08bfa96d-f9ad-430e-8941-35d7c4d1fa42]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:39:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-565d0d18-00d9-4c0c-8e72-e22be608c133 tempest-VolumeDependencyTests-207758820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:40 devstack sudo[105147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31 Jul 07 17:39:40 devstack sudo[105147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:40 devstack sudo[105147]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-565d0d18-00d9-4c0c-8e72-e22be608c133 tempest-VolumeDependencyTests-207758820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31" returned: 0 in 0.829s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-565d0d18-00d9-4c0c-8e72-e22be608c133 tempest-VolumeDependencyTests-207758820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31.d17ceab0-6060-44b4-b715-2a3ef39e2644 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:40 devstack sudo[105153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31.d17ceab0-6060-44b4-b715-2a3ef39e2644 1G Jul 07 17:39:40 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:41 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-565d0d18-00d9-4c0c-8e72-e22be608c133 tempest-VolumeDependencyTests-207758820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31.d17ceab0-6060-44b4-b715-2a3ef39e2644 1G" returned: 0 in 0.861s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-565d0d18-00d9-4c0c-8e72-e22be608c133 tempest-VolumeDependencyTests-207758820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31.d17ceab0-6060-44b4-b715-2a3ef39e2644 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:41 devstack sudo[105159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31.d17ceab0-6060-44b4-b715-2a3ef39e2644 Jul 07 17:39:41 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:42 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-565d0d18-00d9-4c0c-8e72-e22be608c133 tempest-VolumeDependencyTests-207758820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31.d17ceab0-6060-44b4-b715-2a3ef39e2644" returned: 0 in 0.737s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:42 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-565d0d18-00d9-4c0c-8e72-e22be608c133 tempest-VolumeDependencyTests-207758820 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31.d17ceab0-6060-44b4-b715-2a3ef39e2644 is being set with open permissions: ugo+rw Jul 07 17:39:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-565d0d18-00d9-4c0c-8e72-e22be608c133 tempest-VolumeDependencyTests-207758820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31.d17ceab0-6060-44b4-b715-2a3ef39e2644 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:42 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31.d17ceab0-6060-44b4-b715-2a3ef39e2644 Jul 07 17:39:42 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:43 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-565d0d18-00d9-4c0c-8e72-e22be608c133 tempest-VolumeDependencyTests-207758820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31.d17ceab0-6060-44b4-b715-2a3ef39e2644" returned: 0 in 0.717s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-565d0d18-00d9-4c0c-8e72-e22be608c133 tempest-VolumeDependencyTests-207758820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:43 devstack sudo[105167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31.info Jul 07 17:39:43 devstack sudo[105167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:43 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:39:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:39:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:39:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:43 devstack sudo[105169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:39:43 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:43 devstack sudo[105167]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-565d0d18-00d9-4c0c-8e72-e22be608c133 tempest-VolumeDependencyTests-207758820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31.info" returned: 0 in 0.674s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:43 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-565d0d18-00d9-4c0c-8e72-e22be608c133 tempest-VolumeDependencyTests-207758820 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31.info is being set with open permissions: ugo+rw Jul 07 17:39:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-565d0d18-00d9-4c0c-8e72-e22be608c133 tempest-VolumeDependencyTests-207758820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:43 devstack sudo[105172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31.info Jul 07 17:39:43 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:44 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.769s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:44 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:39:44 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:39:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread count: 28 {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:39:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread info: [<_MainThread(MainThread, started 126077716062336)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:39:44 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-565d0d18-00d9-4c0c-8e72-e22be608c133 tempest-VolumeDependencyTests-207758820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31.info" returned: 0 in 0.725s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-565d0d18-00d9-4c0c-8e72-e22be608c133 tempest-VolumeDependencyTests-207758820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.639s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:44 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-565d0d18-00d9-4c0c-8e72-e22be608c133 tempest-VolumeDependencyTests-207758820 None] Create snapshot completed successfully Jul 07 17:39:45 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:39:45 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Flow 'volume_create_manager' (461f9888-be15-4ff8-a363-0ea55d8c4a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:39:45 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0a599d0-43ff-4c68-aeb4-a225f7a2fae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:45 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0a599d0-43ff-4c68-aeb4-a225f7a2fae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:39:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1782936149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=577a51bd-5e3b-436b-b557-a46fb5336bb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a65b54e31ec4c4992284cc996d73dfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:39:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d17ceab0-6060-44b4-b715-2a3ef39e2644,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:39:46Z,use_quota=True,user_id='2f582212b464425c9188a9cc3d5e94c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:45 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b8ca573-b75d-4d2d-8edb-a41df10ddc26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:45 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b8ca573-b75d-4d2d-8edb-a41df10ddc26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:45 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (927da985-1e14-4e31-9329-7f321741df18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:45 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (927da985-1e14-4e31-9329-7f321741df18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '577a51bd-5e3b-436b-b557-a46fb5336bb3', 'volume_name': 'volume-577a51bd-5e3b-436b-b557-a46fb5336bb3', 'volume_size': 1, 'snapshot_id': 'd17ceab0-6060-44b4-b715-2a3ef39e2644'}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:45 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42808ae6-1325-4d5e-8c14-458156a7bd10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:45 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42808ae6-1325-4d5e-8c14-458156a7bd10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:45 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06b5087b-f7f0-4e8c-a643-468113827c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:45 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Volume 577a51bd-5e3b-436b-b557-a46fb5336bb3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-577a51bd-5e3b-436b-b557-a46fb5336bb3', 'volume_size': 1, 'snapshot_id': 'd17ceab0-6060-44b4-b715-2a3ef39e2644'} Jul 07 17:39:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:45 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Acquiring lock "cinder-quobyte-d17ceab0-6060-44b4-b715-2a3ef39e2644-577a51bd-5e3b-436b-b557-a46fb5336bb3" by "_create_volume_from_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:39:45 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Lock "cinder-quobyte-d17ceab0-6060-44b4-b715-2a3ef39e2644-577a51bd-5e3b-436b-b557-a46fb5336bb3" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:39:45 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Creating volume 577a51bd-5e3b-436b-b557-a46fb5336bb3 from snapshot d17ceab0-6060-44b4-b715-2a3ef39e2644 {{(pid=87233) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 17:39:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:45 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:39:45 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:39:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:45 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:39:45 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Acquiring lock "cinder-quobyte-577a51bd-5e3b-436b-b557-a46fb5336bb3" by "_copy_volume_from_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:39:45 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Lock "cinder-quobyte-577a51bd-5e3b-436b-b557-a46fb5336bb3" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:39:45 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] snapshot: d17ceab0-6060-44b4-b715-2a3ef39e2644, volume: 577a51bd-5e3b-436b-b557-a46fb5336bb3, {{(pid=87233) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 17:39:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:45 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:39:45 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:39:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:45 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8efd15-63f2-4902-aec8-c9cdea3a9ca3]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:39:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31.d17ceab0-6060-44b4-b715-2a3ef39e2644 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:45 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31.d17ceab0-6060-44b4-b715-2a3ef39e2644 Jul 07 17:39:45 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:46 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31.d17ceab0-6060-44b4-b715-2a3ef39e2644" returned: 0 in 0.772s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:46 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:39:46 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] will copy from snapshot at /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31 {{(pid=87233) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 17:39:46 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Creating direct copy from snapshot {{(pid=87233) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 17:39:46 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[622c4e23-ea86-4dd4-ae51-1859e9d21b81]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:39:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:46 devstack sudo[105181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31 Jul 07 17:39:46 devstack sudo[105181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:47 devstack sudo[105181]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31" returned: 0 in 0.757s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:47 devstack cinder-volume[87233]: DEBUG cinder.utils [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Path /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-577a51bd-5e3b-436b-b557-a46fb5336bb3 not found in is_blk_device check {{(pid=87233) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 17:39:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-577a51bd-5e3b-436b-b557-a46fb5336bb3 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:47 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-577a51bd-5e3b-436b-b557-a46fb5336bb3 Jul 07 17:39:47 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:51 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-577a51bd-5e3b-436b-b557-a46fb5336bb3" returned: 0 in 4.554s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:52 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b05f82-05e5-48c1-93c3-0a079ac8cebe]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:39:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:52 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31 Jul 07 17:39:52 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:52 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31" returned: 0 in 0.951s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:52 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Image conversion details: src /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31, size 1024.00 MB, duration 4.56 sec, destination /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-577a51bd-5e3b-436b-b557-a46fb5336bb3 {{(pid=87233) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:39:52 devstack cinder-volume[87233]: INFO cinder.image.image_utils [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Converted 1024.00 MB image at 224.80 MB/s Jul 07 17:39:52 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-577a51bd-5e3b-436b-b557-a46fb5336bb3 is being set with open permissions: ugo+rw Jul 07 17:39:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-577a51bd-5e3b-436b-b557-a46fb5336bb3 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:52 devstack sudo[105207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-577a51bd-5e3b-436b-b557-a46fb5336bb3 Jul 07 17:39:52 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:53 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-577a51bd-5e3b-436b-b557-a46fb5336bb3" returned: 0 in 0.664s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:53 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Lock "cinder-quobyte-577a51bd-5e3b-436b-b557-a46fb5336bb3" released by "_copy_volume_from_snapshot" :: held 7.809s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:39:53 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Lock "cinder-quobyte-d17ceab0-6060-44b4-b715-2a3ef39e2644-577a51bd-5e3b-436b-b557-a46fb5336bb3" released by "_create_volume_from_snapshot" :: held 7.839s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:39:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.853s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06b5087b-f7f0-4e8c-a643-468113827c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-577a51bd-5e3b-436b-b557-a46fb5336bb3', 'volume_size': 1, 'snapshot_id': 'd17ceab0-6060-44b4-b715-2a3ef39e2644'}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90f2b07d-f6c8-450a-914e-def7ddea0bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:53 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Volume volume-577a51bd-5e3b-436b-b557-a46fb5336bb3 (577a51bd-5e3b-436b-b557-a46fb5336bb3): created successfully Jul 07 17:39:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90f2b07d-f6c8-450a-914e-def7ddea0bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Flow 'volume_create_manager' (461f9888-be15-4ff8-a363-0ea55d8c4a92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:39:53 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-43966927-e5a5-42f4-8b8a-7d0a37e0cbbc tempest-VolumeDependencyTests-207758820 None] Created volume successfully. Jul 07 17:39:54 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-f0e417d8-1a70-416d-99b5-a39d8deaf25c tempest-VolumeDependencyTests-207758820 None] Acquiring lock "cinder-d17ceab0-6060-44b4-b715-2a3ef39e2644-delete_snapshot" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:39:54 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-f0e417d8-1a70-416d-99b5-a39d8deaf25c tempest-VolumeDependencyTests-207758820 None] Lock "cinder-d17ceab0-6060-44b4-b715-2a3ef39e2644-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:39:54 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-f0e417d8-1a70-416d-99b5-a39d8deaf25c tempest-VolumeDependencyTests-207758820 None] Acquiring lock "cinder-quobyte-193c9f7c-bbdb-47ec-b13b-0faeade67c31" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:39:54 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-f0e417d8-1a70-416d-99b5-a39d8deaf25c tempest-VolumeDependencyTests-207758820 None] Lock "cinder-quobyte-193c9f7c-bbdb-47ec-b13b-0faeade67c31" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:39:54 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-f0e417d8-1a70-416d-99b5-a39d8deaf25c tempest-VolumeDependencyTests-207758820 None] Acquiring lock "cinder-quobyte-d17ceab0-6060-44b4-b715-2a3ef39e2644" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:39:54 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-f0e417d8-1a70-416d-99b5-a39d8deaf25c tempest-VolumeDependencyTests-207758820 None] Lock "cinder-quobyte-d17ceab0-6060-44b4-b715-2a3ef39e2644" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:39:54 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-f0e417d8-1a70-416d-99b5-a39d8deaf25c tempest-VolumeDependencyTests-207758820 None] Deleting offline snapshot d17ceab0-6060-44b4-b715-2a3ef39e2644 of volume 193c9f7c-bbdb-47ec-b13b-0faeade67c31 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:39:54 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-f0e417d8-1a70-416d-99b5-a39d8deaf25c tempest-VolumeDependencyTests-207758820 None] snapshot_file for this snap is: volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31.d17ceab0-6060-44b4-b715-2a3ef39e2644 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:39:54 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16be342-3ddd-496a-92d5-42c0feed7450]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:39:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f0e417d8-1a70-416d-99b5-a39d8deaf25c tempest-VolumeDependencyTests-207758820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31.d17ceab0-6060-44b4-b715-2a3ef39e2644 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:54 devstack sudo[105210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31.d17ceab0-6060-44b4-b715-2a3ef39e2644 Jul 07 17:39:54 devstack sudo[105210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:55 devstack sudo[105210]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f0e417d8-1a70-416d-99b5-a39d8deaf25c tempest-VolumeDependencyTests-207758820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31.d17ceab0-6060-44b4-b715-2a3ef39e2644" returned: 0 in 0.750s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:55 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-f0e417d8-1a70-416d-99b5-a39d8deaf25c tempest-VolumeDependencyTests-207758820 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:39:55 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9c79e0-89ec-40e7-87f2-6f383fb14319]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:39:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f0e417d8-1a70-416d-99b5-a39d8deaf25c tempest-VolumeDependencyTests-207758820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:55 devstack sudo[105215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31 Jul 07 17:39:55 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:55 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f0e417d8-1a70-416d-99b5-a39d8deaf25c tempest-VolumeDependencyTests-207758820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31" returned: 0 in 0.747s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f0e417d8-1a70-416d-99b5-a39d8deaf25c tempest-VolumeDependencyTests-207758820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31.d17ceab0-6060-44b4-b715-2a3ef39e2644 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:55 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31.d17ceab0-6060-44b4-b715-2a3ef39e2644 Jul 07 17:39:55 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:56 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f0e417d8-1a70-416d-99b5-a39d8deaf25c tempest-VolumeDependencyTests-207758820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31.d17ceab0-6060-44b4-b715-2a3ef39e2644" returned: 0 in 0.762s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f0e417d8-1a70-416d-99b5-a39d8deaf25c tempest-VolumeDependencyTests-207758820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31.d17ceab0-6060-44b4-b715-2a3ef39e2644 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:56 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31.d17ceab0-6060-44b4-b715-2a3ef39e2644 Jul 07 17:39:56 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:57 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f0e417d8-1a70-416d-99b5-a39d8deaf25c tempest-VolumeDependencyTests-207758820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31.d17ceab0-6060-44b4-b715-2a3ef39e2644" returned: 0 in 0.669s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:57 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-f0e417d8-1a70-416d-99b5-a39d8deaf25c tempest-VolumeDependencyTests-207758820 None] Lock "cinder-quobyte-d17ceab0-6060-44b4-b715-2a3ef39e2644" released by "_delete_snapshot" :: held 3.020s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:39:57 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-f0e417d8-1a70-416d-99b5-a39d8deaf25c tempest-VolumeDependencyTests-207758820 None] Lock "cinder-quobyte-193c9f7c-bbdb-47ec-b13b-0faeade67c31" released by "delete_snapshot" :: held 3.044s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:39:57 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-f0e417d8-1a70-416d-99b5-a39d8deaf25c tempest-VolumeDependencyTests-207758820 None] Created reservations ['3c9dbeda-aeb4-4f9c-b4a7-e0c87d4e9955', '8bab52cf-9c0d-460c-94e7-5fb8de285ff0', '92b8d41d-0480-4420-81a6-b53cf20f40ff', '7b7cdf12-a47f-4615-a470-89f56762cfa0'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:39:57 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-f0e417d8-1a70-416d-99b5-a39d8deaf25c tempest-VolumeDependencyTests-207758820 None] Delete snapshot completed successfully. Jul 07 17:39:57 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-f0e417d8-1a70-416d-99b5-a39d8deaf25c tempest-VolumeDependencyTests-207758820 None] Lock "cinder-d17ceab0-6060-44b4-b715-2a3ef39e2644-delete_snapshot" released by "delete_snapshot" :: held 3.201s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:39:58 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-18b3c62f-fb3b-4ff8-8a8a-c02b9e7d044b tempest-VolumeDependencyTests-207758820 None] Acquiring lock "cinder-193c9f7c-bbdb-47ec-b13b-0faeade67c31-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:39:58 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-18b3c62f-fb3b-4ff8-8a8a-c02b9e7d044b tempest-VolumeDependencyTests-207758820 None] Lock "cinder-193c9f7c-bbdb-47ec-b13b-0faeade67c31-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:39:58 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-18b3c62f-fb3b-4ff8-8a8a-c02b9e7d044b tempest-VolumeDependencyTests-207758820 None] Acquiring lock "cinder-quobyte-193c9f7c-bbdb-47ec-b13b-0faeade67c31" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:39:58 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-18b3c62f-fb3b-4ff8-8a8a-c02b9e7d044b tempest-VolumeDependencyTests-207758820 None] Lock "cinder-quobyte-193c9f7c-bbdb-47ec-b13b-0faeade67c31" acquired by "delete_volume" :: waited 0.018s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:39:58 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4005dab3-d733-4e06-9f86-29a7323962d5]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:39:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-18b3c62f-fb3b-4ff8-8a8a-c02b9e7d044b tempest-VolumeDependencyTests-207758820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:58 devstack sudo[105230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31 Jul 07 17:39:58 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:59 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-18b3c62f-fb3b-4ff8-8a8a-c02b9e7d044b tempest-VolumeDependencyTests-207758820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31" returned: 0 in 0.725s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-18b3c62f-fb3b-4ff8-8a8a-c02b9e7d044b tempest-VolumeDependencyTests-207758820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:59 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31 Jul 07 17:39:59 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:00 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-18b3c62f-fb3b-4ff8-8a8a-c02b9e7d044b tempest-VolumeDependencyTests-207758820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-193c9f7c-bbdb-47ec-b13b-0faeade67c31" returned: 0 in 0.616s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:00 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-18b3c62f-fb3b-4ff8-8a8a-c02b9e7d044b tempest-VolumeDependencyTests-207758820 None] Lock "cinder-quobyte-193c9f7c-bbdb-47ec-b13b-0faeade67c31" released by "delete_volume" :: held 1.397s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:40:00 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-18b3c62f-fb3b-4ff8-8a8a-c02b9e7d044b tempest-VolumeDependencyTests-207758820 None] Created reservations ['a59292c9-3f20-42df-bc05-e53171c35ac7', '0708022f-627b-4b8c-9cc1-6a10e349c800', '93c39546-f93a-4559-998b-a1af75332e92', '60a58ebf-715a-45d0-8ec3-faff74ba1f14'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:40:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-18b3c62f-fb3b-4ff8-8a8a-c02b9e7d044b tempest-VolumeDependencyTests-207758820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:40:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-18b3c62f-fb3b-4ff8-8a8a-c02b9e7d044b tempest-VolumeDependencyTests-207758820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:40:00 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-18b3c62f-fb3b-4ff8-8a8a-c02b9e7d044b tempest-VolumeDependencyTests-207758820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:40:00 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-18b3c62f-fb3b-4ff8-8a8a-c02b9e7d044b tempest-VolumeDependencyTests-207758820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:40:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-18b3c62f-fb3b-4ff8-8a8a-c02b9e7d044b tempest-VolumeDependencyTests-207758820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:40:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-18b3c62f-fb3b-4ff8-8a8a-c02b9e7d044b tempest-VolumeDependencyTests-207758820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:00 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:40:00 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:00 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-18b3c62f-fb3b-4ff8-8a8a-c02b9e7d044b tempest-VolumeDependencyTests-207758820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.598s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:00 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-18b3c62f-fb3b-4ff8-8a8a-c02b9e7d044b tempest-VolumeDependencyTests-207758820 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:40:00 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-18b3c62f-fb3b-4ff8-8a8a-c02b9e7d044b tempest-VolumeDependencyTests-207758820 None] Deleted volume successfully. Jul 07 17:40:00 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-18b3c62f-fb3b-4ff8-8a8a-c02b9e7d044b tempest-VolumeDependencyTests-207758820 None] Lock "cinder-193c9f7c-bbdb-47ec-b13b-0faeade67c31-delete_volume" released by "delete_volume" :: held 2.187s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:40:00 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-654def06-f9b6-4f6f-a3e1-dd94c72d35c6 tempest-VolumeDependencyTests-207758820 None] Acquiring lock "cinder-577a51bd-5e3b-436b-b557-a46fb5336bb3-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:40:00 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-654def06-f9b6-4f6f-a3e1-dd94c72d35c6 tempest-VolumeDependencyTests-207758820 None] Lock "cinder-577a51bd-5e3b-436b-b557-a46fb5336bb3-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:40:00 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-654def06-f9b6-4f6f-a3e1-dd94c72d35c6 tempest-VolumeDependencyTests-207758820 None] Acquiring lock "cinder-quobyte-577a51bd-5e3b-436b-b557-a46fb5336bb3" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:40:00 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-654def06-f9b6-4f6f-a3e1-dd94c72d35c6 tempest-VolumeDependencyTests-207758820 None] Lock "cinder-quobyte-577a51bd-5e3b-436b-b557-a46fb5336bb3" acquired by "delete_volume" :: waited 0.015s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:40:00 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4272e959-aa64-451c-a36a-4cec0a44bbdd]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:40:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-654def06-f9b6-4f6f-a3e1-dd94c72d35c6 tempest-VolumeDependencyTests-207758820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-577a51bd-5e3b-436b-b557-a46fb5336bb3 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:01 devstack sudo[105242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-577a51bd-5e3b-436b-b557-a46fb5336bb3 Jul 07 17:40:01 devstack sudo[105242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:01 devstack sudo[105242]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-654def06-f9b6-4f6f-a3e1-dd94c72d35c6 tempest-VolumeDependencyTests-207758820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-577a51bd-5e3b-436b-b557-a46fb5336bb3" returned: 0 in 0.787s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-654def06-f9b6-4f6f-a3e1-dd94c72d35c6 tempest-VolumeDependencyTests-207758820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-577a51bd-5e3b-436b-b557-a46fb5336bb3 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:01 devstack sudo[105248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-577a51bd-5e3b-436b-b557-a46fb5336bb3 Jul 07 17:40:01 devstack sudo[105248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:02 devstack sudo[105248]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-654def06-f9b6-4f6f-a3e1-dd94c72d35c6 tempest-VolumeDependencyTests-207758820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-577a51bd-5e3b-436b-b557-a46fb5336bb3" returned: 0 in 0.730s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:02 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-654def06-f9b6-4f6f-a3e1-dd94c72d35c6 tempest-VolumeDependencyTests-207758820 None] Lock "cinder-quobyte-577a51bd-5e3b-436b-b557-a46fb5336bb3" released by "delete_volume" :: held 1.558s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:40:02 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:UPDATE=92,cinder:SELECT=78,cinder:DELETE=10,cinder:INSERT=22 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:40:02 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-654def06-f9b6-4f6f-a3e1-dd94c72d35c6 tempest-VolumeDependencyTests-207758820 None] Created reservations ['fc8f4688-5cff-4e3b-a0c3-8eb128e633cc', '62f2ec09-c77d-4aa8-9ccd-a63a5f2cfac0', '929c8295-c73d-4e44-868a-3aa47899c926', '87e8bd2d-add1-472c-9a6c-fab23730f52d'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:40:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-654def06-f9b6-4f6f-a3e1-dd94c72d35c6 tempest-VolumeDependencyTests-207758820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:40:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-654def06-f9b6-4f6f-a3e1-dd94c72d35c6 tempest-VolumeDependencyTests-207758820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:40:02 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-654def06-f9b6-4f6f-a3e1-dd94c72d35c6 tempest-VolumeDependencyTests-207758820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:40:02 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-654def06-f9b6-4f6f-a3e1-dd94c72d35c6 tempest-VolumeDependencyTests-207758820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:40:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-654def06-f9b6-4f6f-a3e1-dd94c72d35c6 tempest-VolumeDependencyTests-207758820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:40:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-654def06-f9b6-4f6f-a3e1-dd94c72d35c6 tempest-VolumeDependencyTests-207758820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:02 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:40:02 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:03 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-654def06-f9b6-4f6f-a3e1-dd94c72d35c6 tempest-VolumeDependencyTests-207758820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.664s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:03 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-654def06-f9b6-4f6f-a3e1-dd94c72d35c6 tempest-VolumeDependencyTests-207758820 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:40:03 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-654def06-f9b6-4f6f-a3e1-dd94c72d35c6 tempest-VolumeDependencyTests-207758820 None] Deleted volume successfully. Jul 07 17:40:03 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-654def06-f9b6-4f6f-a3e1-dd94c72d35c6 tempest-VolumeDependencyTests-207758820 None] Lock "cinder-577a51bd-5e3b-436b-b557-a46fb5336bb3-delete_volume" released by "delete_volume" :: held 2.451s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:40:07 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:40:08 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Flow 'volume_create_manager' (b359701b-22c2-4b03-b910-fa66d23267b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:40:08 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b77e9f2b-f19d-4980-a9a2-e423e956b9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:08 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b77e9f2b-f19d-4980-a9a2-e423e956b9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c20818c-fac8-4088-a1c5-5e288e22b1c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='811e544bbbc040feb2862474f9f72184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:40:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:40:08Z,use_quota=True,user_id='0ed884384fce485d89eae7719bc61180',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:08 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e791773-3ff0-41e3-af15-32f65884022e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:08 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e791773-3ff0-41e3-af15-32f65884022e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:08 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df094c45-84a1-43b2-a1d1-808df1fdf35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:08 devstack cinder-volume[87233]: DEBUG cinder.image.glance [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Creating Keystone auth plugin from conf {{(pid=87233) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 17:40:08 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df094c45-84a1-43b2-a1d1-808df1fdf35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1c20818c-fac8-4088-a1c5-5e288e22b1c2', 'volume_name': 'volume-1c20818c-fac8-4088-a1c5-5e288e22b1c2', 'volume_size': 1, 'image_id': 'edcca8e1-af55-4cd1-992d-9e289a90c050', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/edcca8e1-af55-4cd1-992d-9e289a90c050', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '25ec37cef5200364eac140863686e704', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '811e544bbbc040feb2862474f9f72184', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2c166bd18b1b6f9a053c156b91e3052910e4a02916eb81cfa0e39b2163d15eec5ffc09dda7f6b3b22eaaaeba5e54868a65066eb33dab7544dcad493b7c975a89', 'id': 'edcca8e1-af55-4cd1-992d-9e289a90c050', 'created_at': datetime.datetime(2026, 7, 7, 15, 40, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 40, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/edcca8e1-af55-4cd1-992d-9e289a90c050/file', 'properties': {}}, 'image_service': }' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:08 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86d3300d-3d1c-4cc6-86d2-ef44bf566247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:08 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86d3300d-3d1c-4cc6-86d2-ef44bf566247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:08 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4e5a4d8-5079-4c31-bc15-13cbe0b6a91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:08 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Volume 1c20818c-fac8-4088-a1c5-5e288e22b1c2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1c20818c-fac8-4088-a1c5-5e288e22b1c2', 'volume_size': 1, 'image_id': 'edcca8e1-af55-4cd1-992d-9e289a90c050', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/edcca8e1-af55-4cd1-992d-9e289a90c050', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '25ec37cef5200364eac140863686e704', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '811e544bbbc040feb2862474f9f72184', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2c166bd18b1b6f9a053c156b91e3052910e4a02916eb81cfa0e39b2163d15eec5ffc09dda7f6b3b22eaaaeba5e54868a65066eb33dab7544dcad493b7c975a89', 'id': 'edcca8e1-af55-4cd1-992d-9e289a90c050', 'created_at': datetime.datetime(2026, 7, 7, 15, 40, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 40, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/edcca8e1-af55-4cd1-992d-9e289a90c050/file', 'properties': {}}, 'image_service': } Jul 07 17:40:08 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Trying to clone 1c20818c-fac8-4088-a1c5-5e288e22b1c2 from image edcca8e1-af55-4cd1-992d-9e289a90c050 at location (None, [{'url': 'file:///opt/stack/data/glance/images/edcca8e1-af55-4cd1-992d-9e289a90c050', 'metadata': {}}]). {{(pid=87233) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 17:40:08 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_edcca8e1-af55-4cd1-992d-9e289a90c050_tuahyuocdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87233) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 17:40:08 devstack cinder-volume[87233]: INFO cinder.image.image_utils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Image download 0.00 MB at 0.00 MB/s Jul 07 17:40:08 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f70623-3592-48dd-97d9-02fc78604d92]: (4, 'raw') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:40:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edcca8e1-af55-4cd1-992d-9e289a90c050_tuahyuocdevstack@QuobyteHD {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:08 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edcca8e1-af55-4cd1-992d-9e289a90c050_tuahyuocdevstack@QuobyteHD Jul 07 17:40:08 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:09 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edcca8e1-af55-4cd1-992d-9e289a90c050_tuahyuocdevstack@QuobyteHD" returned: 0 in 0.700s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edcca8e1-af55-4cd1-992d-9e289a90c050_tuahyuocdevstack@QuobyteHD {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:09 devstack sudo[105262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edcca8e1-af55-4cd1-992d-9e289a90c050_tuahyuocdevstack@QuobyteHD Jul 07 17:40:09 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:10 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edcca8e1-af55-4cd1-992d-9e289a90c050_tuahyuocdevstack@QuobyteHD" returned: 1 in 0.812s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edcca8e1-af55-4cd1-992d-9e289a90c050_tuahyuocdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:40:10 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Temporary image edcca8e1-af55-4cd1-992d-9e289a90c050 is fetched for user 0ed884384fce485d89eae7719bc61180. {{(pid=87233) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 17:40:10 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffc7e5a-a8ef-47ba-84dc-db9bf99228fb]: (4, 'raw') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:40:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edcca8e1-af55-4cd1-992d-9e289a90c050_tuahyuocdevstack@QuobyteHD {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:10 devstack sudo[105267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edcca8e1-af55-4cd1-992d-9e289a90c050_tuahyuocdevstack@QuobyteHD Jul 07 17:40:10 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:10 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edcca8e1-af55-4cd1-992d-9e289a90c050_tuahyuocdevstack@QuobyteHD" returned: 0 in 0.779s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edcca8e1-af55-4cd1-992d-9e289a90c050_tuahyuocdevstack@QuobyteHD {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:11 devstack sudo[105272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edcca8e1-af55-4cd1-992d-9e289a90c050_tuahyuocdevstack@QuobyteHD Jul 07 17:40:11 devstack sudo[105272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:11 devstack sudo[105272]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edcca8e1-af55-4cd1-992d-9e289a90c050_tuahyuocdevstack@QuobyteHD" returned: 1 in 0.724s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edcca8e1-af55-4cd1-992d-9e289a90c050_tuahyuocdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:40:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:40:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:40:11 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c20818c-fac8-4088-a1c5-5e288e22b1c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='811e544bbbc040feb2862474f9f72184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:40:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:40:08Z,use_quota=True,user_id='0ed884384fce485d89eae7719bc61180',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:40:11 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Creating volume 1c20818c-fac8-4088-a1c5-5e288e22b1c2 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:40:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:40:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:40:11 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:40:11 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:40:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:40:11 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:40:11 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:40:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1c20818c-fac8-4088-a1c5-5e288e22b1c2 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:11 devstack sudo[105277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1c20818c-fac8-4088-a1c5-5e288e22b1c2 1073741824 Jul 07 17:40:11 devstack sudo[105277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:12 devstack sudo[105277]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1c20818c-fac8-4088-a1c5-5e288e22b1c2 1073741824" returned: 0 in 0.800s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1c20818c-fac8-4088-a1c5-5e288e22b1c2 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:12 devstack sudo[105283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1c20818c-fac8-4088-a1c5-5e288e22b1c2 Jul 07 17:40:12 devstack sudo[105283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:13 devstack sudo[105283]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1c20818c-fac8-4088-a1c5-5e288e22b1c2" returned: 0 in 0.636s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:13 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] <== create_volume: return (1473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:40:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:40:13 devstack cinder-volume[87233]: DEBUG cinder.volume.volume_utils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Attempting download of edcca8e1-af55-4cd1-992d-9e289a90c050 ((None, [{'url': 'file:///opt/stack/data/glance/images/edcca8e1-af55-4cd1-992d-9e289a90c050', 'metadata': {}}])) to volume 1c20818c-fac8-4088-a1c5-5e288e22b1c2. {{(pid=87233) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 17:40:13 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcb1ebf-44eb-4060-a1da-f84f44fd8aed]: (4, 'raw') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:40:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_edcca8e1-af55-4cd1-992d-9e289a90c050_kwvdgl_s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:13 devstack sudo[105286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_edcca8e1-af55-4cd1-992d-9e289a90c050_kwvdgl_s Jul 07 17:40:13 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:13 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_edcca8e1-af55-4cd1-992d-9e289a90c050_kwvdgl_s" returned: 0 in 0.722s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edcca8e1-af55-4cd1-992d-9e289a90c050_kwvdgl_s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:14 devstack sudo[105290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edcca8e1-af55-4cd1-992d-9e289a90c050_kwvdgl_s Jul 07 17:40:14 devstack sudo[105290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:14 devstack sudo[105290]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edcca8e1-af55-4cd1-992d-9e289a90c050_kwvdgl_s" returned: 1 in 0.695s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edcca8e1-af55-4cd1-992d-9e289a90c050_kwvdgl_s' failed. Not Retrying. {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:40:14 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[413b341e-877f-4904-a9aa-2eb6af600848]: (4, 'raw') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:40:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edcca8e1-af55-4cd1-992d-9e289a90c050_tuahyuocdevstack@QuobyteHD {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:14 devstack sudo[105294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edcca8e1-af55-4cd1-992d-9e289a90c050_tuahyuocdevstack@QuobyteHD Jul 07 17:40:14 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:15 devstack sudo[105294]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edcca8e1-af55-4cd1-992d-9e289a90c050_tuahyuocdevstack@QuobyteHD" returned: 0 in 0.716s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edcca8e1-af55-4cd1-992d-9e289a90c050_tuahyuocdevstack@QuobyteHD {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:15 devstack sudo[105298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edcca8e1-af55-4cd1-992d-9e289a90c050_tuahyuocdevstack@QuobyteHD Jul 07 17:40:15 devstack sudo[105298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:16 devstack sudo[105298]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edcca8e1-af55-4cd1-992d-9e289a90c050_tuahyuocdevstack@QuobyteHD" returned: 1 in 0.675s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edcca8e1-af55-4cd1-992d-9e289a90c050_tuahyuocdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:40:16 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] edcca8e1-af55-4cd1-992d-9e289a90c050 was raw, converting to raw {{(pid=87233) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 17:40:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_edcca8e1-af55-4cd1-992d-9e289a90c050_tuahyuocdevstack@QuobyteHD /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1c20818c-fac8-4088-a1c5-5e288e22b1c2 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:16 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_edcca8e1-af55-4cd1-992d-9e289a90c050_tuahyuocdevstack@QuobyteHD /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1c20818c-fac8-4088-a1c5-5e288e22b1c2 Jul 07 17:40:16 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:16 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_edcca8e1-af55-4cd1-992d-9e289a90c050_tuahyuocdevstack@QuobyteHD /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1c20818c-fac8-4088-a1c5-5e288e22b1c2" returned: 0 in 0.702s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:16 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_edcca8e1-af55-4cd1-992d-9e289a90c050_tuahyuocdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1c20818c-fac8-4088-a1c5-5e288e22b1c2 {{(pid=87233) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:40:16 devstack cinder-volume[87233]: INFO cinder.image.image_utils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 17:40:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1c20818c-fac8-4088-a1c5-5e288e22b1c2 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:16 devstack sudo[105308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1c20818c-fac8-4088-a1c5-5e288e22b1c2 1G Jul 07 17:40:16 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:17 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1c20818c-fac8-4088-a1c5-5e288e22b1c2 1G" returned: 0 in 0.689s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:17 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[319bc71a-1493-4715-a208-5114edccc6f6]: (4, 'raw') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:40:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1c20818c-fac8-4088-a1c5-5e288e22b1c2 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:17 devstack sudo[105313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1c20818c-fac8-4088-a1c5-5e288e22b1c2 Jul 07 17:40:17 devstack sudo[105313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:18 devstack sudo[105313]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1c20818c-fac8-4088-a1c5-5e288e22b1c2" returned: 0 in 0.717s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1c20818c-fac8-4088-a1c5-5e288e22b1c2 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:18 devstack sudo[105317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1c20818c-fac8-4088-a1c5-5e288e22b1c2 Jul 07 17:40:18 devstack sudo[105317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:18 devstack sudo[105317]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1c20818c-fac8-4088-a1c5-5e288e22b1c2" returned: 1 in 0.716s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1c20818c-fac8-4088-a1c5-5e288e22b1c2' failed. Not Retrying. {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:40:18 devstack cinder-volume[87233]: DEBUG cinder.volume.volume_utils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Downloaded image edcca8e1-af55-4cd1-992d-9e289a90c050 ((None, [{'url': 'file:///opt/stack/data/glance/images/edcca8e1-af55-4cd1-992d-9e289a90c050', 'metadata': {}}])) to volume 1c20818c-fac8-4088-a1c5-5e288e22b1c2 successfully. {{(pid=87233) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 17:40:18 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Temporary image edcca8e1-af55-4cd1-992d-9e289a90c050 for user 0ed884384fce485d89eae7719bc61180 is deleted. {{(pid=87233) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 17:40:18 devstack cinder-volume[87233]: DEBUG cinder.volume.volume_utils [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Marking volume 1c20818c-fac8-4088-a1c5-5e288e22b1c2 as bootable. {{(pid=87233) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 17:40:18 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:SELECT=61,cinder:UPDATE=94,cinder:DELETE=4,cinder:INSERT=25 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:40:18 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Copying metadata from image edcca8e1-af55-4cd1-992d-9e289a90c050 to 1c20818c-fac8-4088-a1c5-5e288e22b1c2. {{(pid=87233) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 17:40:18 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Creating volume glance metadata for volume 1c20818c-fac8-4088-a1c5-5e288e22b1c2 backed by image edcca8e1-af55-4cd1-992d-9e289a90c050 with: {'image_id': 'edcca8e1-af55-4cd1-992d-9e289a90c050', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '25ec37cef5200364eac140863686e704', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87233) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 17:40:18 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4e5a4d8-5079-4c31-bc15-13cbe0b6a91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c20818c-fac8-4088-a1c5-5e288e22b1c2', 'volume_size': 1, 'image_id': 'edcca8e1-af55-4cd1-992d-9e289a90c050', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/edcca8e1-af55-4cd1-992d-9e289a90c050', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '25ec37cef5200364eac140863686e704', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '811e544bbbc040feb2862474f9f72184', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2c166bd18b1b6f9a053c156b91e3052910e4a02916eb81cfa0e39b2163d15eec5ffc09dda7f6b3b22eaaaeba5e54868a65066eb33dab7544dcad493b7c975a89', 'id': 'edcca8e1-af55-4cd1-992d-9e289a90c050', 'created_at': datetime.datetime(2026, 7, 7, 15, 40, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 40, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/edcca8e1-af55-4cd1-992d-9e289a90c050/file', 'properties': {}}, 'image_service': }' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:18 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f36153b9-2947-4674-bd64-eb4acc2dc1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:19 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Volume volume-1c20818c-fac8-4088-a1c5-5e288e22b1c2 (1c20818c-fac8-4088-a1c5-5e288e22b1c2): created successfully Jul 07 17:40:19 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f36153b9-2947-4674-bd64-eb4acc2dc1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:19 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Flow 'volume_create_manager' (b359701b-22c2-4b03-b910-fa66d23267b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:40:19 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-7c229b9d-9245-4292-8473-f79468bdf65f tempest-VolumeImageDependencyTests-400038055 None] Created volume successfully. Jul 07 17:40:19 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-f7e37e7d-226a-4c37-a05e-7d9b9f043a5d tempest-VolumeImageDependencyTests-400038055 None] Acquiring lock "cinder-1c20818c-fac8-4088-a1c5-5e288e22b1c2-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:40:19 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-f7e37e7d-226a-4c37-a05e-7d9b9f043a5d tempest-VolumeImageDependencyTests-400038055 None] Lock "cinder-1c20818c-fac8-4088-a1c5-5e288e22b1c2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:40:19 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-f7e37e7d-226a-4c37-a05e-7d9b9f043a5d tempest-VolumeImageDependencyTests-400038055 None] Acquiring lock "cinder-quobyte-1c20818c-fac8-4088-a1c5-5e288e22b1c2" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:40:19 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-f7e37e7d-226a-4c37-a05e-7d9b9f043a5d tempest-VolumeImageDependencyTests-400038055 None] Lock "cinder-quobyte-1c20818c-fac8-4088-a1c5-5e288e22b1c2" acquired by "delete_volume" :: waited 0.015s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:40:19 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[299ddf1f-6680-48ae-a6fc-e115dbf40986]: (4, 'raw') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:40:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f7e37e7d-226a-4c37-a05e-7d9b9f043a5d tempest-VolumeImageDependencyTests-400038055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1c20818c-fac8-4088-a1c5-5e288e22b1c2 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:19 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1c20818c-fac8-4088-a1c5-5e288e22b1c2 Jul 07 17:40:19 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:20 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f7e37e7d-226a-4c37-a05e-7d9b9f043a5d tempest-VolumeImageDependencyTests-400038055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1c20818c-fac8-4088-a1c5-5e288e22b1c2" returned: 0 in 0.728s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f7e37e7d-226a-4c37-a05e-7d9b9f043a5d tempest-VolumeImageDependencyTests-400038055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1c20818c-fac8-4088-a1c5-5e288e22b1c2 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:20 devstack sudo[105362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1c20818c-fac8-4088-a1c5-5e288e22b1c2 Jul 07 17:40:20 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:21 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f7e37e7d-226a-4c37-a05e-7d9b9f043a5d tempest-VolumeImageDependencyTests-400038055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1c20818c-fac8-4088-a1c5-5e288e22b1c2" returned: 1 in 0.764s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f7e37e7d-226a-4c37-a05e-7d9b9f043a5d tempest-VolumeImageDependencyTests-400038055 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1c20818c-fac8-4088-a1c5-5e288e22b1c2' failed. Not Retrying. {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:40:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f7e37e7d-226a-4c37-a05e-7d9b9f043a5d tempest-VolumeImageDependencyTests-400038055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1c20818c-fac8-4088-a1c5-5e288e22b1c2 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:21 devstack sudo[105369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1c20818c-fac8-4088-a1c5-5e288e22b1c2 Jul 07 17:40:21 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:21 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f7e37e7d-226a-4c37-a05e-7d9b9f043a5d tempest-VolumeImageDependencyTests-400038055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-1c20818c-fac8-4088-a1c5-5e288e22b1c2" returned: 0 in 0.628s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:21 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-f7e37e7d-226a-4c37-a05e-7d9b9f043a5d tempest-VolumeImageDependencyTests-400038055 None] Lock "cinder-quobyte-1c20818c-fac8-4088-a1c5-5e288e22b1c2" released by "delete_volume" :: held 2.178s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:40:21 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-f7e37e7d-226a-4c37-a05e-7d9b9f043a5d tempest-VolumeImageDependencyTests-400038055 None] Created reservations ['1a8b6b0e-196c-43ff-9019-f47e4ff2004d', '6356ff5e-c4d5-4cd0-af75-6a8cfefae7c1', 'f88e656b-4946-476c-b695-21b3f27f3d61', 'b67f0923-f3aa-4da0-b4c8-1d8789d07626'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:40:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f7e37e7d-226a-4c37-a05e-7d9b9f043a5d tempest-VolumeImageDependencyTests-400038055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:40:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f7e37e7d-226a-4c37-a05e-7d9b9f043a5d tempest-VolumeImageDependencyTests-400038055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:40:22 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-f7e37e7d-226a-4c37-a05e-7d9b9f043a5d tempest-VolumeImageDependencyTests-400038055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:40:22 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-f7e37e7d-226a-4c37-a05e-7d9b9f043a5d tempest-VolumeImageDependencyTests-400038055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:40:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f7e37e7d-226a-4c37-a05e-7d9b9f043a5d tempest-VolumeImageDependencyTests-400038055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:40:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f7e37e7d-226a-4c37-a05e-7d9b9f043a5d tempest-VolumeImageDependencyTests-400038055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:22 devstack sudo[105375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:40:22 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:22 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f7e37e7d-226a-4c37-a05e-7d9b9f043a5d tempest-VolumeImageDependencyTests-400038055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.644s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:22 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-f7e37e7d-226a-4c37-a05e-7d9b9f043a5d tempest-VolumeImageDependencyTests-400038055 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:40:22 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-f7e37e7d-226a-4c37-a05e-7d9b9f043a5d tempest-VolumeImageDependencyTests-400038055 None] Deleted volume successfully. Jul 07 17:40:22 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-f7e37e7d-226a-4c37-a05e-7d9b9f043a5d tempest-VolumeImageDependencyTests-400038055 None] Lock "cinder-1c20818c-fac8-4088-a1c5-5e288e22b1c2-delete_volume" released by "delete_volume" :: held 3.048s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:40:31 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:SELECT=7,cinder:INSERT=6,cinder:UPDATE=12 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:40:32 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:INSERT=8,cinder:UPDATE=16,cinder:SELECT=15,cinder:DELETE=3 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:40:43 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:40:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:40:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:40:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:40:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:40:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:40:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:43 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:40:43 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:44 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.675s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:44 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:40:44 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:40:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread count: 28 {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:40:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread info: [<_MainThread(MainThread, started 126077716062336)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:40:47 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a0f64da-1161-49d7-a827-73a0a89d48fd tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:40:47 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7a0f64da-1161-49d7-a827-73a0a89d48fd tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Flow 'volume_create_manager' (4fa4b864-eec0-4d81-9337-55c19f009bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:40:47 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7a0f64da-1161-49d7-a827-73a0a89d48fd tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55e90731-a567-420d-8094-853c199eb8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:47 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7a0f64da-1161-49d7-a827-73a0a89d48fd tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55e90731-a567-420d-8094-853c199eb8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:40:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1286239585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bde11ef-8472-4f9f-a0d0-e757f3cd1b24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605c0f265ade47c8b5245607160063ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:40:47Z,use_quota=True,user_id='676440cfabd7478e8fe942fc6f36889f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:47 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7a0f64da-1161-49d7-a827-73a0a89d48fd tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (412ecf13-2f82-4a2c-9961-58150bdfa434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:47 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7a0f64da-1161-49d7-a827-73a0a89d48fd tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (412ecf13-2f82-4a2c-9961-58150bdfa434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:47 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7a0f64da-1161-49d7-a827-73a0a89d48fd tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f5cb7e-0a84-4847-8504-efd4c9d0cc96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:47 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7a0f64da-1161-49d7-a827-73a0a89d48fd tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f5cb7e-0a84-4847-8504-efd4c9d0cc96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bde11ef-8472-4f9f-a0d0-e757f3cd1b24', 'volume_name': 'volume-0bde11ef-8472-4f9f-a0d0-e757f3cd1b24', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:47 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7a0f64da-1161-49d7-a827-73a0a89d48fd tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe55c6d4-6f57-42f2-b3ac-ce483b32286b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:47 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7a0f64da-1161-49d7-a827-73a0a89d48fd tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe55c6d4-6f57-42f2-b3ac-ce483b32286b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:47 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7a0f64da-1161-49d7-a827-73a0a89d48fd tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c0abb12-31d9-4c12-bf6f-277891f7cc4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:47 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-7a0f64da-1161-49d7-a827-73a0a89d48fd tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Volume 0bde11ef-8472-4f9f-a0d0-e757f3cd1b24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bde11ef-8472-4f9f-a0d0-e757f3cd1b24', 'volume_size': 1} Jul 07 17:40:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-7a0f64da-1161-49d7-a827-73a0a89d48fd tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:40:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-7a0f64da-1161-49d7-a827-73a0a89d48fd tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:40:47 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-7a0f64da-1161-49d7-a827-73a0a89d48fd tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:40:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1286239585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bde11ef-8472-4f9f-a0d0-e757f3cd1b24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605c0f265ade47c8b5245607160063ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:40:47Z,use_quota=True,user_id='676440cfabd7478e8fe942fc6f36889f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:40:47 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-7a0f64da-1161-49d7-a827-73a0a89d48fd tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Creating volume 0bde11ef-8472-4f9f-a0d0-e757f3cd1b24 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:40:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-7a0f64da-1161-49d7-a827-73a0a89d48fd tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:40:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-7a0f64da-1161-49d7-a827-73a0a89d48fd tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:40:47 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-7a0f64da-1161-49d7-a827-73a0a89d48fd tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:40:47 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-7a0f64da-1161-49d7-a827-73a0a89d48fd tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:40:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-7a0f64da-1161-49d7-a827-73a0a89d48fd tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:40:47 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-7a0f64da-1161-49d7-a827-73a0a89d48fd tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:40:47 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-7a0f64da-1161-49d7-a827-73a0a89d48fd tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:40:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7a0f64da-1161-49d7-a827-73a0a89d48fd tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0bde11ef-8472-4f9f-a0d0-e757f3cd1b24 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:47 devstack sudo[105424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0bde11ef-8472-4f9f-a0d0-e757f3cd1b24 1073741824 Jul 07 17:40:47 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:47 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1417a51-bad0-4f5c-a7ff-bcfa165b37aa tempest-CreateVolumesFromSnapshotTest-1739026630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:40:47 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d1417a51-bad0-4f5c-a7ff-bcfa165b37aa tempest-CreateVolumesFromSnapshotTest-1739026630 None] Flow 'volume_create_manager' (40168faa-dd56-42af-b3a2-89dff93e2e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:40:47 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d1417a51-bad0-4f5c-a7ff-bcfa165b37aa tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e2b2030-e500-4403-862a-ed405f949dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:47 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d1417a51-bad0-4f5c-a7ff-bcfa165b37aa tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e2b2030-e500-4403-862a-ed405f949dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:40:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-331773964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba78ad4c-332e-4680-98b6-cf29e7754a10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eb07bf8e6b149efb4f3bbea9a3719ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:40:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:40:48Z,use_quota=True,user_id='9a7839e972e54d85bdeae85e261da377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:47 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d1417a51-bad0-4f5c-a7ff-bcfa165b37aa tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a72b9c7-436f-43c7-8c30-595c57ccf553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:47 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d1417a51-bad0-4f5c-a7ff-bcfa165b37aa tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a72b9c7-436f-43c7-8c30-595c57ccf553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:47 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d1417a51-bad0-4f5c-a7ff-bcfa165b37aa tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15180263-60ef-494b-9573-c4785ad390b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:47 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d1417a51-bad0-4f5c-a7ff-bcfa165b37aa tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15180263-60ef-494b-9573-c4785ad390b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba78ad4c-332e-4680-98b6-cf29e7754a10', 'volume_name': 'volume-ba78ad4c-332e-4680-98b6-cf29e7754a10', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:47 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d1417a51-bad0-4f5c-a7ff-bcfa165b37aa tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f039af6e-c7c2-4152-ab4d-9ac84e11a9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:47 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d1417a51-bad0-4f5c-a7ff-bcfa165b37aa tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f039af6e-c7c2-4152-ab4d-9ac84e11a9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:48 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d1417a51-bad0-4f5c-a7ff-bcfa165b37aa tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04467290-4b42-416c-aef7-8448a1de763e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:48 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-d1417a51-bad0-4f5c-a7ff-bcfa165b37aa tempest-CreateVolumesFromSnapshotTest-1739026630 None] Volume ba78ad4c-332e-4680-98b6-cf29e7754a10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba78ad4c-332e-4680-98b6-cf29e7754a10', 'volume_size': 1} Jul 07 17:40:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d1417a51-bad0-4f5c-a7ff-bcfa165b37aa tempest-CreateVolumesFromSnapshotTest-1739026630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:40:48 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7a0f64da-1161-49d7-a827-73a0a89d48fd tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0bde11ef-8472-4f9f-a0d0-e757f3cd1b24 1073741824" returned: 0 in 1.106s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7a0f64da-1161-49d7-a827-73a0a89d48fd tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0bde11ef-8472-4f9f-a0d0-e757f3cd1b24 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:48 devstack sudo[105430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0bde11ef-8472-4f9f-a0d0-e757f3cd1b24 Jul 07 17:40:48 devstack sudo[105430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:48 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e8cd793-6370-4f75-ad62-b5350f96320e tempest-ProjectReaderTests-1245571501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:40:48 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-2e8cd793-6370-4f75-ad62-b5350f96320e tempest-ProjectReaderTests-1245571501 None] Flow 'volume_create_manager' (571ae03d-2236-4e79-89f0-b945dc181fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:40:48 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-2e8cd793-6370-4f75-ad62-b5350f96320e tempest-ProjectReaderTests-1245571501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1dc9a12-0d4f-44fd-9a14-747c409c6c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:48 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-2e8cd793-6370-4f75-ad62-b5350f96320e tempest-ProjectReaderTests-1245571501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1dc9a12-0d4f-44fd-9a14-747c409c6c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1988179716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86f4d3eb-819d-4050-bb62-fc1a352f2b2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddc1fcfe77d746d5bb2f587fe117cae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:40:49Z,use_quota=True,user_id='c1ed97ae9c0a4014b06b2648f855c484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:48 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-2e8cd793-6370-4f75-ad62-b5350f96320e tempest-ProjectReaderTests-1245571501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2e1ffd6-f1be-47af-9564-fabdb65e02a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:48 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-2e8cd793-6370-4f75-ad62-b5350f96320e tempest-ProjectReaderTests-1245571501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2e1ffd6-f1be-47af-9564-fabdb65e02a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:48 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-2e8cd793-6370-4f75-ad62-b5350f96320e tempest-ProjectReaderTests-1245571501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b632ad5f-afb2-4e87-b066-90dcee451a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:48 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-2e8cd793-6370-4f75-ad62-b5350f96320e tempest-ProjectReaderTests-1245571501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b632ad5f-afb2-4e87-b066-90dcee451a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86f4d3eb-819d-4050-bb62-fc1a352f2b2b', 'volume_name': 'volume-86f4d3eb-819d-4050-bb62-fc1a352f2b2b', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:48 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-2e8cd793-6370-4f75-ad62-b5350f96320e tempest-ProjectReaderTests-1245571501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ace45f88-ac4b-4114-99c0-9441c9bd63fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:48 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-2e8cd793-6370-4f75-ad62-b5350f96320e tempest-ProjectReaderTests-1245571501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ace45f88-ac4b-4114-99c0-9441c9bd63fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:48 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-2e8cd793-6370-4f75-ad62-b5350f96320e tempest-ProjectReaderTests-1245571501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fdef4ad-9c1b-4b08-9276-c8b8ca0db462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:48 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-2e8cd793-6370-4f75-ad62-b5350f96320e tempest-ProjectReaderTests-1245571501 None] Volume 86f4d3eb-819d-4050-bb62-fc1a352f2b2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86f4d3eb-819d-4050-bb62-fc1a352f2b2b', 'volume_size': 1} Jul 07 17:40:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-2e8cd793-6370-4f75-ad62-b5350f96320e tempest-ProjectReaderTests-1245571501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:40:49 devstack sudo[105430]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7a0f64da-1161-49d7-a827-73a0a89d48fd tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0bde11ef-8472-4f9f-a0d0-e757f3cd1b24" returned: 0 in 0.762s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:49 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-7a0f64da-1161-49d7-a827-73a0a89d48fd tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] <== create_volume: return (1917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:40:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-7a0f64da-1161-49d7-a827-73a0a89d48fd tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.921s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:40:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d1417a51-bad0-4f5c-a7ff-bcfa165b37aa tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.436s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:40:49 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d1417a51-bad0-4f5c-a7ff-bcfa165b37aa tempest-CreateVolumesFromSnapshotTest-1739026630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:40:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-331773964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba78ad4c-332e-4680-98b6-cf29e7754a10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eb07bf8e6b149efb4f3bbea9a3719ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:40:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:40:48Z,use_quota=True,user_id='9a7839e972e54d85bdeae85e261da377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:40:49 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-d1417a51-bad0-4f5c-a7ff-bcfa165b37aa tempest-CreateVolumesFromSnapshotTest-1739026630 None] Creating volume ba78ad4c-332e-4680-98b6-cf29e7754a10 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:40:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d1417a51-bad0-4f5c-a7ff-bcfa165b37aa tempest-CreateVolumesFromSnapshotTest-1739026630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:40:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d1417a51-bad0-4f5c-a7ff-bcfa165b37aa tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:40:49 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d1417a51-bad0-4f5c-a7ff-bcfa165b37aa tempest-CreateVolumesFromSnapshotTest-1739026630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:40:49 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d1417a51-bad0-4f5c-a7ff-bcfa165b37aa tempest-CreateVolumesFromSnapshotTest-1739026630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:40:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d1417a51-bad0-4f5c-a7ff-bcfa165b37aa tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:40:49 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d1417a51-bad0-4f5c-a7ff-bcfa165b37aa tempest-CreateVolumesFromSnapshotTest-1739026630 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:40:49 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-d1417a51-bad0-4f5c-a7ff-bcfa165b37aa tempest-CreateVolumesFromSnapshotTest-1739026630 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:40:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d1417a51-bad0-4f5c-a7ff-bcfa165b37aa tempest-CreateVolumesFromSnapshotTest-1739026630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ba78ad4c-332e-4680-98b6-cf29e7754a10 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:49 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7a0f64da-1161-49d7-a827-73a0a89d48fd tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c0abb12-31d9-4c12-bf6f-277891f7cc4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bde11ef-8472-4f9f-a0d0-e757f3cd1b24', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:49 devstack sudo[105433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ba78ad4c-332e-4680-98b6-cf29e7754a10 1073741824 Jul 07 17:40:49 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:49 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7a0f64da-1161-49d7-a827-73a0a89d48fd tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c187a4f9-c6aa-4a44-b90c-4c6ba97721ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:49 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-7a0f64da-1161-49d7-a827-73a0a89d48fd tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Volume volume-0bde11ef-8472-4f9f-a0d0-e757f3cd1b24 (0bde11ef-8472-4f9f-a0d0-e757f3cd1b24): created successfully Jul 07 17:40:49 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7a0f64da-1161-49d7-a827-73a0a89d48fd tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c187a4f9-c6aa-4a44-b90c-4c6ba97721ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:49 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7a0f64da-1161-49d7-a827-73a0a89d48fd tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Flow 'volume_create_manager' (4fa4b864-eec0-4d81-9337-55c19f009bdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:40:49 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-7a0f64da-1161-49d7-a827-73a0a89d48fd tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Created volume successfully. Jul 07 17:40:50 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d1417a51-bad0-4f5c-a7ff-bcfa165b37aa tempest-CreateVolumesFromSnapshotTest-1739026630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ba78ad4c-332e-4680-98b6-cf29e7754a10 1073741824" returned: 0 in 0.946s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d1417a51-bad0-4f5c-a7ff-bcfa165b37aa tempest-CreateVolumesFromSnapshotTest-1739026630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ba78ad4c-332e-4680-98b6-cf29e7754a10 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:50 devstack sudo[105439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ba78ad4c-332e-4680-98b6-cf29e7754a10 Jul 07 17:40:50 devstack sudo[105439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:50 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ea3d888-a306-48da-8ab8-d594a3f4aca6 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:40:50 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-5ea3d888-a306-48da-8ab8-d594a3f4aca6 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Flow 'volume_create_manager' (a549bd54-06eb-415a-9062-ee1ff357af85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-5ea3d888-a306-48da-8ab8-d594a3f4aca6 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89158076-f48b-488a-8d93-124903acfdfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-5ea3d888-a306-48da-8ab8-d594a3f4aca6 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89158076-f48b-488a-8d93-124903acfdfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-204902459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0965ef52-ecaf-4413-aca2-a14d38167f6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605c0f265ade47c8b5245607160063ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:40:51Z,use_quota=True,user_id='676440cfabd7478e8fe942fc6f36889f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-5ea3d888-a306-48da-8ab8-d594a3f4aca6 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6c10af8-957c-4a68-a3be-7e609530bc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-5ea3d888-a306-48da-8ab8-d594a3f4aca6 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6c10af8-957c-4a68-a3be-7e609530bc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-5ea3d888-a306-48da-8ab8-d594a3f4aca6 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14892c39-d902-433e-ad25-0fae5ad98722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-5ea3d888-a306-48da-8ab8-d594a3f4aca6 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14892c39-d902-433e-ad25-0fae5ad98722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0965ef52-ecaf-4413-aca2-a14d38167f6d', 'volume_name': 'volume-0965ef52-ecaf-4413-aca2-a14d38167f6d', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-5ea3d888-a306-48da-8ab8-d594a3f4aca6 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aa2ea72-3b3f-41ba-86bd-8fe79baabbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-5ea3d888-a306-48da-8ab8-d594a3f4aca6 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aa2ea72-3b3f-41ba-86bd-8fe79baabbc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-5ea3d888-a306-48da-8ab8-d594a3f4aca6 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e3d812-b2e5-4c2a-ae8e-a7b40865eb22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:51 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-5ea3d888-a306-48da-8ab8-d594a3f4aca6 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Volume 0965ef52-ecaf-4413-aca2-a14d38167f6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0965ef52-ecaf-4413-aca2-a14d38167f6d', 'volume_size': 1} Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-5ea3d888-a306-48da-8ab8-d594a3f4aca6 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:40:51 devstack sudo[105439]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d1417a51-bad0-4f5c-a7ff-bcfa165b37aa tempest-CreateVolumesFromSnapshotTest-1739026630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ba78ad4c-332e-4680-98b6-cf29e7754a10" returned: 0 in 0.717s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d1417a51-bad0-4f5c-a7ff-bcfa165b37aa tempest-CreateVolumesFromSnapshotTest-1739026630 None] <== create_volume: return (1706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d1417a51-bad0-4f5c-a7ff-bcfa165b37aa tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.709s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-2e8cd793-6370-4f75-ad62-b5350f96320e tempest-ProjectReaderTests-1245571501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.304s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-2e8cd793-6370-4f75-ad62-b5350f96320e tempest-ProjectReaderTests-1245571501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1988179716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86f4d3eb-819d-4050-bb62-fc1a352f2b2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddc1fcfe77d746d5bb2f587fe117cae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:40:49Z,use_quota=True,user_id='c1ed97ae9c0a4014b06b2648f855c484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-2e8cd793-6370-4f75-ad62-b5350f96320e tempest-ProjectReaderTests-1245571501 None] Creating volume 86f4d3eb-819d-4050-bb62-fc1a352f2b2b {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-2e8cd793-6370-4f75-ad62-b5350f96320e tempest-ProjectReaderTests-1245571501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-2e8cd793-6370-4f75-ad62-b5350f96320e tempest-ProjectReaderTests-1245571501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-2e8cd793-6370-4f75-ad62-b5350f96320e tempest-ProjectReaderTests-1245571501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-2e8cd793-6370-4f75-ad62-b5350f96320e tempest-ProjectReaderTests-1245571501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-2e8cd793-6370-4f75-ad62-b5350f96320e tempest-ProjectReaderTests-1245571501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-2e8cd793-6370-4f75-ad62-b5350f96320e tempest-ProjectReaderTests-1245571501 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:40:51 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-2e8cd793-6370-4f75-ad62-b5350f96320e tempest-ProjectReaderTests-1245571501 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2e8cd793-6370-4f75-ad62-b5350f96320e tempest-ProjectReaderTests-1245571501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-86f4d3eb-819d-4050-bb62-fc1a352f2b2b 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:51 devstack sudo[105443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-86f4d3eb-819d-4050-bb62-fc1a352f2b2b 1073741824 Jul 07 17:40:51 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d1417a51-bad0-4f5c-a7ff-bcfa165b37aa tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04467290-4b42-416c-aef7-8448a1de763e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba78ad4c-332e-4680-98b6-cf29e7754a10', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d1417a51-bad0-4f5c-a7ff-bcfa165b37aa tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8aa2ae9-22cf-480a-bb6e-e08045987b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:51 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-d1417a51-bad0-4f5c-a7ff-bcfa165b37aa tempest-CreateVolumesFromSnapshotTest-1739026630 None] Volume volume-ba78ad4c-332e-4680-98b6-cf29e7754a10 (ba78ad4c-332e-4680-98b6-cf29e7754a10): created successfully Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d1417a51-bad0-4f5c-a7ff-bcfa165b37aa tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8aa2ae9-22cf-480a-bb6e-e08045987b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d1417a51-bad0-4f5c-a7ff-bcfa165b37aa tempest-CreateVolumesFromSnapshotTest-1739026630 None] Flow 'volume_create_manager' (40168faa-dd56-42af-b3a2-89dff93e2e03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:40:51 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-d1417a51-bad0-4f5c-a7ff-bcfa165b37aa tempest-CreateVolumesFromSnapshotTest-1739026630 None] Created volume successfully. Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-43cb2063-1661-491d-b682-bd4c3ba01788 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-43cb2063-1661-491d-b682-bd4c3ba01788 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Flow 'volume_create_manager' (efc987bf-95b9-45bd-97a7-e05472b38ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-43cb2063-1661-491d-b682-bd4c3ba01788 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (134b700b-1baa-44b3-8659-616448da8ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-43cb2063-1661-491d-b682-bd4c3ba01788 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (134b700b-1baa-44b3-8659-616448da8ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-425770224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f69959e-e985-4373-94ac-d83cf85b3deb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605c0f265ade47c8b5245607160063ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:40:51Z,use_quota=True,user_id='676440cfabd7478e8fe942fc6f36889f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-43cb2063-1661-491d-b682-bd4c3ba01788 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2eccd29-20ba-491f-8c15-650fab766907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-43cb2063-1661-491d-b682-bd4c3ba01788 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2eccd29-20ba-491f-8c15-650fab766907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-43cb2063-1661-491d-b682-bd4c3ba01788 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ca95a57-6316-4078-b079-e0c4572fda2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-43cb2063-1661-491d-b682-bd4c3ba01788 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ca95a57-6316-4078-b079-e0c4572fda2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f69959e-e985-4373-94ac-d83cf85b3deb', 'volume_name': 'volume-5f69959e-e985-4373-94ac-d83cf85b3deb', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-43cb2063-1661-491d-b682-bd4c3ba01788 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (777d73cc-ab5d-4eaf-9edf-4fae0107d080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-43cb2063-1661-491d-b682-bd4c3ba01788 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (777d73cc-ab5d-4eaf-9edf-4fae0107d080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-43cb2063-1661-491d-b682-bd4c3ba01788 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c404c64-b43f-40f2-a131-fa26e598303e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:51 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-43cb2063-1661-491d-b682-bd4c3ba01788 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Volume 5f69959e-e985-4373-94ac-d83cf85b3deb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f69959e-e985-4373-94ac-d83cf85b3deb', 'volume_size': 1} Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-43cb2063-1661-491d-b682-bd4c3ba01788 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-7df5e0ed-ed5f-482a-bc13-b5b73367bbde tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7df5e0ed-ed5f-482a-bc13-b5b73367bbde tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Flow 'volume_create_manager' (93ab609b-bf4a-46d4-807c-d7f49f869841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7df5e0ed-ed5f-482a-bc13-b5b73367bbde tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08c9fa86-cb3a-4027-a516-77607222b9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7df5e0ed-ed5f-482a-bc13-b5b73367bbde tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08c9fa86-cb3a-4027-a516-77607222b9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1494591288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=668ec4ee-5f44-4baa-822d-9d3213ff8a07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605c0f265ade47c8b5245607160063ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:40:52Z,use_quota=True,user_id='676440cfabd7478e8fe942fc6f36889f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7df5e0ed-ed5f-482a-bc13-b5b73367bbde tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8996277b-78b4-4bf6-a0ec-e66da5774004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7df5e0ed-ed5f-482a-bc13-b5b73367bbde tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8996277b-78b4-4bf6-a0ec-e66da5774004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7df5e0ed-ed5f-482a-bc13-b5b73367bbde tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a081f93-8126-4f6a-914d-396634967b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7df5e0ed-ed5f-482a-bc13-b5b73367bbde tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a081f93-8126-4f6a-914d-396634967b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '668ec4ee-5f44-4baa-822d-9d3213ff8a07', 'volume_name': 'volume-668ec4ee-5f44-4baa-822d-9d3213ff8a07', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7df5e0ed-ed5f-482a-bc13-b5b73367bbde tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cccd6c76-d30f-4561-834f-dd93d78c463e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7df5e0ed-ed5f-482a-bc13-b5b73367bbde tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cccd6c76-d30f-4561-834f-dd93d78c463e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7df5e0ed-ed5f-482a-bc13-b5b73367bbde tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f006f770-b88e-4922-90ec-4e15afac8b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:52 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-7df5e0ed-ed5f-482a-bc13-b5b73367bbde tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Volume 668ec4ee-5f44-4baa-822d-9d3213ff8a07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-668ec4ee-5f44-4baa-822d-9d3213ff8a07', 'volume_size': 1} Jul 07 17:40:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-7df5e0ed-ed5f-482a-bc13-b5b73367bbde tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:40:52 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:40:52 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Flow 'volume_create_manager' (062cec3a-3c84-43f2-8359-05a0f6ba020a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:40:52 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17344051-eedd-4c20-acb4-d0439041744b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:52 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17344051-eedd-4c20-acb4-d0439041744b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=497bb435-d98f-46e3-b69d-8fe7f3034317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92f0005d81ed403aab8ff9b077d12d34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:40:52Z,use_quota=True,user_id='0d4d09ebb0cd4cdfad7302f51da6c352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(87870dde-f2c8-4779-8bf7-dbf5ec926ccb),volume_type_id=87870dde-f2c8-4779-8bf7-dbf5ec926ccb)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:52 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4385938b-c2d4-4f2a-b328-137e79f9f438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:52 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4385938b-c2d4-4f2a-b328-137e79f9f438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:52 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6611c648-3c7c-4984-96b6-7f2627c582a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:52 devstack cinder-volume[87233]: DEBUG cinder.image.glance [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Creating Keystone auth plugin from conf {{(pid=87233) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 17:40:52 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2e8cd793-6370-4f75-ad62-b5350f96320e tempest-ProjectReaderTests-1245571501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-86f4d3eb-819d-4050-bb62-fc1a352f2b2b 1073741824" returned: 0 in 1.119s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2e8cd793-6370-4f75-ad62-b5350f96320e tempest-ProjectReaderTests-1245571501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-86f4d3eb-819d-4050-bb62-fc1a352f2b2b {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:52 devstack sudo[105450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-86f4d3eb-819d-4050-bb62-fc1a352f2b2b Jul 07 17:40:52 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:52 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-806fd23f-6fff-4814-afd8-47398227dbc7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:40:52 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-806fd23f-6fff-4814-afd8-47398227dbc7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Flow 'volume_create_manager' (d3a143a1-fb9b-403b-b3a1-a4ef9f5e0e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:40:52 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-806fd23f-6fff-4814-afd8-47398227dbc7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f66b67ac-4d59-47f2-896a-a5af53e65664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:52 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-806fd23f-6fff-4814-afd8-47398227dbc7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f66b67ac-4d59-47f2-896a-a5af53e65664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1674543177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4adacdc7-998d-4535-adcf-93a8418d8f0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605c0f265ade47c8b5245607160063ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:40:52Z,use_quota=True,user_id='676440cfabd7478e8fe942fc6f36889f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:52 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-806fd23f-6fff-4814-afd8-47398227dbc7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74c41ac8-4e59-4701-aad4-fd8526cb9dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:52 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-806fd23f-6fff-4814-afd8-47398227dbc7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74c41ac8-4e59-4701-aad4-fd8526cb9dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:52 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-806fd23f-6fff-4814-afd8-47398227dbc7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b73b1bb-4a58-4181-adda-b8535adabed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:52 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-806fd23f-6fff-4814-afd8-47398227dbc7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b73b1bb-4a58-4181-adda-b8535adabed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4adacdc7-998d-4535-adcf-93a8418d8f0a', 'volume_name': 'volume-4adacdc7-998d-4535-adcf-93a8418d8f0a', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:52 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-806fd23f-6fff-4814-afd8-47398227dbc7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc89e542-9952-43f7-82d0-0ed0b5de7f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:52 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-806fd23f-6fff-4814-afd8-47398227dbc7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc89e542-9952-43f7-82d0-0ed0b5de7f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:52 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-806fd23f-6fff-4814-afd8-47398227dbc7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d00a9008-e926-41bc-931a-09432042684c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:52 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-806fd23f-6fff-4814-afd8-47398227dbc7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Volume 4adacdc7-998d-4535-adcf-93a8418d8f0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4adacdc7-998d-4535-adcf-93a8418d8f0a', 'volume_size': 1} Jul 07 17:40:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-806fd23f-6fff-4814-afd8-47398227dbc7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:40:52 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6611c648-3c7c-4984-96b6-7f2627c582a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '497bb435-d98f-46e3-b69d-8fe7f3034317', 'volume_name': 'volume-497bb435-d98f-46e3-b69d-8fe7f3034317', 'volume_size': 1, 'image_id': 'ab465613-f341-4521-9231-bf956eeae707', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ab465613-f341-4521-9231-bf956eeae707', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4cbd7702e77ba4cadd5da1cd6223f3b3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '92f0005d81ed403aab8ff9b077d12d34', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '66152bd00a74217f37a6c518be28343ec1d35c4dc82f245d692c803a187647c0bbfdae1562a51b4197d10e7a0957c82780e56fa13cf462d6e833287d78f95139', 'id': 'ab465613-f341-4521-9231-bf956eeae707', 'created_at': datetime.datetime(2026, 7, 7, 15, 40, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 40, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ab465613-f341-4521-9231-bf956eeae707/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:52 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (664be5ee-2fa2-4fd5-b700-c4f1c4abacbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:52 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (664be5ee-2fa2-4fd5-b700-c4f1c4abacbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:52 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d107d1df-ae7a-4046-90c9-ffa7eac56076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:52 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Volume 497bb435-d98f-46e3-b69d-8fe7f3034317: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-497bb435-d98f-46e3-b69d-8fe7f3034317', 'volume_size': 1, 'image_id': 'ab465613-f341-4521-9231-bf956eeae707', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ab465613-f341-4521-9231-bf956eeae707', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4cbd7702e77ba4cadd5da1cd6223f3b3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '92f0005d81ed403aab8ff9b077d12d34', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '66152bd00a74217f37a6c518be28343ec1d35c4dc82f245d692c803a187647c0bbfdae1562a51b4197d10e7a0957c82780e56fa13cf462d6e833287d78f95139', 'id': 'ab465613-f341-4521-9231-bf956eeae707', 'created_at': datetime.datetime(2026, 7, 7, 15, 40, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 40, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ab465613-f341-4521-9231-bf956eeae707/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 07 17:40:52 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Trying to clone 497bb435-d98f-46e3-b69d-8fe7f3034317 from image ab465613-f341-4521-9231-bf956eeae707 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ab465613-f341-4521-9231-bf956eeae707', 'metadata': {}}]). {{(pid=87233) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 17:40:52 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ab465613-f341-4521-9231-bf956eeae707_6ybcl7jkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87233) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 17:40:52 devstack cinder-volume[87233]: INFO cinder.image.image_utils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Image download 0.00 MB at 0.00 MB/s Jul 07 17:40:52 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c585bf-19a9-4f92-9011-204e146c104e]: (4, 'raw') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:40:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab465613-f341-4521-9231-bf956eeae707_6ybcl7jkdevstack@QuobyteHD {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1ecf7d61-3bc2-49a8-b7bc-0e9f68a11d0a tempest-CreateVolumesFromSnapshotTest-1739026630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:40:52 devstack sudo[105452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab465613-f341-4521-9231-bf956eeae707_6ybcl7jkdevstack@QuobyteHD Jul 07 17:40:52 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:52 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-da653eae-d94c-4261-9dfb-8a4bf5ca09b7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:40:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-da653eae-d94c-4261-9dfb-8a4bf5ca09b7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Flow 'volume_create_manager' (f2ba7889-517d-49e0-bb43-3efacce45da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:40:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-da653eae-d94c-4261-9dfb-8a4bf5ca09b7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1b9f0a3-d805-4512-91ea-7790faf60927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-da653eae-d94c-4261-9dfb-8a4bf5ca09b7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1b9f0a3-d805-4512-91ea-7790faf60927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2102522604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cd95ced-a210-4590-aed1-2952ae6c8e86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605c0f265ade47c8b5245607160063ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:40:53Z,use_quota=True,user_id='676440cfabd7478e8fe942fc6f36889f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-da653eae-d94c-4261-9dfb-8a4bf5ca09b7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ec1f71f-19d0-43c3-b406-db8ca62d1034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-da653eae-d94c-4261-9dfb-8a4bf5ca09b7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ec1f71f-19d0-43c3-b406-db8ca62d1034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-da653eae-d94c-4261-9dfb-8a4bf5ca09b7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b23dd84a-32cf-4bd0-8ecf-6c03c1a8bf4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-da653eae-d94c-4261-9dfb-8a4bf5ca09b7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b23dd84a-32cf-4bd0-8ecf-6c03c1a8bf4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cd95ced-a210-4590-aed1-2952ae6c8e86', 'volume_name': 'volume-8cd95ced-a210-4590-aed1-2952ae6c8e86', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-da653eae-d94c-4261-9dfb-8a4bf5ca09b7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2bff162-4202-4e42-b661-61476b645ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-da653eae-d94c-4261-9dfb-8a4bf5ca09b7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2bff162-4202-4e42-b661-61476b645ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-da653eae-d94c-4261-9dfb-8a4bf5ca09b7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d8d1fa6-3fe2-48eb-a806-b26946868b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:53 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-da653eae-d94c-4261-9dfb-8a4bf5ca09b7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Volume 8cd95ced-a210-4590-aed1-2952ae6c8e86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cd95ced-a210-4590-aed1-2952ae6c8e86', 'volume_size': 1} Jul 07 17:40:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-da653eae-d94c-4261-9dfb-8a4bf5ca09b7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:40:53 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2e8cd793-6370-4f75-ad62-b5350f96320e tempest-ProjectReaderTests-1245571501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-86f4d3eb-819d-4050-bb62-fc1a352f2b2b" returned: 0 in 0.761s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:53 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-2e8cd793-6370-4f75-ad62-b5350f96320e tempest-ProjectReaderTests-1245571501 None] <== create_volume: return (2010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:40:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-2e8cd793-6370-4f75-ad62-b5350f96320e tempest-ProjectReaderTests-1245571501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.013s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:40:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-5ea3d888-a306-48da-8ab8-d594a3f4aca6 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.105s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:40:53 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-5ea3d888-a306-48da-8ab8-d594a3f4aca6 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-204902459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0965ef52-ecaf-4413-aca2-a14d38167f6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605c0f265ade47c8b5245607160063ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:40:51Z,use_quota=True,user_id='676440cfabd7478e8fe942fc6f36889f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:40:53 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-5ea3d888-a306-48da-8ab8-d594a3f4aca6 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Creating volume 0965ef52-ecaf-4413-aca2-a14d38167f6d {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:40:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-5ea3d888-a306-48da-8ab8-d594a3f4aca6 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:40:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-5ea3d888-a306-48da-8ab8-d594a3f4aca6 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:40:53 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-5ea3d888-a306-48da-8ab8-d594a3f4aca6 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:40:53 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-5ea3d888-a306-48da-8ab8-d594a3f4aca6 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:40:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-5ea3d888-a306-48da-8ab8-d594a3f4aca6 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:40:53 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-5ea3d888-a306-48da-8ab8-d594a3f4aca6 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:40:53 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-5ea3d888-a306-48da-8ab8-d594a3f4aca6 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:40:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5ea3d888-a306-48da-8ab8-d594a3f4aca6 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0965ef52-ecaf-4413-aca2-a14d38167f6d 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:53 devstack sudo[105456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0965ef52-ecaf-4413-aca2-a14d38167f6d 1073741824 Jul 07 17:40:53 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-2e8cd793-6370-4f75-ad62-b5350f96320e tempest-ProjectReaderTests-1245571501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fdef4ad-9c1b-4b08-9276-c8b8ca0db462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86f4d3eb-819d-4050-bb62-fc1a352f2b2b', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-2e8cd793-6370-4f75-ad62-b5350f96320e tempest-ProjectReaderTests-1245571501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3a282f8-1d13-4318-8825-bdd561870080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:53 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-2e8cd793-6370-4f75-ad62-b5350f96320e tempest-ProjectReaderTests-1245571501 None] Volume volume-86f4d3eb-819d-4050-bb62-fc1a352f2b2b (86f4d3eb-819d-4050-bb62-fc1a352f2b2b): created successfully Jul 07 17:40:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-2e8cd793-6370-4f75-ad62-b5350f96320e tempest-ProjectReaderTests-1245571501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3a282f8-1d13-4318-8825-bdd561870080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-2e8cd793-6370-4f75-ad62-b5350f96320e tempest-ProjectReaderTests-1245571501 None] Flow 'volume_create_manager' (571ae03d-2236-4e79-89f0-b945dc181fb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:40:53 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-2e8cd793-6370-4f75-ad62-b5350f96320e tempest-ProjectReaderTests-1245571501 None] Created volume successfully. Jul 07 17:40:53 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab465613-f341-4521-9231-bf956eeae707_6ybcl7jkdevstack@QuobyteHD" returned: 0 in 0.780s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab465613-f341-4521-9231-bf956eeae707_6ybcl7jkdevstack@QuobyteHD {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:53 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab465613-f341-4521-9231-bf956eeae707_6ybcl7jkdevstack@QuobyteHD Jul 07 17:40:53 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:54 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5ea3d888-a306-48da-8ab8-d594a3f4aca6 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0965ef52-ecaf-4413-aca2-a14d38167f6d 1073741824" returned: 0 in 0.834s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5ea3d888-a306-48da-8ab8-d594a3f4aca6 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0965ef52-ecaf-4413-aca2-a14d38167f6d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:54 devstack sudo[105466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0965ef52-ecaf-4413-aca2-a14d38167f6d Jul 07 17:40:54 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:54 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-4d2ea77f-2acc-42e3-9033-eb029b238393 tempest-ProjectReaderTests-1245571501 None] Acquiring lock "cinder-86f4d3eb-819d-4050-bb62-fc1a352f2b2b-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:40:54 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-4d2ea77f-2acc-42e3-9033-eb029b238393 tempest-ProjectReaderTests-1245571501 None] Lock "cinder-86f4d3eb-819d-4050-bb62-fc1a352f2b2b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:40:54 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-4d2ea77f-2acc-42e3-9033-eb029b238393 tempest-ProjectReaderTests-1245571501 None] Acquiring lock "cinder-quobyte-86f4d3eb-819d-4050-bb62-fc1a352f2b2b" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:40:54 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab465613-f341-4521-9231-bf956eeae707_6ybcl7jkdevstack@QuobyteHD" returned: 1 in 0.777s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab465613-f341-4521-9231-bf956eeae707_6ybcl7jkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:40:54 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Temporary image ab465613-f341-4521-9231-bf956eeae707 is fetched for user 0d4d09ebb0cd4cdfad7302f51da6c352. {{(pid=87233) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 17:40:54 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-4d2ea77f-2acc-42e3-9033-eb029b238393 tempest-ProjectReaderTests-1245571501 None] Lock "cinder-quobyte-86f4d3eb-819d-4050-bb62-fc1a352f2b2b" acquired by "delete_volume" :: waited 0.023s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:40:54 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef2363e-9933-473f-a218-27d541da2215]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:40:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4d2ea77f-2acc-42e3-9033-eb029b238393 tempest-ProjectReaderTests-1245571501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-86f4d3eb-819d-4050-bb62-fc1a352f2b2b {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:54 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c127e0-2012-40ad-a8a4-68d14c6a9cb5]: (4, 'raw') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:40:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab465613-f341-4521-9231-bf956eeae707_6ybcl7jkdevstack@QuobyteHD {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:54 devstack sudo[105471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-86f4d3eb-819d-4050-bb62-fc1a352f2b2b Jul 07 17:40:54 devstack sudo[105471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:54 devstack sudo[105472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab465613-f341-4521-9231-bf956eeae707_6ybcl7jkdevstack@QuobyteHD Jul 07 17:40:54 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:54 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5ea3d888-a306-48da-8ab8-d594a3f4aca6 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0965ef52-ecaf-4413-aca2-a14d38167f6d" returned: 0 in 0.742s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:54 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-5ea3d888-a306-48da-8ab8-d594a3f4aca6 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:40:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-5ea3d888-a306-48da-8ab8-d594a3f4aca6 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.641s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:40:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-43cb2063-1661-491d-b682-bd4c3ba01788 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.163s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:40:54 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-43cb2063-1661-491d-b682-bd4c3ba01788 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-425770224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f69959e-e985-4373-94ac-d83cf85b3deb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605c0f265ade47c8b5245607160063ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:40:51Z,use_quota=True,user_id='676440cfabd7478e8fe942fc6f36889f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:40:54 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-43cb2063-1661-491d-b682-bd4c3ba01788 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Creating volume 5f69959e-e985-4373-94ac-d83cf85b3deb {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:40:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-43cb2063-1661-491d-b682-bd4c3ba01788 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:40:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-43cb2063-1661-491d-b682-bd4c3ba01788 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:40:54 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-43cb2063-1661-491d-b682-bd4c3ba01788 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:40:54 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-43cb2063-1661-491d-b682-bd4c3ba01788 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:40:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-43cb2063-1661-491d-b682-bd4c3ba01788 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:40:54 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-43cb2063-1661-491d-b682-bd4c3ba01788 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:40:54 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-43cb2063-1661-491d-b682-bd4c3ba01788 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:40:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-43cb2063-1661-491d-b682-bd4c3ba01788 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5f69959e-e985-4373-94ac-d83cf85b3deb 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-5ea3d888-a306-48da-8ab8-d594a3f4aca6 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e3d812-b2e5-4c2a-ae8e-a7b40865eb22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0965ef52-ecaf-4413-aca2-a14d38167f6d', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-5ea3d888-a306-48da-8ab8-d594a3f4aca6 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71e306c6-eff4-4a8b-943b-ff46ffd4c9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:54 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5f69959e-e985-4373-94ac-d83cf85b3deb 1073741824 Jul 07 17:40:54 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:54 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-5ea3d888-a306-48da-8ab8-d594a3f4aca6 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Volume volume-0965ef52-ecaf-4413-aca2-a14d38167f6d (0965ef52-ecaf-4413-aca2-a14d38167f6d): created successfully Jul 07 17:40:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-5ea3d888-a306-48da-8ab8-d594a3f4aca6 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71e306c6-eff4-4a8b-943b-ff46ffd4c9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-5ea3d888-a306-48da-8ab8-d594a3f4aca6 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Flow 'volume_create_manager' (a549bd54-06eb-415a-9062-ee1ff357af85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:40:54 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-5ea3d888-a306-48da-8ab8-d594a3f4aca6 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Created volume successfully. Jul 07 17:40:55 devstack sudo[105471]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4d2ea77f-2acc-42e3-9033-eb029b238393 tempest-ProjectReaderTests-1245571501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-86f4d3eb-819d-4050-bb62-fc1a352f2b2b" returned: 0 in 0.806s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4d2ea77f-2acc-42e3-9033-eb029b238393 tempest-ProjectReaderTests-1245571501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-86f4d3eb-819d-4050-bb62-fc1a352f2b2b {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:55 devstack sudo[105483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-86f4d3eb-819d-4050-bb62-fc1a352f2b2b Jul 07 17:40:55 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:55 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab465613-f341-4521-9231-bf956eeae707_6ybcl7jkdevstack@QuobyteHD" returned: 0 in 0.802s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab465613-f341-4521-9231-bf956eeae707_6ybcl7jkdevstack@QuobyteHD {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:55 devstack sudo[105485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab465613-f341-4521-9231-bf956eeae707_6ybcl7jkdevstack@QuobyteHD Jul 07 17:40:55 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:55 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-43cb2063-1661-491d-b682-bd4c3ba01788 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5f69959e-e985-4373-94ac-d83cf85b3deb 1073741824" returned: 0 in 0.875s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-43cb2063-1661-491d-b682-bd4c3ba01788 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5f69959e-e985-4373-94ac-d83cf85b3deb {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:55 devstack sudo[105491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5f69959e-e985-4373-94ac-d83cf85b3deb Jul 07 17:40:55 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:55 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4d2ea77f-2acc-42e3-9033-eb029b238393 tempest-ProjectReaderTests-1245571501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-86f4d3eb-819d-4050-bb62-fc1a352f2b2b" returned: 0 in 0.674s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:55 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-4d2ea77f-2acc-42e3-9033-eb029b238393 tempest-ProjectReaderTests-1245571501 None] Lock "cinder-quobyte-86f4d3eb-819d-4050-bb62-fc1a352f2b2b" released by "delete_volume" :: held 1.544s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:40:55 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-4d2ea77f-2acc-42e3-9033-eb029b238393 tempest-ProjectReaderTests-1245571501 None] Created reservations ['774baf1c-bb98-4bab-935b-515d0f28a6cb', 'd29bf132-2e57-4fbf-afe3-03ed2e913b9e', 'b443d7b1-6116-4b1d-8447-53080cb72f5f', '59b84e81-8350-4f9f-9f97-144d7c89741a'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:40:56 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab465613-f341-4521-9231-bf956eeae707_6ybcl7jkdevstack@QuobyteHD" returned: 1 in 0.760s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab465613-f341-4521-9231-bf956eeae707_6ybcl7jkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:40:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:40:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4d2ea77f-2acc-42e3-9033-eb029b238393 tempest-ProjectReaderTests-1245571501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:40:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4d2ea77f-2acc-42e3-9033-eb029b238393 tempest-ProjectReaderTests-1245571501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:40:56 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-4d2ea77f-2acc-42e3-9033-eb029b238393 tempest-ProjectReaderTests-1245571501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:40:56 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-4d2ea77f-2acc-42e3-9033-eb029b238393 tempest-ProjectReaderTests-1245571501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:40:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4d2ea77f-2acc-42e3-9033-eb029b238393 tempest-ProjectReaderTests-1245571501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:40:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4d2ea77f-2acc-42e3-9033-eb029b238393 tempest-ProjectReaderTests-1245571501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:56 devstack sudo[105497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:40:56 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:56 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-43cb2063-1661-491d-b682-bd4c3ba01788 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5f69959e-e985-4373-94ac-d83cf85b3deb" returned: 0 in 0.680s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:56 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-43cb2063-1661-491d-b682-bd4c3ba01788 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:40:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-43cb2063-1661-491d-b682-bd4c3ba01788 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.613s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:40:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-7df5e0ed-ed5f-482a-bc13-b5b73367bbde tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.432s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:40:56 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-7df5e0ed-ed5f-482a-bc13-b5b73367bbde tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1494591288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=668ec4ee-5f44-4baa-822d-9d3213ff8a07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605c0f265ade47c8b5245607160063ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:40:52Z,use_quota=True,user_id='676440cfabd7478e8fe942fc6f36889f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:40:56 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-7df5e0ed-ed5f-482a-bc13-b5b73367bbde tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Creating volume 668ec4ee-5f44-4baa-822d-9d3213ff8a07 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:40:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-7df5e0ed-ed5f-482a-bc13-b5b73367bbde tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:40:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-7df5e0ed-ed5f-482a-bc13-b5b73367bbde tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:40:56 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-7df5e0ed-ed5f-482a-bc13-b5b73367bbde tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:40:56 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-7df5e0ed-ed5f-482a-bc13-b5b73367bbde tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:40:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-7df5e0ed-ed5f-482a-bc13-b5b73367bbde tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:40:56 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-7df5e0ed-ed5f-482a-bc13-b5b73367bbde tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:40:56 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-7df5e0ed-ed5f-482a-bc13-b5b73367bbde tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:40:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7df5e0ed-ed5f-482a-bc13-b5b73367bbde tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-668ec4ee-5f44-4baa-822d-9d3213ff8a07 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:56 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-668ec4ee-5f44-4baa-822d-9d3213ff8a07 1073741824 Jul 07 17:40:56 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:56 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-43cb2063-1661-491d-b682-bd4c3ba01788 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c404c64-b43f-40f2-a131-fa26e598303e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f69959e-e985-4373-94ac-d83cf85b3deb', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:56 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-43cb2063-1661-491d-b682-bd4c3ba01788 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78fac8c4-9a96-4b08-8797-f9fad1c77a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:56 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-43cb2063-1661-491d-b682-bd4c3ba01788 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Volume volume-5f69959e-e985-4373-94ac-d83cf85b3deb (5f69959e-e985-4373-94ac-d83cf85b3deb): created successfully Jul 07 17:40:56 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-43cb2063-1661-491d-b682-bd4c3ba01788 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78fac8c4-9a96-4b08-8797-f9fad1c77a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:56 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-43cb2063-1661-491d-b682-bd4c3ba01788 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Flow 'volume_create_manager' (efc987bf-95b9-45bd-97a7-e05472b38ca8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:40:56 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-43cb2063-1661-491d-b682-bd4c3ba01788 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Created volume successfully. Jul 07 17:40:56 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4d2ea77f-2acc-42e3-9033-eb029b238393 tempest-ProjectReaderTests-1245571501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.667s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:56 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-4d2ea77f-2acc-42e3-9033-eb029b238393 tempest-ProjectReaderTests-1245571501 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:40:56 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-4d2ea77f-2acc-42e3-9033-eb029b238393 tempest-ProjectReaderTests-1245571501 None] Deleted volume successfully. Jul 07 17:40:56 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-4d2ea77f-2acc-42e3-9033-eb029b238393 tempest-ProjectReaderTests-1245571501 None] Lock "cinder-86f4d3eb-819d-4050-bb62-fc1a352f2b2b-delete_volume" released by "delete_volume" :: held 2.488s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:40:57 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-4480c376-1b39-43e5-803b-b710b5be6a3e tempest-ProjectReaderTests-1245571501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:40:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4480c376-1b39-43e5-803b-b710b5be6a3e tempest-ProjectReaderTests-1245571501 None] Flow 'volume_create_manager' (0bc14a14-9201-401b-931a-df3fd1ce2fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:40:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4480c376-1b39-43e5-803b-b710b5be6a3e tempest-ProjectReaderTests-1245571501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fb2c3e9-fa91-4584-96b8-3ba83a36686b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4480c376-1b39-43e5-803b-b710b5be6a3e tempest-ProjectReaderTests-1245571501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fb2c3e9-fa91-4584-96b8-3ba83a36686b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1277469216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ec33a90-a3c6-4f4e-b9dd-bfc002e89ade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddc1fcfe77d746d5bb2f587fe117cae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:40:57Z,use_quota=True,user_id='c1ed97ae9c0a4014b06b2648f855c484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4480c376-1b39-43e5-803b-b710b5be6a3e tempest-ProjectReaderTests-1245571501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cff4f34-e617-4a61-91f8-714f186e48e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4480c376-1b39-43e5-803b-b710b5be6a3e tempest-ProjectReaderTests-1245571501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cff4f34-e617-4a61-91f8-714f186e48e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4480c376-1b39-43e5-803b-b710b5be6a3e tempest-ProjectReaderTests-1245571501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e11a5d35-8a7a-4eb3-95df-4c9e8d0174e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4480c376-1b39-43e5-803b-b710b5be6a3e tempest-ProjectReaderTests-1245571501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e11a5d35-8a7a-4eb3-95df-4c9e8d0174e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ec33a90-a3c6-4f4e-b9dd-bfc002e89ade', 'volume_name': 'volume-5ec33a90-a3c6-4f4e-b9dd-bfc002e89ade', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4480c376-1b39-43e5-803b-b710b5be6a3e tempest-ProjectReaderTests-1245571501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8af385f-880c-4111-bdfb-a176646da848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4480c376-1b39-43e5-803b-b710b5be6a3e tempest-ProjectReaderTests-1245571501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8af385f-880c-4111-bdfb-a176646da848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:57 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4480c376-1b39-43e5-803b-b710b5be6a3e tempest-ProjectReaderTests-1245571501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f68d006-6a9a-4654-a10f-c81076fc6492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:57 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-4480c376-1b39-43e5-803b-b710b5be6a3e tempest-ProjectReaderTests-1245571501 None] Volume 5ec33a90-a3c6-4f4e-b9dd-bfc002e89ade: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ec33a90-a3c6-4f4e-b9dd-bfc002e89ade', 'volume_size': 1} Jul 07 17:40:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4480c376-1b39-43e5-803b-b710b5be6a3e tempest-ProjectReaderTests-1245571501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:40:57 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7df5e0ed-ed5f-482a-bc13-b5b73367bbde tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-668ec4ee-5f44-4baa-822d-9d3213ff8a07 1073741824" returned: 0 in 0.877s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7df5e0ed-ed5f-482a-bc13-b5b73367bbde tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-668ec4ee-5f44-4baa-822d-9d3213ff8a07 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:57 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-668ec4ee-5f44-4baa-822d-9d3213ff8a07 Jul 07 17:40:57 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:57 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7df5e0ed-ed5f-482a-bc13-b5b73367bbde tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-668ec4ee-5f44-4baa-822d-9d3213ff8a07" returned: 0 in 0.614s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:57 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-7df5e0ed-ed5f-482a-bc13-b5b73367bbde tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:40:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-7df5e0ed-ed5f-482a-bc13-b5b73367bbde tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:40:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-806fd23f-6fff-4814-afd8-47398227dbc7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.359s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:40:57 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-806fd23f-6fff-4814-afd8-47398227dbc7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1674543177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4adacdc7-998d-4535-adcf-93a8418d8f0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605c0f265ade47c8b5245607160063ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:40:52Z,use_quota=True,user_id='676440cfabd7478e8fe942fc6f36889f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:40:57 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-806fd23f-6fff-4814-afd8-47398227dbc7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Creating volume 4adacdc7-998d-4535-adcf-93a8418d8f0a {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:40:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-806fd23f-6fff-4814-afd8-47398227dbc7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:40:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-806fd23f-6fff-4814-afd8-47398227dbc7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:40:57 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-806fd23f-6fff-4814-afd8-47398227dbc7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:40:57 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-806fd23f-6fff-4814-afd8-47398227dbc7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:40:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-806fd23f-6fff-4814-afd8-47398227dbc7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:40:57 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-806fd23f-6fff-4814-afd8-47398227dbc7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:40:57 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-806fd23f-6fff-4814-afd8-47398227dbc7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:40:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-806fd23f-6fff-4814-afd8-47398227dbc7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4adacdc7-998d-4535-adcf-93a8418d8f0a 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:58 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4adacdc7-998d-4535-adcf-93a8418d8f0a 1073741824 Jul 07 17:40:58 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7df5e0ed-ed5f-482a-bc13-b5b73367bbde tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f006f770-b88e-4922-90ec-4e15afac8b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-668ec4ee-5f44-4baa-822d-9d3213ff8a07', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7df5e0ed-ed5f-482a-bc13-b5b73367bbde tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f265e656-a693-472b-af06-111db023ee1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:58 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-7df5e0ed-ed5f-482a-bc13-b5b73367bbde tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Volume volume-668ec4ee-5f44-4baa-822d-9d3213ff8a07 (668ec4ee-5f44-4baa-822d-9d3213ff8a07): created successfully Jul 07 17:40:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7df5e0ed-ed5f-482a-bc13-b5b73367bbde tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f265e656-a693-472b-af06-111db023ee1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:58 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7df5e0ed-ed5f-482a-bc13-b5b73367bbde tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Flow 'volume_create_manager' (93ab609b-bf4a-46d4-807c-d7f49f869841) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:40:58 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-7df5e0ed-ed5f-482a-bc13-b5b73367bbde tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Created volume successfully. Jul 07 17:40:58 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-806fd23f-6fff-4814-afd8-47398227dbc7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4adacdc7-998d-4535-adcf-93a8418d8f0a 1073741824" returned: 0 in 0.803s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-806fd23f-6fff-4814-afd8-47398227dbc7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4adacdc7-998d-4535-adcf-93a8418d8f0a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:58 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4adacdc7-998d-4535-adcf-93a8418d8f0a Jul 07 17:40:58 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:59 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-806fd23f-6fff-4814-afd8-47398227dbc7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4adacdc7-998d-4535-adcf-93a8418d8f0a" returned: 0 in 0.636s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:59 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-806fd23f-6fff-4814-afd8-47398227dbc7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] <== create_volume: return (1480ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:40:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-806fd23f-6fff-4814-afd8-47398227dbc7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:40:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1ecf7d61-3bc2-49a8-b7bc-0e9f68a11d0a tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.512s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:40:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-806fd23f-6fff-4814-afd8-47398227dbc7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d00a9008-e926-41bc-931a-09432042684c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4adacdc7-998d-4535-adcf-93a8418d8f0a', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-806fd23f-6fff-4814-afd8-47398227dbc7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cff1d84-1729-447d-a94e-554cf436abfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:59 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-1ecf7d61-3bc2-49a8-b7bc-0e9f68a11d0a tempest-CreateVolumesFromSnapshotTest-1739026630 None] Creating offline snapshot 7862f33c-3d3d-44dc-a6dd-e91db438aa10 of volume ba78ad4c-332e-4680-98b6-cf29e7754a10 {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:40:59 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-806fd23f-6fff-4814-afd8-47398227dbc7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Volume volume-4adacdc7-998d-4535-adcf-93a8418d8f0a (4adacdc7-998d-4535-adcf-93a8418d8f0a): created successfully Jul 07 17:40:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-806fd23f-6fff-4814-afd8-47398227dbc7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cff1d84-1729-447d-a94e-554cf436abfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-806fd23f-6fff-4814-afd8-47398227dbc7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Flow 'volume_create_manager' (d3a143a1-fb9b-403b-b3a1-a4ef9f5e0e0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:40:59 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee540883-a42f-497c-870f-fc94cf15a1a0]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:40:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1ecf7d61-3bc2-49a8-b7bc-0e9f68a11d0a tempest-CreateVolumesFromSnapshotTest-1739026630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ba78ad4c-332e-4680-98b6-cf29e7754a10 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:59 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-806fd23f-6fff-4814-afd8-47398227dbc7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Created volume successfully. Jul 07 17:40:59 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ba78ad4c-332e-4680-98b6-cf29e7754a10 Jul 07 17:40:59 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:00 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1ecf7d61-3bc2-49a8-b7bc-0e9f68a11d0a tempest-CreateVolumesFromSnapshotTest-1739026630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ba78ad4c-332e-4680-98b6-cf29e7754a10" returned: 0 in 0.767s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1ecf7d61-3bc2-49a8-b7bc-0e9f68a11d0a tempest-CreateVolumesFromSnapshotTest-1739026630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ba78ad4c-332e-4680-98b6-cf29e7754a10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ba78ad4c-332e-4680-98b6-cf29e7754a10.7862f33c-3d3d-44dc-a6dd-e91db438aa10 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:00 devstack sudo[105522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ba78ad4c-332e-4680-98b6-cf29e7754a10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ba78ad4c-332e-4680-98b6-cf29e7754a10.7862f33c-3d3d-44dc-a6dd-e91db438aa10 1G Jul 07 17:41:00 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:01 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1ecf7d61-3bc2-49a8-b7bc-0e9f68a11d0a tempest-CreateVolumesFromSnapshotTest-1739026630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ba78ad4c-332e-4680-98b6-cf29e7754a10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ba78ad4c-332e-4680-98b6-cf29e7754a10.7862f33c-3d3d-44dc-a6dd-e91db438aa10 1G" returned: 0 in 0.763s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1ecf7d61-3bc2-49a8-b7bc-0e9f68a11d0a tempest-CreateVolumesFromSnapshotTest-1739026630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba78ad4c-332e-4680-98b6-cf29e7754a10 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ba78ad4c-332e-4680-98b6-cf29e7754a10.7862f33c-3d3d-44dc-a6dd-e91db438aa10 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:01 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba78ad4c-332e-4680-98b6-cf29e7754a10 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ba78ad4c-332e-4680-98b6-cf29e7754a10.7862f33c-3d3d-44dc-a6dd-e91db438aa10 Jul 07 17:41:01 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:01 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1ecf7d61-3bc2-49a8-b7bc-0e9f68a11d0a tempest-CreateVolumesFromSnapshotTest-1739026630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba78ad4c-332e-4680-98b6-cf29e7754a10 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ba78ad4c-332e-4680-98b6-cf29e7754a10.7862f33c-3d3d-44dc-a6dd-e91db438aa10" returned: 0 in 0.659s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:01 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-1ecf7d61-3bc2-49a8-b7bc-0e9f68a11d0a tempest-CreateVolumesFromSnapshotTest-1739026630 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ba78ad4c-332e-4680-98b6-cf29e7754a10.7862f33c-3d3d-44dc-a6dd-e91db438aa10 is being set with open permissions: ugo+rw Jul 07 17:41:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1ecf7d61-3bc2-49a8-b7bc-0e9f68a11d0a tempest-CreateVolumesFromSnapshotTest-1739026630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ba78ad4c-332e-4680-98b6-cf29e7754a10.7862f33c-3d3d-44dc-a6dd-e91db438aa10 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:01 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ba78ad4c-332e-4680-98b6-cf29e7754a10.7862f33c-3d3d-44dc-a6dd-e91db438aa10 Jul 07 17:41:01 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:02 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1ecf7d61-3bc2-49a8-b7bc-0e9f68a11d0a tempest-CreateVolumesFromSnapshotTest-1739026630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ba78ad4c-332e-4680-98b6-cf29e7754a10.7862f33c-3d3d-44dc-a6dd-e91db438aa10" returned: 0 in 0.626s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1ecf7d61-3bc2-49a8-b7bc-0e9f68a11d0a tempest-CreateVolumesFromSnapshotTest-1739026630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ba78ad4c-332e-4680-98b6-cf29e7754a10.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:02 devstack sudo[105537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ba78ad4c-332e-4680-98b6-cf29e7754a10.info Jul 07 17:41:02 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:03 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1ecf7d61-3bc2-49a8-b7bc-0e9f68a11d0a tempest-CreateVolumesFromSnapshotTest-1739026630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ba78ad4c-332e-4680-98b6-cf29e7754a10.info" returned: 0 in 0.650s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:03 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-1ecf7d61-3bc2-49a8-b7bc-0e9f68a11d0a tempest-CreateVolumesFromSnapshotTest-1739026630 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ba78ad4c-332e-4680-98b6-cf29e7754a10.info is being set with open permissions: ugo+rw Jul 07 17:41:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1ecf7d61-3bc2-49a8-b7bc-0e9f68a11d0a tempest-CreateVolumesFromSnapshotTest-1739026630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ba78ad4c-332e-4680-98b6-cf29e7754a10.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:03 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ba78ad4c-332e-4680-98b6-cf29e7754a10.info Jul 07 17:41:03 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:03 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1ecf7d61-3bc2-49a8-b7bc-0e9f68a11d0a tempest-CreateVolumesFromSnapshotTest-1739026630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ba78ad4c-332e-4680-98b6-cf29e7754a10.info" returned: 0 in 0.629s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1ecf7d61-3bc2-49a8-b7bc-0e9f68a11d0a tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.200s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-da653eae-d94c-4261-9dfb-8a4bf5ca09b7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.605s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:03 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-da653eae-d94c-4261-9dfb-8a4bf5ca09b7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2102522604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cd95ced-a210-4590-aed1-2952ae6c8e86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605c0f265ade47c8b5245607160063ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:40:53Z,use_quota=True,user_id='676440cfabd7478e8fe942fc6f36889f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:41:03 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-da653eae-d94c-4261-9dfb-8a4bf5ca09b7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Creating volume 8cd95ced-a210-4590-aed1-2952ae6c8e86 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:41:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-da653eae-d94c-4261-9dfb-8a4bf5ca09b7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-da653eae-d94c-4261-9dfb-8a4bf5ca09b7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:03 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-da653eae-d94c-4261-9dfb-8a4bf5ca09b7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:03 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-da653eae-d94c-4261-9dfb-8a4bf5ca09b7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-da653eae-d94c-4261-9dfb-8a4bf5ca09b7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:03 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-da653eae-d94c-4261-9dfb-8a4bf5ca09b7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:41:03 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-da653eae-d94c-4261-9dfb-8a4bf5ca09b7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:41:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-da653eae-d94c-4261-9dfb-8a4bf5ca09b7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8cd95ced-a210-4590-aed1-2952ae6c8e86 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:03 devstack sudo[105544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8cd95ced-a210-4590-aed1-2952ae6c8e86 1073741824 Jul 07 17:41:03 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:03 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-1ecf7d61-3bc2-49a8-b7bc-0e9f68a11d0a tempest-CreateVolumesFromSnapshotTest-1739026630 None] Create snapshot completed successfully Jul 07 17:41:04 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-47b3c31f-9533-4a9e-9e9d-ea1efc97d5f6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:41:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-47b3c31f-9533-4a9e-9e9d-ea1efc97d5f6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Flow 'volume_create_manager' (23ab69b5-c980-4b6d-8d22-e0094c7f9fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-47b3c31f-9533-4a9e-9e9d-ea1efc97d5f6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab3d41d4-70c8-42ca-9d3b-52756bc4bad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-47b3c31f-9533-4a9e-9e9d-ea1efc97d5f6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab3d41d4-70c8-42ca-9d3b-52756bc4bad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-83889228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf0917fc-f1b6-4833-8f07-1b3e52f9d22e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eb07bf8e6b149efb4f3bbea9a3719ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:04Z,use_quota=True,user_id='9a7839e972e54d85bdeae85e261da377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-47b3c31f-9533-4a9e-9e9d-ea1efc97d5f6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f368df7-5afa-4cef-bc67-aa0b9312c7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-47b3c31f-9533-4a9e-9e9d-ea1efc97d5f6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f368df7-5afa-4cef-bc67-aa0b9312c7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-47b3c31f-9533-4a9e-9e9d-ea1efc97d5f6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d36a416c-1a13-4d5f-8136-ed4d1f2df482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:04 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-47b3c31f-9533-4a9e-9e9d-ea1efc97d5f6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d36a416c-1a13-4d5f-8136-ed4d1f2df482) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf0917fc-f1b6-4833-8f07-1b3e52f9d22e', 'volume_name': 'volume-cf0917fc-f1b6-4833-8f07-1b3e52f9d22e', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-47b3c31f-9533-4a9e-9e9d-ea1efc97d5f6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ab06d0d-386f-43b2-a9ab-be6b2a0de868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-47b3c31f-9533-4a9e-9e9d-ea1efc97d5f6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ab06d0d-386f-43b2-a9ab-be6b2a0de868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-47b3c31f-9533-4a9e-9e9d-ea1efc97d5f6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6853b592-4758-46c8-8a5e-994a60a72587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:04 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-47b3c31f-9533-4a9e-9e9d-ea1efc97d5f6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Volume cf0917fc-f1b6-4833-8f07-1b3e52f9d22e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf0917fc-f1b6-4833-8f07-1b3e52f9d22e', 'volume_size': 1} Jul 07 17:41:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-47b3c31f-9533-4a9e-9e9d-ea1efc97d5f6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-da653eae-d94c-4261-9dfb-8a4bf5ca09b7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8cd95ced-a210-4590-aed1-2952ae6c8e86 1073741824" returned: 0 in 1.001s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-da653eae-d94c-4261-9dfb-8a4bf5ca09b7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8cd95ced-a210-4590-aed1-2952ae6c8e86 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:04 devstack sudo[105550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8cd95ced-a210-4590-aed1-2952ae6c8e86 Jul 07 17:41:04 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-104924f8-13e8-4b8b-bbc5-d0cdbd5e9da3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-104924f8-13e8-4b8b-bbc5-d0cdbd5e9da3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Flow 'volume_create_manager' (fe210058-876e-418c-b53e-9bf9cc5b8766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-104924f8-13e8-4b8b-bbc5-d0cdbd5e9da3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2e3b04d-6fdf-4302-b264-6f90e91a48f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-104924f8-13e8-4b8b-bbc5-d0cdbd5e9da3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2e3b04d-6fdf-4302-b264-6f90e91a48f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-717393550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc13bf28-c443-45ac-a1b2-ea79020316f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eb07bf8e6b149efb4f3bbea9a3719ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:05Z,use_quota=True,user_id='9a7839e972e54d85bdeae85e261da377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-104924f8-13e8-4b8b-bbc5-d0cdbd5e9da3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e8ddfd2-5872-4587-80eb-c0e47c646d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-104924f8-13e8-4b8b-bbc5-d0cdbd5e9da3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e8ddfd2-5872-4587-80eb-c0e47c646d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-104924f8-13e8-4b8b-bbc5-d0cdbd5e9da3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6ee0a6c-3cfe-47c8-b7fa-591bdcc60e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-104924f8-13e8-4b8b-bbc5-d0cdbd5e9da3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6ee0a6c-3cfe-47c8-b7fa-591bdcc60e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc13bf28-c443-45ac-a1b2-ea79020316f6', 'volume_name': 'volume-cc13bf28-c443-45ac-a1b2-ea79020316f6', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-104924f8-13e8-4b8b-bbc5-d0cdbd5e9da3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9622383b-6a4e-47a9-9dfc-c190447fd861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-104924f8-13e8-4b8b-bbc5-d0cdbd5e9da3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9622383b-6a4e-47a9-9dfc-c190447fd861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-104924f8-13e8-4b8b-bbc5-d0cdbd5e9da3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cfd5d3a-5d5f-45c1-9349-ede859c0b868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:05 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-104924f8-13e8-4b8b-bbc5-d0cdbd5e9da3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Volume cc13bf28-c443-45ac-a1b2-ea79020316f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc13bf28-c443-45ac-a1b2-ea79020316f6', 'volume_size': 1} Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-104924f8-13e8-4b8b-bbc5-d0cdbd5e9da3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-efa062cf-ccdf-4736-aefd-3285b3618fd2 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-efa062cf-ccdf-4736-aefd-3285b3618fd2 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Flow 'volume_create_manager' (875c169f-75d0-48de-8f08-d3e415cafbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-efa062cf-ccdf-4736-aefd-3285b3618fd2 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6804144b-aab6-4cc2-bad0-ed2c68d1851c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-efa062cf-ccdf-4736-aefd-3285b3618fd2 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6804144b-aab6-4cc2-bad0-ed2c68d1851c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1972434273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c5e94ef-906f-4282-a601-c280a113905d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eb07bf8e6b149efb4f3bbea9a3719ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:05Z,use_quota=True,user_id='9a7839e972e54d85bdeae85e261da377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-efa062cf-ccdf-4736-aefd-3285b3618fd2 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (186ad0c1-c8dd-46f6-ad14-bba41990389d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-efa062cf-ccdf-4736-aefd-3285b3618fd2 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (186ad0c1-c8dd-46f6-ad14-bba41990389d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-efa062cf-ccdf-4736-aefd-3285b3618fd2 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2442b76d-13c6-4bfe-be7c-2b40420fad16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-efa062cf-ccdf-4736-aefd-3285b3618fd2 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2442b76d-13c6-4bfe-be7c-2b40420fad16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c5e94ef-906f-4282-a601-c280a113905d', 'volume_name': 'volume-5c5e94ef-906f-4282-a601-c280a113905d', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:05 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-efa062cf-ccdf-4736-aefd-3285b3618fd2 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e612a79a-f147-400e-9bfd-2dd99b397342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-efa062cf-ccdf-4736-aefd-3285b3618fd2 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e612a79a-f147-400e-9bfd-2dd99b397342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-efa062cf-ccdf-4736-aefd-3285b3618fd2 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8213d605-4b3f-4c08-b659-8b902659d8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:05 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-efa062cf-ccdf-4736-aefd-3285b3618fd2 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Volume 5c5e94ef-906f-4282-a601-c280a113905d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c5e94ef-906f-4282-a601-c280a113905d', 'volume_size': 1} Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-efa062cf-ccdf-4736-aefd-3285b3618fd2 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-da653eae-d94c-4261-9dfb-8a4bf5ca09b7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8cd95ced-a210-4590-aed1-2952ae6c8e86" returned: 0 in 0.791s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-da653eae-d94c-4261-9dfb-8a4bf5ca09b7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] <== create_volume: return (1837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-da653eae-d94c-4261-9dfb-8a4bf5ca09b7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.840s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.469s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=497bb435-d98f-46e3-b69d-8fe7f3034317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92f0005d81ed403aab8ff9b077d12d34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:40:52Z,use_quota=True,user_id='0d4d09ebb0cd4cdfad7302f51da6c352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(87870dde-f2c8-4779-8bf7-dbf5ec926ccb),volume_type_id=87870dde-f2c8-4779-8bf7-dbf5ec926ccb)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Creating volume 497bb435-d98f-46e3-b69d-8fe7f3034317 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:41:05 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-497bb435-d98f-46e3-b69d-8fe7f3034317 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:05 devstack sudo[105553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-497bb435-d98f-46e3-b69d-8fe7f3034317 1073741824 Jul 07 17:41:05 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-da653eae-d94c-4261-9dfb-8a4bf5ca09b7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d8d1fa6-3fe2-48eb-a806-b26946868b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cd95ced-a210-4590-aed1-2952ae6c8e86', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-da653eae-d94c-4261-9dfb-8a4bf5ca09b7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d82de80-72d1-4c52-8529-d7a756123b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:05 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-da653eae-d94c-4261-9dfb-8a4bf5ca09b7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Volume volume-8cd95ced-a210-4590-aed1-2952ae6c8e86 (8cd95ced-a210-4590-aed1-2952ae6c8e86): created successfully Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-da653eae-d94c-4261-9dfb-8a4bf5ca09b7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d82de80-72d1-4c52-8529-d7a756123b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-da653eae-d94c-4261-9dfb-8a4bf5ca09b7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Flow 'volume_create_manager' (f2ba7889-517d-49e0-bb43-3efacce45da9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:05 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-da653eae-d94c-4261-9dfb-8a4bf5ca09b7 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Created volume successfully. Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-2586666d-db8e-4d93-8144-13a96b536a1e tempest-CreateVolumesFromSnapshotTest-1739026630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-2586666d-db8e-4d93-8144-13a96b536a1e tempest-CreateVolumesFromSnapshotTest-1739026630 None] Flow 'volume_create_manager' (aae837f9-1da1-4f53-ab31-bf747faeefbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-2586666d-db8e-4d93-8144-13a96b536a1e tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c1a61e0-bcd6-4b70-a805-1ca9c432b97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-2e2aa9a6-4c13-4055-b229-245fba8cd65d tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Acquiring lock "cinder-8cd95ced-a210-4590-aed1-2952ae6c8e86-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-2586666d-db8e-4d93-8144-13a96b536a1e tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c1a61e0-bcd6-4b70-a805-1ca9c432b97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-362322636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7ad4f55-d720-42a9-9d29-9113cdaee017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eb07bf8e6b149efb4f3bbea9a3719ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:06Z,use_quota=True,user_id='9a7839e972e54d85bdeae85e261da377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-2586666d-db8e-4d93-8144-13a96b536a1e tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efdf2793-3390-4106-a5b7-977301e297b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-2586666d-db8e-4d93-8144-13a96b536a1e tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efdf2793-3390-4106-a5b7-977301e297b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-2586666d-db8e-4d93-8144-13a96b536a1e tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (850a8ef2-41c7-4fdc-84f6-68c93cf9869f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-2586666d-db8e-4d93-8144-13a96b536a1e tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (850a8ef2-41c7-4fdc-84f6-68c93cf9869f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7ad4f55-d720-42a9-9d29-9113cdaee017', 'volume_name': 'volume-d7ad4f55-d720-42a9-9d29-9113cdaee017', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-2586666d-db8e-4d93-8144-13a96b536a1e tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dd62cc5-6501-466f-bf03-2d346f312afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-2586666d-db8e-4d93-8144-13a96b536a1e tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dd62cc5-6501-466f-bf03-2d346f312afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-2586666d-db8e-4d93-8144-13a96b536a1e tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daf2ad3c-44fc-4611-ac90-5e7f6effcc83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:05 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-2586666d-db8e-4d93-8144-13a96b536a1e tempest-CreateVolumesFromSnapshotTest-1739026630 None] Volume d7ad4f55-d720-42a9-9d29-9113cdaee017: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7ad4f55-d720-42a9-9d29-9113cdaee017', 'volume_size': 1} Jul 07 17:41:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-2586666d-db8e-4d93-8144-13a96b536a1e tempest-CreateVolumesFromSnapshotTest-1739026630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:06 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-2e2aa9a6-4c13-4055-b229-245fba8cd65d tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "cinder-8cd95ced-a210-4590-aed1-2952ae6c8e86-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:06 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-2e2aa9a6-4c13-4055-b229-245fba8cd65d tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Acquiring lock "cinder-quobyte-8cd95ced-a210-4590-aed1-2952ae6c8e86" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:06 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-2e2aa9a6-4c13-4055-b229-245fba8cd65d tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "cinder-quobyte-8cd95ced-a210-4590-aed1-2952ae6c8e86" acquired by "delete_volume" :: waited 0.026s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:06 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aec3263-91e7-4ced-b82b-50ee2b711726]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2e2aa9a6-4c13-4055-b229-245fba8cd65d tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8cd95ced-a210-4590-aed1-2952ae6c8e86 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:06 devstack sudo[105555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8cd95ced-a210-4590-aed1-2952ae6c8e86 Jul 07 17:41:06 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:06 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-8115c3b4-065a-4473-9d20-b73b2970925b tempest-CreateVolumesFromSnapshotTest-1739026630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:41:06 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-8115c3b4-065a-4473-9d20-b73b2970925b tempest-CreateVolumesFromSnapshotTest-1739026630 None] Flow 'volume_create_manager' (237297a5-1d22-4dd8-a0f6-8f4e1cd04102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:06 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-8115c3b4-065a-4473-9d20-b73b2970925b tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (180a30c3-7e58-4fe5-adaa-c1cf17c93179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:06 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-8115c3b4-065a-4473-9d20-b73b2970925b tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (180a30c3-7e58-4fe5-adaa-c1cf17c93179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1894166460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb7e6f56-fb5b-4dbf-a217-663efa646c7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eb07bf8e6b149efb4f3bbea9a3719ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:06Z,use_quota=True,user_id='9a7839e972e54d85bdeae85e261da377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:06 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-8115c3b4-065a-4473-9d20-b73b2970925b tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a68fa940-2821-4ae3-a187-323f1af0239b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:06 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-8115c3b4-065a-4473-9d20-b73b2970925b tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a68fa940-2821-4ae3-a187-323f1af0239b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:06 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-8115c3b4-065a-4473-9d20-b73b2970925b tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79be65f5-6168-4c0d-8a99-54bf3f011edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:06 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-8115c3b4-065a-4473-9d20-b73b2970925b tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79be65f5-6168-4c0d-8a99-54bf3f011edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb7e6f56-fb5b-4dbf-a217-663efa646c7c', 'volume_name': 'volume-cb7e6f56-fb5b-4dbf-a217-663efa646c7c', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:06 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-8115c3b4-065a-4473-9d20-b73b2970925b tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7f292df-4714-4445-b011-9531c4120218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:06 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-8115c3b4-065a-4473-9d20-b73b2970925b tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7f292df-4714-4445-b011-9531c4120218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:06 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-8115c3b4-065a-4473-9d20-b73b2970925b tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (224a76c2-14d3-484c-aabb-7554aad92ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:06 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-8115c3b4-065a-4473-9d20-b73b2970925b tempest-CreateVolumesFromSnapshotTest-1739026630 None] Volume cb7e6f56-fb5b-4dbf-a217-663efa646c7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb7e6f56-fb5b-4dbf-a217-663efa646c7c', 'volume_size': 1} Jul 07 17:41:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-8115c3b4-065a-4473-9d20-b73b2970925b tempest-CreateVolumesFromSnapshotTest-1739026630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:06 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-497bb435-d98f-46e3-b69d-8fe7f3034317 1073741824" returned: 0 in 1.017s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-497bb435-d98f-46e3-b69d-8fe7f3034317 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:06 devstack sudo[105561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-497bb435-d98f-46e3-b69d-8fe7f3034317 Jul 07 17:41:06 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:06 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2e2aa9a6-4c13-4055-b229-245fba8cd65d tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8cd95ced-a210-4590-aed1-2952ae6c8e86" returned: 0 in 0.879s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2e2aa9a6-4c13-4055-b229-245fba8cd65d tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8cd95ced-a210-4590-aed1-2952ae6c8e86 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:06 devstack sudo[105566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8cd95ced-a210-4590-aed1-2952ae6c8e86 Jul 07 17:41:06 devstack sudo[105566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:07 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-497bb435-d98f-46e3-b69d-8fe7f3034317" returned: 0 in 0.736s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:07 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] <== create_volume: return (1790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:41:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.794s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4480c376-1b39-43e5-803b-b710b5be6a3e tempest-ProjectReaderTests-1245571501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.157s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:07 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-4480c376-1b39-43e5-803b-b710b5be6a3e tempest-ProjectReaderTests-1245571501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1277469216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ec33a90-a3c6-4f4e-b9dd-bfc002e89ade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddc1fcfe77d746d5bb2f587fe117cae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:40:57Z,use_quota=True,user_id='c1ed97ae9c0a4014b06b2648f855c484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:41:07 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-4480c376-1b39-43e5-803b-b710b5be6a3e tempest-ProjectReaderTests-1245571501 None] Creating volume 5ec33a90-a3c6-4f4e-b9dd-bfc002e89ade {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:41:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4480c376-1b39-43e5-803b-b710b5be6a3e tempest-ProjectReaderTests-1245571501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4480c376-1b39-43e5-803b-b710b5be6a3e tempest-ProjectReaderTests-1245571501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:07 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-4480c376-1b39-43e5-803b-b710b5be6a3e tempest-ProjectReaderTests-1245571501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:07 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-4480c376-1b39-43e5-803b-b710b5be6a3e tempest-ProjectReaderTests-1245571501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4480c376-1b39-43e5-803b-b710b5be6a3e tempest-ProjectReaderTests-1245571501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:07 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-4480c376-1b39-43e5-803b-b710b5be6a3e tempest-ProjectReaderTests-1245571501 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:41:07 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-4480c376-1b39-43e5-803b-b710b5be6a3e tempest-ProjectReaderTests-1245571501 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:41:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4480c376-1b39-43e5-803b-b710b5be6a3e tempest-ProjectReaderTests-1245571501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5ec33a90-a3c6-4f4e-b9dd-bfc002e89ade 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:07 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5ec33a90-a3c6-4f4e-b9dd-bfc002e89ade 1073741824 Jul 07 17:41:07 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:07 devstack cinder-volume[87233]: DEBUG cinder.volume.volume_utils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Attempting download of ab465613-f341-4521-9231-bf956eeae707 ((None, [{'url': 'file:///opt/stack/data/glance/images/ab465613-f341-4521-9231-bf956eeae707', 'metadata': {}}])) to volume 497bb435-d98f-46e3-b69d-8fe7f3034317. {{(pid=87233) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 17:41:07 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc64d9c-af0f-4a80-b1d7-b346852c90b7]: (4, 'raw') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ab465613-f341-4521-9231-bf956eeae707_b7rsp3ou {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:07 devstack sudo[105571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ab465613-f341-4521-9231-bf956eeae707_b7rsp3ou Jul 07 17:41:07 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:07 devstack sudo[105566]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2e2aa9a6-4c13-4055-b229-245fba8cd65d tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8cd95ced-a210-4590-aed1-2952ae6c8e86" returned: 0 in 0.647s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:07 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-2e2aa9a6-4c13-4055-b229-245fba8cd65d tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "cinder-quobyte-8cd95ced-a210-4590-aed1-2952ae6c8e86" released by "delete_volume" :: held 1.570s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:07 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-2e2aa9a6-4c13-4055-b229-245fba8cd65d tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Created reservations ['90c995e6-a857-4867-bf22-7bddfb6f3d0b', 'bce2732b-f830-4b8e-bf8c-0089504a90ae', '4e2433dd-43cd-4515-9083-63200a4da372', '830bc69b-0ac2-4fc5-95ca-2679eb25343d'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:41:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-2e2aa9a6-4c13-4055-b229-245fba8cd65d tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-2e2aa9a6-4c13-4055-b229-245fba8cd65d tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:07 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-2e2aa9a6-4c13-4055-b229-245fba8cd65d tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:07 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-2e2aa9a6-4c13-4055-b229-245fba8cd65d tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-2e2aa9a6-4c13-4055-b229-245fba8cd65d tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2e2aa9a6-4c13-4055-b229-245fba8cd65d tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:07 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:41:07 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:08 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0978a79b-04a7-4914-8cfd-f5a7e5b08727 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Acquiring lock "cinder-4adacdc7-998d-4535-adcf-93a8418d8f0a-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:08 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0978a79b-04a7-4914-8cfd-f5a7e5b08727 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "cinder-4adacdc7-998d-4535-adcf-93a8418d8f0a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:08 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0978a79b-04a7-4914-8cfd-f5a7e5b08727 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Acquiring lock "cinder-quobyte-4adacdc7-998d-4535-adcf-93a8418d8f0a" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:08 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:08 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0978a79b-04a7-4914-8cfd-f5a7e5b08727 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "cinder-quobyte-4adacdc7-998d-4535-adcf-93a8418d8f0a" acquired by "delete_volume" :: waited 0.028s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4480c376-1b39-43e5-803b-b710b5be6a3e tempest-ProjectReaderTests-1245571501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5ec33a90-a3c6-4f4e-b9dd-bfc002e89ade 1073741824" returned: 0 in 1.035s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:08 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63123c6-eb86-4ba0-9dee-86e3d2e8e1d3]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0978a79b-04a7-4914-8cfd-f5a7e5b08727 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4adacdc7-998d-4535-adcf-93a8418d8f0a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:08 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ab465613-f341-4521-9231-bf956eeae707_b7rsp3ou" returned: 0 in 0.993s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab465613-f341-4521-9231-bf956eeae707_b7rsp3ou {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4480c376-1b39-43e5-803b-b710b5be6a3e tempest-ProjectReaderTests-1245571501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5ec33a90-a3c6-4f4e-b9dd-bfc002e89ade {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:08 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5ec33a90-a3c6-4f4e-b9dd-bfc002e89ade Jul 07 17:41:08 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:08 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2e2aa9a6-4c13-4055-b229-245fba8cd65d tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.753s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:08 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-2e2aa9a6-4c13-4055-b229-245fba8cd65d tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:41:08 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-2e2aa9a6-4c13-4055-b229-245fba8cd65d tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Deleted volume successfully. Jul 07 17:41:08 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4adacdc7-998d-4535-adcf-93a8418d8f0a Jul 07 17:41:08 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:08 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-2e2aa9a6-4c13-4055-b229-245fba8cd65d tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "cinder-8cd95ced-a210-4590-aed1-2952ae6c8e86-delete_volume" released by "delete_volume" :: held 2.541s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:08 devstack sudo[105585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab465613-f341-4521-9231-bf956eeae707_b7rsp3ou Jul 07 17:41:08 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:09 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4480c376-1b39-43e5-803b-b710b5be6a3e tempest-ProjectReaderTests-1245571501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5ec33a90-a3c6-4f4e-b9dd-bfc002e89ade" returned: 0 in 0.649s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:09 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-4480c376-1b39-43e5-803b-b710b5be6a3e tempest-ProjectReaderTests-1245571501 None] <== create_volume: return (1760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:41:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4480c376-1b39-43e5-803b-b710b5be6a3e tempest-ProjectReaderTests-1245571501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.762s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-47b3c31f-9533-4a9e-9e9d-ea1efc97d5f6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.401s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:09 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-47b3c31f-9533-4a9e-9e9d-ea1efc97d5f6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-83889228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf0917fc-f1b6-4833-8f07-1b3e52f9d22e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eb07bf8e6b149efb4f3bbea9a3719ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:04Z,use_quota=True,user_id='9a7839e972e54d85bdeae85e261da377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:41:09 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-47b3c31f-9533-4a9e-9e9d-ea1efc97d5f6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Creating volume cf0917fc-f1b6-4833-8f07-1b3e52f9d22e {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:41:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-47b3c31f-9533-4a9e-9e9d-ea1efc97d5f6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-47b3c31f-9533-4a9e-9e9d-ea1efc97d5f6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:09 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-47b3c31f-9533-4a9e-9e9d-ea1efc97d5f6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:09 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-47b3c31f-9533-4a9e-9e9d-ea1efc97d5f6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-47b3c31f-9533-4a9e-9e9d-ea1efc97d5f6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:09 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-47b3c31f-9533-4a9e-9e9d-ea1efc97d5f6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:41:09 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-47b3c31f-9533-4a9e-9e9d-ea1efc97d5f6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:41:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-47b3c31f-9533-4a9e-9e9d-ea1efc97d5f6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf0917fc-f1b6-4833-8f07-1b3e52f9d22e 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:09 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4480c376-1b39-43e5-803b-b710b5be6a3e tempest-ProjectReaderTests-1245571501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f68d006-6a9a-4654-a10f-c81076fc6492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ec33a90-a3c6-4f4e-b9dd-bfc002e89ade', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:09 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4480c376-1b39-43e5-803b-b710b5be6a3e tempest-ProjectReaderTests-1245571501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e2fe4af-5c64-46c8-95fb-18e8db895fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:09 devstack sudo[105593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf0917fc-f1b6-4833-8f07-1b3e52f9d22e 1073741824 Jul 07 17:41:09 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:09 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-4480c376-1b39-43e5-803b-b710b5be6a3e tempest-ProjectReaderTests-1245571501 None] Volume volume-5ec33a90-a3c6-4f4e-b9dd-bfc002e89ade (5ec33a90-a3c6-4f4e-b9dd-bfc002e89ade): created successfully Jul 07 17:41:09 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4480c376-1b39-43e5-803b-b710b5be6a3e tempest-ProjectReaderTests-1245571501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e2fe4af-5c64-46c8-95fb-18e8db895fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:09 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-4480c376-1b39-43e5-803b-b710b5be6a3e tempest-ProjectReaderTests-1245571501 None] Flow 'volume_create_manager' (0bc14a14-9201-401b-931a-df3fd1ce2fc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:09 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-4480c376-1b39-43e5-803b-b710b5be6a3e tempest-ProjectReaderTests-1245571501 None] Created volume successfully. Jul 07 17:41:09 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0978a79b-04a7-4914-8cfd-f5a7e5b08727 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4adacdc7-998d-4535-adcf-93a8418d8f0a" returned: 0 in 0.865s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0978a79b-04a7-4914-8cfd-f5a7e5b08727 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4adacdc7-998d-4535-adcf-93a8418d8f0a {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:09 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4adacdc7-998d-4535-adcf-93a8418d8f0a Jul 07 17:41:09 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:09 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab465613-f341-4521-9231-bf956eeae707_b7rsp3ou" returned: 1 in 0.888s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab465613-f341-4521-9231-bf956eeae707_b7rsp3ou' failed. Not Retrying. {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:41:09 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0dc57f-96f1-4f4b-a3ba-0a0e91fd3853]: (4, 'raw') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab465613-f341-4521-9231-bf956eeae707_6ybcl7jkdevstack@QuobyteHD {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:09 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab465613-f341-4521-9231-bf956eeae707_6ybcl7jkdevstack@QuobyteHD Jul 07 17:41:09 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:09 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-86c706ab-7a33-45c9-85aa-a88c3d93f5b3 tempest-ProjectReaderTests-1245571501 None] Acquiring lock "cinder-5ec33a90-a3c6-4f4e-b9dd-bfc002e89ade-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:09 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-86c706ab-7a33-45c9-85aa-a88c3d93f5b3 tempest-ProjectReaderTests-1245571501 None] Lock "cinder-5ec33a90-a3c6-4f4e-b9dd-bfc002e89ade-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:10 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-86c706ab-7a33-45c9-85aa-a88c3d93f5b3 tempest-ProjectReaderTests-1245571501 None] Acquiring lock "cinder-quobyte-5ec33a90-a3c6-4f4e-b9dd-bfc002e89ade" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:10 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0978a79b-04a7-4914-8cfd-f5a7e5b08727 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4adacdc7-998d-4535-adcf-93a8418d8f0a" returned: 0 in 0.768s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:10 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0978a79b-04a7-4914-8cfd-f5a7e5b08727 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "cinder-quobyte-4adacdc7-998d-4535-adcf-93a8418d8f0a" released by "delete_volume" :: held 1.696s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:10 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-86c706ab-7a33-45c9-85aa-a88c3d93f5b3 tempest-ProjectReaderTests-1245571501 None] Lock "cinder-quobyte-5ec33a90-a3c6-4f4e-b9dd-bfc002e89ade" acquired by "delete_volume" :: waited 0.039s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:10 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:10 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5854a27d-a273-40d8-94fc-5b57bbb5004f]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-86c706ab-7a33-45c9-85aa-a88c3d93f5b3 tempest-ProjectReaderTests-1245571501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5ec33a90-a3c6-4f4e-b9dd-bfc002e89ade {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab465613-f341-4521-9231-bf956eeae707_6ybcl7jkdevstack@QuobyteHD" returned: 0 in 0.779s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab465613-f341-4521-9231-bf956eeae707_6ybcl7jkdevstack@QuobyteHD {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:10 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-47b3c31f-9533-4a9e-9e9d-ea1efc97d5f6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf0917fc-f1b6-4833-8f07-1b3e52f9d22e 1073741824" returned: 0 in 1.034s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:10 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-0978a79b-04a7-4914-8cfd-f5a7e5b08727 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Created reservations ['de3b1f1c-ca12-4d05-94b5-2b5bc2ba61be', '482acbe8-eb9e-4921-98e3-9bed4631762d', 'dbcaa2a2-a95f-4e64-a81f-fbeacec104c1', '6c9a8156-8929-4485-b0df-8380c059a9c4'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:41:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-47b3c31f-9533-4a9e-9e9d-ea1efc97d5f6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf0917fc-f1b6-4833-8f07-1b3e52f9d22e {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:10 devstack sudo[105609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5ec33a90-a3c6-4f4e-b9dd-bfc002e89ade Jul 07 17:41:10 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:10 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab465613-f341-4521-9231-bf956eeae707_6ybcl7jkdevstack@QuobyteHD Jul 07 17:41:10 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:10 devstack sudo[105611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf0917fc-f1b6-4833-8f07-1b3e52f9d22e Jul 07 17:41:10 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0978a79b-04a7-4914-8cfd-f5a7e5b08727 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0978a79b-04a7-4914-8cfd-f5a7e5b08727 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:10 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-0978a79b-04a7-4914-8cfd-f5a7e5b08727 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:10 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-0978a79b-04a7-4914-8cfd-f5a7e5b08727 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0978a79b-04a7-4914-8cfd-f5a7e5b08727 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0978a79b-04a7-4914-8cfd-f5a7e5b08727 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:10 devstack sudo[105615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:41:10 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:10 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c73f21a5-8630-4081-82d9-300b61e6e27e tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Acquiring lock "cinder-668ec4ee-5f44-4baa-822d-9d3213ff8a07-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:10 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c73f21a5-8630-4081-82d9-300b61e6e27e tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "cinder-668ec4ee-5f44-4baa-822d-9d3213ff8a07-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:10 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c73f21a5-8630-4081-82d9-300b61e6e27e tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Acquiring lock "cinder-quobyte-668ec4ee-5f44-4baa-822d-9d3213ff8a07" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:10 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c73f21a5-8630-4081-82d9-300b61e6e27e tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "cinder-quobyte-668ec4ee-5f44-4baa-822d-9d3213ff8a07" acquired by "delete_volume" :: waited 0.042s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:10 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[95314269-cd90-45db-89ad-9880847624a2]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c73f21a5-8630-4081-82d9-300b61e6e27e tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-668ec4ee-5f44-4baa-822d-9d3213ff8a07 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:11 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab465613-f341-4521-9231-bf956eeae707_6ybcl7jkdevstack@QuobyteHD" returned: 1 in 0.918s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab465613-f341-4521-9231-bf956eeae707_6ybcl7jkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:41:11 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] ab465613-f341-4521-9231-bf956eeae707 was raw, converting to raw {{(pid=87233) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 17:41:11 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ab465613-f341-4521-9231-bf956eeae707_6ybcl7jkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-497bb435-d98f-46e3-b69d-8fe7f3034317 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:11 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-668ec4ee-5f44-4baa-822d-9d3213ff8a07 Jul 07 17:41:11 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0978a79b-04a7-4914-8cfd-f5a7e5b08727 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.763s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:11 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-0978a79b-04a7-4914-8cfd-f5a7e5b08727 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:41:11 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-0978a79b-04a7-4914-8cfd-f5a7e5b08727 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Deleted volume successfully. Jul 07 17:41:11 devstack sudo[105628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ab465613-f341-4521-9231-bf956eeae707_6ybcl7jkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-497bb435-d98f-46e3-b69d-8fe7f3034317 Jul 07 17:41:11 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:11 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0978a79b-04a7-4914-8cfd-f5a7e5b08727 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "cinder-4adacdc7-998d-4535-adcf-93a8418d8f0a-delete_volume" released by "delete_volume" :: held 2.847s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:11 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-86c706ab-7a33-45c9-85aa-a88c3d93f5b3 tempest-ProjectReaderTests-1245571501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5ec33a90-a3c6-4f4e-b9dd-bfc002e89ade" returned: 0 in 1.039s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-86c706ab-7a33-45c9-85aa-a88c3d93f5b3 tempest-ProjectReaderTests-1245571501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5ec33a90-a3c6-4f4e-b9dd-bfc002e89ade {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:11 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5ec33a90-a3c6-4f4e-b9dd-bfc002e89ade Jul 07 17:41:11 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:11 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-47b3c31f-9533-4a9e-9e9d-ea1efc97d5f6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf0917fc-f1b6-4833-8f07-1b3e52f9d22e" returned: 0 in 1.014s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:11 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-47b3c31f-9533-4a9e-9e9d-ea1efc97d5f6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] <== create_volume: return (2113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:41:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-47b3c31f-9533-4a9e-9e9d-ea1efc97d5f6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.117s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-104924f8-13e8-4b8b-bbc5-d0cdbd5e9da3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.098s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:11 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-104924f8-13e8-4b8b-bbc5-d0cdbd5e9da3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-717393550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc13bf28-c443-45ac-a1b2-ea79020316f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eb07bf8e6b149efb4f3bbea9a3719ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:05Z,use_quota=True,user_id='9a7839e972e54d85bdeae85e261da377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:41:11 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-104924f8-13e8-4b8b-bbc5-d0cdbd5e9da3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Creating volume cc13bf28-c443-45ac-a1b2-ea79020316f6 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:41:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-104924f8-13e8-4b8b-bbc5-d0cdbd5e9da3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-104924f8-13e8-4b8b-bbc5-d0cdbd5e9da3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:11 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-104924f8-13e8-4b8b-bbc5-d0cdbd5e9da3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:11 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-104924f8-13e8-4b8b-bbc5-d0cdbd5e9da3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-104924f8-13e8-4b8b-bbc5-d0cdbd5e9da3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:11 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-104924f8-13e8-4b8b-bbc5-d0cdbd5e9da3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:41:11 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-104924f8-13e8-4b8b-bbc5-d0cdbd5e9da3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:41:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-104924f8-13e8-4b8b-bbc5-d0cdbd5e9da3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc13bf28-c443-45ac-a1b2-ea79020316f6 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:11 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-47b3c31f-9533-4a9e-9e9d-ea1efc97d5f6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6853b592-4758-46c8-8a5e-994a60a72587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf0917fc-f1b6-4833-8f07-1b3e52f9d22e', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:11 devstack sudo[105632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc13bf28-c443-45ac-a1b2-ea79020316f6 1073741824 Jul 07 17:41:11 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:11 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-47b3c31f-9533-4a9e-9e9d-ea1efc97d5f6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab4aaeaf-14d9-4b2f-a42f-3d94285612aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:11 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-47b3c31f-9533-4a9e-9e9d-ea1efc97d5f6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Volume volume-cf0917fc-f1b6-4833-8f07-1b3e52f9d22e (cf0917fc-f1b6-4833-8f07-1b3e52f9d22e): created successfully Jul 07 17:41:11 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-47b3c31f-9533-4a9e-9e9d-ea1efc97d5f6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab4aaeaf-14d9-4b2f-a42f-3d94285612aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:11 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-47b3c31f-9533-4a9e-9e9d-ea1efc97d5f6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Flow 'volume_create_manager' (23ab69b5-c980-4b6d-8d22-e0094c7f9fbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:11 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-47b3c31f-9533-4a9e-9e9d-ea1efc97d5f6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Created volume successfully. Jul 07 17:41:11 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ab465613-f341-4521-9231-bf956eeae707_6ybcl7jkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-497bb435-d98f-46e3-b69d-8fe7f3034317" returned: 0 in 0.861s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:11 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ab465613-f341-4521-9231-bf956eeae707_6ybcl7jkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-497bb435-d98f-46e3-b69d-8fe7f3034317 {{(pid=87233) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:41:11 devstack cinder-volume[87233]: INFO cinder.image.image_utils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 17:41:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-497bb435-d98f-46e3-b69d-8fe7f3034317 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:11 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-86c706ab-7a33-45c9-85aa-a88c3d93f5b3 tempest-ProjectReaderTests-1245571501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5ec33a90-a3c6-4f4e-b9dd-bfc002e89ade" returned: 0 in 0.790s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:11 devstack sudo[105641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-497bb435-d98f-46e3-b69d-8fe7f3034317 1G Jul 07 17:41:11 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:11 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-86c706ab-7a33-45c9-85aa-a88c3d93f5b3 tempest-ProjectReaderTests-1245571501 None] Lock "cinder-quobyte-5ec33a90-a3c6-4f4e-b9dd-bfc002e89ade" released by "delete_volume" :: held 1.876s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:11 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c73f21a5-8630-4081-82d9-300b61e6e27e tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-668ec4ee-5f44-4baa-822d-9d3213ff8a07" returned: 0 in 1.131s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c73f21a5-8630-4081-82d9-300b61e6e27e tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-668ec4ee-5f44-4baa-822d-9d3213ff8a07 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:11 devstack sudo[105646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-668ec4ee-5f44-4baa-822d-9d3213ff8a07 Jul 07 17:41:11 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:12 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-86c706ab-7a33-45c9-85aa-a88c3d93f5b3 tempest-ProjectReaderTests-1245571501 None] Created reservations ['3803ccb4-e243-4514-9a5e-a66082f1762a', '9b0bc6f5-c3ff-456c-8800-2d8f7e4b3665', 'd005a8cc-0020-4e48-9d82-0a83e095a4d2', 'beb45f8d-9440-420e-a534-80ffe9b5a479'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:41:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-86c706ab-7a33-45c9-85aa-a88c3d93f5b3 tempest-ProjectReaderTests-1245571501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-86c706ab-7a33-45c9-85aa-a88c3d93f5b3 tempest-ProjectReaderTests-1245571501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:12 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-86c706ab-7a33-45c9-85aa-a88c3d93f5b3 tempest-ProjectReaderTests-1245571501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:12 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-86c706ab-7a33-45c9-85aa-a88c3d93f5b3 tempest-ProjectReaderTests-1245571501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-86c706ab-7a33-45c9-85aa-a88c3d93f5b3 tempest-ProjectReaderTests-1245571501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-86c706ab-7a33-45c9-85aa-a88c3d93f5b3 tempest-ProjectReaderTests-1245571501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:12 devstack sudo[105650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:41:12 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:12 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-104924f8-13e8-4b8b-bbc5-d0cdbd5e9da3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc13bf28-c443-45ac-a1b2-ea79020316f6 1073741824" returned: 0 in 1.162s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-104924f8-13e8-4b8b-bbc5-d0cdbd5e9da3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc13bf28-c443-45ac-a1b2-ea79020316f6 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:12 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc13bf28-c443-45ac-a1b2-ea79020316f6 Jul 07 17:41:12 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:12 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c73f21a5-8630-4081-82d9-300b61e6e27e tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-668ec4ee-5f44-4baa-822d-9d3213ff8a07" returned: 0 in 0.826s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:12 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c73f21a5-8630-4081-82d9-300b61e6e27e tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "cinder-quobyte-668ec4ee-5f44-4baa-822d-9d3213ff8a07" released by "delete_volume" :: held 2.017s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:12 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-497bb435-d98f-46e3-b69d-8fe7f3034317 1G" returned: 0 in 1.025s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:12 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-c73f21a5-8630-4081-82d9-300b61e6e27e tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Created reservations ['c74b638a-2fe2-4447-8535-51a136a501f6', 'e8aa551d-98fd-4d74-86e2-7e0da1e1264e', '0de60094-32c4-489c-b915-21cd82f025f1', '666e7658-c875-467b-a5f2-1ac170f3d417'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:41:12 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fb49c5-79e0-43aa-9dff-59432570d485]: (4, 'raw') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-497bb435-d98f-46e3-b69d-8fe7f3034317 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:13 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-86c706ab-7a33-45c9-85aa-a88c3d93f5b3 tempest-ProjectReaderTests-1245571501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.924s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:13 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-86c706ab-7a33-45c9-85aa-a88c3d93f5b3 tempest-ProjectReaderTests-1245571501 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:41:13 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-86c706ab-7a33-45c9-85aa-a88c3d93f5b3 tempest-ProjectReaderTests-1245571501 None] Deleted volume successfully. Jul 07 17:41:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c73f21a5-8630-4081-82d9-300b61e6e27e tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c73f21a5-8630-4081-82d9-300b61e6e27e tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:13 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c73f21a5-8630-4081-82d9-300b61e6e27e tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:13 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c73f21a5-8630-4081-82d9-300b61e6e27e tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c73f21a5-8630-4081-82d9-300b61e6e27e tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c73f21a5-8630-4081-82d9-300b61e6e27e tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:13 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-86c706ab-7a33-45c9-85aa-a88c3d93f5b3 tempest-ProjectReaderTests-1245571501 None] Lock "cinder-5ec33a90-a3c6-4f4e-b9dd-bfc002e89ade-delete_volume" released by "delete_volume" :: held 3.152s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:13 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-497bb435-d98f-46e3-b69d-8fe7f3034317 Jul 07 17:41:13 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:13 devstack sudo[105660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:41:13 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:13 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-104924f8-13e8-4b8b-bbc5-d0cdbd5e9da3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc13bf28-c443-45ac-a1b2-ea79020316f6" returned: 0 in 0.960s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:13 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-104924f8-13e8-4b8b-bbc5-d0cdbd5e9da3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] <== create_volume: return (2196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:41:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-104924f8-13e8-4b8b-bbc5-d0cdbd5e9da3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.203s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-efa062cf-ccdf-4736-aefd-3285b3618fd2 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.919s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:13 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-efa062cf-ccdf-4736-aefd-3285b3618fd2 tempest-CreateVolumesFromSnapshotTest-1739026630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1972434273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c5e94ef-906f-4282-a601-c280a113905d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eb07bf8e6b149efb4f3bbea9a3719ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:05Z,use_quota=True,user_id='9a7839e972e54d85bdeae85e261da377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:41:13 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-efa062cf-ccdf-4736-aefd-3285b3618fd2 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Creating volume 5c5e94ef-906f-4282-a601-c280a113905d {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:41:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-efa062cf-ccdf-4736-aefd-3285b3618fd2 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-efa062cf-ccdf-4736-aefd-3285b3618fd2 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:13 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-efa062cf-ccdf-4736-aefd-3285b3618fd2 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:13 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-efa062cf-ccdf-4736-aefd-3285b3618fd2 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-efa062cf-ccdf-4736-aefd-3285b3618fd2 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:13 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-efa062cf-ccdf-4736-aefd-3285b3618fd2 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:41:13 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-efa062cf-ccdf-4736-aefd-3285b3618fd2 tempest-CreateVolumesFromSnapshotTest-1739026630 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:41:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-efa062cf-ccdf-4736-aefd-3285b3618fd2 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c5e94ef-906f-4282-a601-c280a113905d 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-104924f8-13e8-4b8b-bbc5-d0cdbd5e9da3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cfd5d3a-5d5f-45c1-9349-ede859c0b868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc13bf28-c443-45ac-a1b2-ea79020316f6', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-104924f8-13e8-4b8b-bbc5-d0cdbd5e9da3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3df1b4b2-40d2-411f-aab8-75a12e174d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:13 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c5e94ef-906f-4282-a601-c280a113905d 1073741824 Jul 07 17:41:13 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:13 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-104924f8-13e8-4b8b-bbc5-d0cdbd5e9da3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Volume volume-cc13bf28-c443-45ac-a1b2-ea79020316f6 (cc13bf28-c443-45ac-a1b2-ea79020316f6): created successfully Jul 07 17:41:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-104924f8-13e8-4b8b-bbc5-d0cdbd5e9da3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3df1b4b2-40d2-411f-aab8-75a12e174d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:13 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-104924f8-13e8-4b8b-bbc5-d0cdbd5e9da3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Flow 'volume_create_manager' (fe210058-876e-418c-b53e-9bf9cc5b8766) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:13 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-104924f8-13e8-4b8b-bbc5-d0cdbd5e9da3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Created volume successfully. Jul 07 17:41:13 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-497bb435-d98f-46e3-b69d-8fe7f3034317" returned: 0 in 1.000s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-497bb435-d98f-46e3-b69d-8fe7f3034317 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:14 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c73f21a5-8630-4081-82d9-300b61e6e27e tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.947s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:14 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-c73f21a5-8630-4081-82d9-300b61e6e27e tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:41:14 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-c73f21a5-8630-4081-82d9-300b61e6e27e tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Deleted volume successfully. Jul 07 17:41:14 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c73f21a5-8630-4081-82d9-300b61e6e27e tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "cinder-668ec4ee-5f44-4baa-822d-9d3213ff8a07-delete_volume" released by "delete_volume" :: held 3.417s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:14 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9a34136c-3f97-4d6d-abde-571dfbbdd2d3 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Acquiring lock "cinder-5f69959e-e985-4373-94ac-d83cf85b3deb-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:14 devstack sudo[105669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-497bb435-d98f-46e3-b69d-8fe7f3034317 Jul 07 17:41:14 devstack sudo[105669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:14 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9a34136c-3f97-4d6d-abde-571dfbbdd2d3 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "cinder-5f69959e-e985-4373-94ac-d83cf85b3deb-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:14 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9a34136c-3f97-4d6d-abde-571dfbbdd2d3 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Acquiring lock "cinder-quobyte-5f69959e-e985-4373-94ac-d83cf85b3deb" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:14 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9a34136c-3f97-4d6d-abde-571dfbbdd2d3 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "cinder-quobyte-5f69959e-e985-4373-94ac-d83cf85b3deb" acquired by "delete_volume" :: waited 0.018s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:14 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[417f1744-8170-4bec-a14f-fd02527cd81d]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9a34136c-3f97-4d6d-abde-571dfbbdd2d3 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5f69959e-e985-4373-94ac-d83cf85b3deb {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:14 devstack sudo[105675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5f69959e-e985-4373-94ac-d83cf85b3deb Jul 07 17:41:14 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:14 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-efa062cf-ccdf-4736-aefd-3285b3618fd2 tempest-CreateVolumesFromSnapshotTest-1739026630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c5e94ef-906f-4282-a601-c280a113905d 1073741824" returned: 0 in 1.139s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-efa062cf-ccdf-4736-aefd-3285b3618fd2 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c5e94ef-906f-4282-a601-c280a113905d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:14 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c5e94ef-906f-4282-a601-c280a113905d Jul 07 17:41:14 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:14 devstack sudo[105669]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-497bb435-d98f-46e3-b69d-8fe7f3034317" returned: 1 in 1.015s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-497bb435-d98f-46e3-b69d-8fe7f3034317' failed. Not Retrying. {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:41:14 devstack cinder-volume[87233]: DEBUG cinder.volume.volume_utils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Downloaded image ab465613-f341-4521-9231-bf956eeae707 ((None, [{'url': 'file:///opt/stack/data/glance/images/ab465613-f341-4521-9231-bf956eeae707', 'metadata': {}}])) to volume 497bb435-d98f-46e3-b69d-8fe7f3034317 successfully. {{(pid=87233) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 17:41:14 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Temporary image ab465613-f341-4521-9231-bf956eeae707 for user 0d4d09ebb0cd4cdfad7302f51da6c352 is deleted. {{(pid=87233) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 17:41:14 devstack cinder-volume[87233]: DEBUG cinder.volume.volume_utils [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Marking volume 497bb435-d98f-46e3-b69d-8fe7f3034317 as bootable. {{(pid=87233) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 17:41:14 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Copying metadata from image ab465613-f341-4521-9231-bf956eeae707 to 497bb435-d98f-46e3-b69d-8fe7f3034317. {{(pid=87233) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 17:41:14 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Creating volume glance metadata for volume 497bb435-d98f-46e3-b69d-8fe7f3034317 backed by image ab465613-f341-4521-9231-bf956eeae707 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'ab465613-f341-4521-9231-bf956eeae707', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '4cbd7702e77ba4cadd5da1cd6223f3b3', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87233) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 17:41:15 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d107d1df-ae7a-4046-90c9-ffa7eac56076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-497bb435-d98f-46e3-b69d-8fe7f3034317', 'volume_size': 1, 'image_id': 'ab465613-f341-4521-9231-bf956eeae707', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ab465613-f341-4521-9231-bf956eeae707', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4cbd7702e77ba4cadd5da1cd6223f3b3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '92f0005d81ed403aab8ff9b077d12d34', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '66152bd00a74217f37a6c518be28343ec1d35c4dc82f245d692c803a187647c0bbfdae1562a51b4197d10e7a0957c82780e56fa13cf462d6e833287d78f95139', 'id': 'ab465613-f341-4521-9231-bf956eeae707', 'created_at': datetime.datetime(2026, 7, 7, 15, 40, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 40, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ab465613-f341-4521-9231-bf956eeae707/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:15 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e20658fa-1dd6-4411-b31c-6cb6673c0279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:15 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Volume volume-497bb435-d98f-46e3-b69d-8fe7f3034317 (497bb435-d98f-46e3-b69d-8fe7f3034317): created successfully Jul 07 17:41:15 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e20658fa-1dd6-4411-b31c-6cb6673c0279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:15 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Flow 'volume_create_manager' (062cec3a-3c84-43f2-8359-05a0f6ba020a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:15 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-0f938007-15d3-4b81-9b43-3ec3061731f3 tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Created volume successfully. Jul 07 17:41:15 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9a34136c-3f97-4d6d-abde-571dfbbdd2d3 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5f69959e-e985-4373-94ac-d83cf85b3deb" returned: 0 in 0.932s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9a34136c-3f97-4d6d-abde-571dfbbdd2d3 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5f69959e-e985-4373-94ac-d83cf85b3deb {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:15 devstack sudo[105687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5f69959e-e985-4373-94ac-d83cf85b3deb Jul 07 17:41:15 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:15 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-efa062cf-ccdf-4736-aefd-3285b3618fd2 tempest-CreateVolumesFromSnapshotTest-1739026630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c5e94ef-906f-4282-a601-c280a113905d" returned: 0 in 0.787s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:15 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-efa062cf-ccdf-4736-aefd-3285b3618fd2 tempest-CreateVolumesFromSnapshotTest-1739026630 None] <== create_volume: return (1992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:41:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-efa062cf-ccdf-4736-aefd-3285b3618fd2 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-2586666d-db8e-4d93-8144-13a96b536a1e tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.447s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:15 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-2586666d-db8e-4d93-8144-13a96b536a1e tempest-CreateVolumesFromSnapshotTest-1739026630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-362322636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7ad4f55-d720-42a9-9d29-9113cdaee017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eb07bf8e6b149efb4f3bbea9a3719ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:06Z,use_quota=True,user_id='9a7839e972e54d85bdeae85e261da377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:41:15 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-2586666d-db8e-4d93-8144-13a96b536a1e tempest-CreateVolumesFromSnapshotTest-1739026630 None] Creating volume d7ad4f55-d720-42a9-9d29-9113cdaee017 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:41:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-2586666d-db8e-4d93-8144-13a96b536a1e tempest-CreateVolumesFromSnapshotTest-1739026630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-2586666d-db8e-4d93-8144-13a96b536a1e tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:15 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-2586666d-db8e-4d93-8144-13a96b536a1e tempest-CreateVolumesFromSnapshotTest-1739026630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:15 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-2586666d-db8e-4d93-8144-13a96b536a1e tempest-CreateVolumesFromSnapshotTest-1739026630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-2586666d-db8e-4d93-8144-13a96b536a1e tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:15 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-2586666d-db8e-4d93-8144-13a96b536a1e tempest-CreateVolumesFromSnapshotTest-1739026630 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:41:15 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-2586666d-db8e-4d93-8144-13a96b536a1e tempest-CreateVolumesFromSnapshotTest-1739026630 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:41:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2586666d-db8e-4d93-8144-13a96b536a1e tempest-CreateVolumesFromSnapshotTest-1739026630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7ad4f55-d720-42a9-9d29-9113cdaee017 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:15 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-efa062cf-ccdf-4736-aefd-3285b3618fd2 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8213d605-4b3f-4c08-b659-8b902659d8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c5e94ef-906f-4282-a601-c280a113905d', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:15 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-efa062cf-ccdf-4736-aefd-3285b3618fd2 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b70c515-3a56-40b7-bde1-812450be14f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:15 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7ad4f55-d720-42a9-9d29-9113cdaee017 1073741824 Jul 07 17:41:15 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:15 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-efa062cf-ccdf-4736-aefd-3285b3618fd2 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Volume volume-5c5e94ef-906f-4282-a601-c280a113905d (5c5e94ef-906f-4282-a601-c280a113905d): created successfully Jul 07 17:41:15 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-efa062cf-ccdf-4736-aefd-3285b3618fd2 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b70c515-3a56-40b7-bde1-812450be14f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:15 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-efa062cf-ccdf-4736-aefd-3285b3618fd2 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Flow 'volume_create_manager' (875c169f-75d0-48de-8f08-d3e415cafbac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:15 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-efa062cf-ccdf-4736-aefd-3285b3618fd2 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Created volume successfully. Jul 07 17:41:15 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-e37c775e-5aac-42ff-a839-df0873790e2e tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Acquiring lock "cinder-497bb435-d98f-46e3-b69d-8fe7f3034317-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:15 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-e37c775e-5aac-42ff-a839-df0873790e2e tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Lock "cinder-497bb435-d98f-46e3-b69d-8fe7f3034317-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:15 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-e37c775e-5aac-42ff-a839-df0873790e2e tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Acquiring lock "cinder-quobyte-497bb435-d98f-46e3-b69d-8fe7f3034317" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:15 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-e37c775e-5aac-42ff-a839-df0873790e2e tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Lock "cinder-quobyte-497bb435-d98f-46e3-b69d-8fe7f3034317" acquired by "delete_volume" :: waited 0.016s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:15 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f624a2-9dd4-4bbd-a17f-6a9ab7a927a2]: (4, 'raw') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e37c775e-5aac-42ff-a839-df0873790e2e tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-497bb435-d98f-46e3-b69d-8fe7f3034317 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:15 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-497bb435-d98f-46e3-b69d-8fe7f3034317 Jul 07 17:41:15 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:15 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9a34136c-3f97-4d6d-abde-571dfbbdd2d3 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5f69959e-e985-4373-94ac-d83cf85b3deb" returned: 0 in 0.754s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:15 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9a34136c-3f97-4d6d-abde-571dfbbdd2d3 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "cinder-quobyte-5f69959e-e985-4373-94ac-d83cf85b3deb" released by "delete_volume" :: held 1.743s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:16 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-9a34136c-3f97-4d6d-abde-571dfbbdd2d3 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Created reservations ['649d7046-1dfa-4a93-9620-2c3a0750fbbb', '7df270b6-6318-429b-ba12-774068eef904', 'a93664e9-51c4-4f48-b696-b653c3b862c1', '3de51d72-ebe4-41c5-9944-746b13d61f05'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:41:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9a34136c-3f97-4d6d-abde-571dfbbdd2d3 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9a34136c-3f97-4d6d-abde-571dfbbdd2d3 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:16 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-9a34136c-3f97-4d6d-abde-571dfbbdd2d3 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:16 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-9a34136c-3f97-4d6d-abde-571dfbbdd2d3 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9a34136c-3f97-4d6d-abde-571dfbbdd2d3 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9a34136c-3f97-4d6d-abde-571dfbbdd2d3 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:16 devstack sudo[105695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:41:16 devstack sudo[105695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:16 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-87f31221-5d93-4429-afd1-f483c3276601 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Acquiring lock "cinder-0965ef52-ecaf-4413-aca2-a14d38167f6d-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:16 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-87f31221-5d93-4429-afd1-f483c3276601 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "cinder-0965ef52-ecaf-4413-aca2-a14d38167f6d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:16 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-87f31221-5d93-4429-afd1-f483c3276601 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Acquiring lock "cinder-quobyte-0965ef52-ecaf-4413-aca2-a14d38167f6d" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:16 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-87f31221-5d93-4429-afd1-f483c3276601 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "cinder-quobyte-0965ef52-ecaf-4413-aca2-a14d38167f6d" acquired by "delete_volume" :: waited 0.029s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:16 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b755c7a3-283a-43a2-9362-0c126e0543ea]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-87f31221-5d93-4429-afd1-f483c3276601 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0965ef52-ecaf-4413-aca2-a14d38167f6d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:16 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2586666d-db8e-4d93-8144-13a96b536a1e tempest-CreateVolumesFromSnapshotTest-1739026630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7ad4f55-d720-42a9-9d29-9113cdaee017 1073741824" returned: 0 in 1.235s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2586666d-db8e-4d93-8144-13a96b536a1e tempest-CreateVolumesFromSnapshotTest-1739026630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7ad4f55-d720-42a9-9d29-9113cdaee017 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:16 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7ad4f55-d720-42a9-9d29-9113cdaee017 Jul 07 17:41:16 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:16 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0965ef52-ecaf-4413-aca2-a14d38167f6d Jul 07 17:41:16 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:17 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e37c775e-5aac-42ff-a839-df0873790e2e tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-497bb435-d98f-46e3-b69d-8fe7f3034317" returned: 0 in 1.191s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e37c775e-5aac-42ff-a839-df0873790e2e tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-497bb435-d98f-46e3-b69d-8fe7f3034317 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:17 devstack sudo[105695]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9a34136c-3f97-4d6d-abde-571dfbbdd2d3 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 1.065s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:17 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-9a34136c-3f97-4d6d-abde-571dfbbdd2d3 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:41:17 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-497bb435-d98f-46e3-b69d-8fe7f3034317 Jul 07 17:41:17 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:17 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-9a34136c-3f97-4d6d-abde-571dfbbdd2d3 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Deleted volume successfully. Jul 07 17:41:17 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-9a34136c-3f97-4d6d-abde-571dfbbdd2d3 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "cinder-5f69959e-e985-4373-94ac-d83cf85b3deb-delete_volume" released by "delete_volume" :: held 3.127s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:17 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2586666d-db8e-4d93-8144-13a96b536a1e tempest-CreateVolumesFromSnapshotTest-1739026630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7ad4f55-d720-42a9-9d29-9113cdaee017" returned: 0 in 0.857s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:17 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-2586666d-db8e-4d93-8144-13a96b536a1e tempest-CreateVolumesFromSnapshotTest-1739026630 None] <== create_volume: return (2163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:41:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-2586666d-db8e-4d93-8144-13a96b536a1e tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.170s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-8115c3b4-065a-4473-9d20-b73b2970925b tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.171s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:17 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-8115c3b4-065a-4473-9d20-b73b2970925b tempest-CreateVolumesFromSnapshotTest-1739026630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1894166460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb7e6f56-fb5b-4dbf-a217-663efa646c7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eb07bf8e6b149efb4f3bbea9a3719ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:06Z,use_quota=True,user_id='9a7839e972e54d85bdeae85e261da377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:41:17 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-8115c3b4-065a-4473-9d20-b73b2970925b tempest-CreateVolumesFromSnapshotTest-1739026630 None] Creating volume cb7e6f56-fb5b-4dbf-a217-663efa646c7c {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:41:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-8115c3b4-065a-4473-9d20-b73b2970925b tempest-CreateVolumesFromSnapshotTest-1739026630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-8115c3b4-065a-4473-9d20-b73b2970925b tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:17 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-8115c3b4-065a-4473-9d20-b73b2970925b tempest-CreateVolumesFromSnapshotTest-1739026630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:17 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-8115c3b4-065a-4473-9d20-b73b2970925b tempest-CreateVolumesFromSnapshotTest-1739026630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-8115c3b4-065a-4473-9d20-b73b2970925b tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:17 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-8115c3b4-065a-4473-9d20-b73b2970925b tempest-CreateVolumesFromSnapshotTest-1739026630 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:41:17 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-8115c3b4-065a-4473-9d20-b73b2970925b tempest-CreateVolumesFromSnapshotTest-1739026630 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:41:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8115c3b4-065a-4473-9d20-b73b2970925b tempest-CreateVolumesFromSnapshotTest-1739026630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cb7e6f56-fb5b-4dbf-a217-663efa646c7c 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:17 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cb7e6f56-fb5b-4dbf-a217-663efa646c7c 1073741824 Jul 07 17:41:17 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:17 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-2586666d-db8e-4d93-8144-13a96b536a1e tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daf2ad3c-44fc-4611-ac90-5e7f6effcc83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7ad4f55-d720-42a9-9d29-9113cdaee017', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:17 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-2586666d-db8e-4d93-8144-13a96b536a1e tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb15ee81-b3ee-4a51-a6a3-caf1aa900acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:17 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-87f31221-5d93-4429-afd1-f483c3276601 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0965ef52-ecaf-4413-aca2-a14d38167f6d" returned: 0 in 1.094s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-87f31221-5d93-4429-afd1-f483c3276601 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0965ef52-ecaf-4413-aca2-a14d38167f6d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:17 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-2586666d-db8e-4d93-8144-13a96b536a1e tempest-CreateVolumesFromSnapshotTest-1739026630 None] Volume volume-d7ad4f55-d720-42a9-9d29-9113cdaee017 (d7ad4f55-d720-42a9-9d29-9113cdaee017): created successfully Jul 07 17:41:17 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-2586666d-db8e-4d93-8144-13a96b536a1e tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb15ee81-b3ee-4a51-a6a3-caf1aa900acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:17 devstack sudo[105717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0965ef52-ecaf-4413-aca2-a14d38167f6d Jul 07 17:41:17 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:17 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-2586666d-db8e-4d93-8144-13a96b536a1e tempest-CreateVolumesFromSnapshotTest-1739026630 None] Flow 'volume_create_manager' (aae837f9-1da1-4f53-ab31-bf747faeefbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:17 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-2586666d-db8e-4d93-8144-13a96b536a1e tempest-CreateVolumesFromSnapshotTest-1739026630 None] Created volume successfully. Jul 07 17:41:18 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e37c775e-5aac-42ff-a839-df0873790e2e tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-497bb435-d98f-46e3-b69d-8fe7f3034317" returned: 1 in 1.130s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e37c775e-5aac-42ff-a839-df0873790e2e tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-497bb435-d98f-46e3-b69d-8fe7f3034317' failed. Not Retrying. {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:41:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e37c775e-5aac-42ff-a839-df0873790e2e tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-497bb435-d98f-46e3-b69d-8fe7f3034317 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:18 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-497bb435-d98f-46e3-b69d-8fe7f3034317 Jul 07 17:41:18 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:18 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-87f31221-5d93-4429-afd1-f483c3276601 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0965ef52-ecaf-4413-aca2-a14d38167f6d" returned: 0 in 0.782s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:18 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-87f31221-5d93-4429-afd1-f483c3276601 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "cinder-quobyte-0965ef52-ecaf-4413-aca2-a14d38167f6d" released by "delete_volume" :: held 1.963s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:18 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-87f31221-5d93-4429-afd1-f483c3276601 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Created reservations ['feaef1d3-453e-459c-b538-f28750e3d364', '2b56c7c2-0056-4237-86ba-96640b301e4f', '6f03b81a-97d9-4ffc-b774-c0dc24f9e9ca', '820ed643-9d19-46a8-afe9-193a32b029e5'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:41:18 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8115c3b4-065a-4473-9d20-b73b2970925b tempest-CreateVolumesFromSnapshotTest-1739026630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cb7e6f56-fb5b-4dbf-a217-663efa646c7c 1073741824" returned: 0 in 1.070s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-87f31221-5d93-4429-afd1-f483c3276601 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-87f31221-5d93-4429-afd1-f483c3276601 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:18 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-87f31221-5d93-4429-afd1-f483c3276601 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:18 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-87f31221-5d93-4429-afd1-f483c3276601 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-87f31221-5d93-4429-afd1-f483c3276601 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-87f31221-5d93-4429-afd1-f483c3276601 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8115c3b4-065a-4473-9d20-b73b2970925b tempest-CreateVolumesFromSnapshotTest-1739026630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cb7e6f56-fb5b-4dbf-a217-663efa646c7c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:18 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:41:18 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:18 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-254c471d-6777-496c-ab7c-7940ae23db6b tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Acquiring lock "cinder-0bde11ef-8472-4f9f-a0d0-e757f3cd1b24-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:18 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cb7e6f56-fb5b-4dbf-a217-663efa646c7c Jul 07 17:41:18 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:18 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-254c471d-6777-496c-ab7c-7940ae23db6b tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "cinder-0bde11ef-8472-4f9f-a0d0-e757f3cd1b24-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:18 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e37c775e-5aac-42ff-a839-df0873790e2e tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-497bb435-d98f-46e3-b69d-8fe7f3034317" returned: 0 in 0.743s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:18 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-e37c775e-5aac-42ff-a839-df0873790e2e tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Lock "cinder-quobyte-497bb435-d98f-46e3-b69d-8fe7f3034317" released by "delete_volume" :: held 3.163s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:18 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-254c471d-6777-496c-ab7c-7940ae23db6b tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Acquiring lock "cinder-quobyte-0bde11ef-8472-4f9f-a0d0-e757f3cd1b24" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:18 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-254c471d-6777-496c-ab7c-7940ae23db6b tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "cinder-quobyte-0bde11ef-8472-4f9f-a0d0-e757f3cd1b24" acquired by "delete_volume" :: waited 0.028s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:19 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6cf1fe-88ce-4b09-befc-b123f5fd4d72]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-254c471d-6777-496c-ab7c-7940ae23db6b tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0bde11ef-8472-4f9f-a0d0-e757f3cd1b24 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:19 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-e37c775e-5aac-42ff-a839-df0873790e2e tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Created reservations ['0634adcc-6f77-4569-a09f-9208a740fed5', 'ca76113f-9ed1-487a-adc0-0c49060adb88', '80875ee4-8b28-44d9-8da1-8856d6f47d51', 'c18432d3-28bc-4ae2-bbab-ab99896e360d'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:41:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e37c775e-5aac-42ff-a839-df0873790e2e tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e37c775e-5aac-42ff-a839-df0873790e2e tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:19 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-e37c775e-5aac-42ff-a839-df0873790e2e tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:19 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-e37c775e-5aac-42ff-a839-df0873790e2e tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e37c775e-5aac-42ff-a839-df0873790e2e tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e37c775e-5aac-42ff-a839-df0873790e2e tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:19 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:41:19 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:19 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0bde11ef-8472-4f9f-a0d0-e757f3cd1b24 Jul 07 17:41:19 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:19 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-87f31221-5d93-4429-afd1-f483c3276601 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 1.036s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:19 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-87f31221-5d93-4429-afd1-f483c3276601 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:41:19 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-87f31221-5d93-4429-afd1-f483c3276601 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Deleted volume successfully. Jul 07 17:41:19 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8115c3b4-065a-4473-9d20-b73b2970925b tempest-CreateVolumesFromSnapshotTest-1739026630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cb7e6f56-fb5b-4dbf-a217-663efa646c7c" returned: 0 in 1.042s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:19 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-8115c3b4-065a-4473-9d20-b73b2970925b tempest-CreateVolumesFromSnapshotTest-1739026630 None] <== create_volume: return (2224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:41:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-8115c3b4-065a-4473-9d20-b73b2970925b tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.226s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:19 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-87f31221-5d93-4429-afd1-f483c3276601 tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "cinder-0965ef52-ecaf-4413-aca2-a14d38167f6d-delete_volume" released by "delete_volume" :: held 3.377s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:19 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-8115c3b4-065a-4473-9d20-b73b2970925b tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (224a76c2-14d3-484c-aabb-7554aad92ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb7e6f56-fb5b-4dbf-a217-663efa646c7c', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:19 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-8115c3b4-065a-4473-9d20-b73b2970925b tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (044e86d8-8c04-48cf-b99d-b685c960b341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:19 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-8115c3b4-065a-4473-9d20-b73b2970925b tempest-CreateVolumesFromSnapshotTest-1739026630 None] Volume volume-cb7e6f56-fb5b-4dbf-a217-663efa646c7c (cb7e6f56-fb5b-4dbf-a217-663efa646c7c): created successfully Jul 07 17:41:19 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-8115c3b4-065a-4473-9d20-b73b2970925b tempest-CreateVolumesFromSnapshotTest-1739026630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (044e86d8-8c04-48cf-b99d-b685c960b341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:19 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-8115c3b4-065a-4473-9d20-b73b2970925b tempest-CreateVolumesFromSnapshotTest-1739026630 None] Flow 'volume_create_manager' (237297a5-1d22-4dd8-a0f6-8f4e1cd04102) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:19 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-8115c3b4-065a-4473-9d20-b73b2970925b tempest-CreateVolumesFromSnapshotTest-1739026630 None] Created volume successfully. Jul 07 17:41:20 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e37c775e-5aac-42ff-a839-df0873790e2e tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.887s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:20 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-e37c775e-5aac-42ff-a839-df0873790e2e tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:41:20 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-e37c775e-5aac-42ff-a839-df0873790e2e tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Deleted volume successfully. Jul 07 17:41:20 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-e37c775e-5aac-42ff-a839-df0873790e2e tempest-VolumeAndVolumeTypeFromImageTest-185081455 None] Lock "cinder-497bb435-d98f-46e3-b69d-8fe7f3034317-delete_volume" released by "delete_volume" :: held 4.431s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:20 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-254c471d-6777-496c-ab7c-7940ae23db6b tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0bde11ef-8472-4f9f-a0d0-e757f3cd1b24" returned: 0 in 1.194s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-254c471d-6777-496c-ab7c-7940ae23db6b tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0bde11ef-8472-4f9f-a0d0-e757f3cd1b24 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:20 devstack sudo[105778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0bde11ef-8472-4f9f-a0d0-e757f3cd1b24 Jul 07 17:41:20 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:20 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-667c07c0-70ba-435b-857e-d6b1538253b6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Acquiring lock "cinder-cb7e6f56-fb5b-4dbf-a217-663efa646c7c-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:20 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-667c07c0-70ba-435b-857e-d6b1538253b6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "cinder-cb7e6f56-fb5b-4dbf-a217-663efa646c7c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:20 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-667c07c0-70ba-435b-857e-d6b1538253b6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Acquiring lock "cinder-quobyte-cb7e6f56-fb5b-4dbf-a217-663efa646c7c" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:21 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-667c07c0-70ba-435b-857e-d6b1538253b6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "cinder-quobyte-cb7e6f56-fb5b-4dbf-a217-663efa646c7c" acquired by "delete_volume" :: waited 0.019s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:21 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f0bf9a-4c65-4b8c-aba4-67ebaba593fb]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-667c07c0-70ba-435b-857e-d6b1538253b6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cb7e6f56-fb5b-4dbf-a217-663efa646c7c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:21 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-254c471d-6777-496c-ab7c-7940ae23db6b tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0bde11ef-8472-4f9f-a0d0-e757f3cd1b24" returned: 0 in 0.851s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:21 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-254c471d-6777-496c-ab7c-7940ae23db6b tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "cinder-quobyte-0bde11ef-8472-4f9f-a0d0-e757f3cd1b24" released by "delete_volume" :: held 2.114s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:21 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-254c471d-6777-496c-ab7c-7940ae23db6b tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Created reservations ['871b82f3-5c61-4fb3-9d38-3d34651326b1', '5136a497-1577-4bc1-a5e9-acf0fdbc9218', 'e946ddcd-812c-4770-a50e-12e3b4bb3d5f', 'dfcb10d9-5369-47a2-a895-8f2421ed1409'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:41:21 devstack sudo[105785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cb7e6f56-fb5b-4dbf-a217-663efa646c7c Jul 07 17:41:21 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-254c471d-6777-496c-ab7c-7940ae23db6b tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-254c471d-6777-496c-ab7c-7940ae23db6b tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:21 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-254c471d-6777-496c-ab7c-7940ae23db6b tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:21 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-254c471d-6777-496c-ab7c-7940ae23db6b tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-254c471d-6777-496c-ab7c-7940ae23db6b tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-254c471d-6777-496c-ab7c-7940ae23db6b tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:21 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:41:21 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:22 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-667c07c0-70ba-435b-857e-d6b1538253b6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cb7e6f56-fb5b-4dbf-a217-663efa646c7c" returned: 0 in 1.084s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-667c07c0-70ba-435b-857e-d6b1538253b6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cb7e6f56-fb5b-4dbf-a217-663efa646c7c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:22 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-254c471d-6777-496c-ab7c-7940ae23db6b tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.908s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:22 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-254c471d-6777-496c-ab7c-7940ae23db6b tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:41:22 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-254c471d-6777-496c-ab7c-7940ae23db6b tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Deleted volume successfully. Jul 07 17:41:22 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cb7e6f56-fb5b-4dbf-a217-663efa646c7c Jul 07 17:41:22 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:22 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-254c471d-6777-496c-ab7c-7940ae23db6b tempest-CreateVolumesFromSourceVolumeTest-1540642946 None] Lock "cinder-0bde11ef-8472-4f9f-a0d0-e757f3cd1b24-delete_volume" released by "delete_volume" :: held 3.337s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:23 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-667c07c0-70ba-435b-857e-d6b1538253b6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cb7e6f56-fb5b-4dbf-a217-663efa646c7c" returned: 0 in 0.966s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:23 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-667c07c0-70ba-435b-857e-d6b1538253b6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "cinder-quobyte-cb7e6f56-fb5b-4dbf-a217-663efa646c7c" released by "delete_volume" :: held 2.107s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:23 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-667c07c0-70ba-435b-857e-d6b1538253b6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Created reservations ['b835dff9-e308-4bf3-bd05-67f6591f6815', 'dcf63106-406b-4dc3-9c66-39a46eda8ef0', '73373f8e-c89c-476d-b7d1-a3b8352593c5', '42616a78-794e-4aa1-887e-7c7758f4a60b'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:41:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-667c07c0-70ba-435b-857e-d6b1538253b6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-667c07c0-70ba-435b-857e-d6b1538253b6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:23 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-667c07c0-70ba-435b-857e-d6b1538253b6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:23 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-667c07c0-70ba-435b-857e-d6b1538253b6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-667c07c0-70ba-435b-857e-d6b1538253b6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-667c07c0-70ba-435b-857e-d6b1538253b6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:23 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:41:23 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:23 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-667c07c0-70ba-435b-857e-d6b1538253b6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.713s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:23 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-667c07c0-70ba-435b-857e-d6b1538253b6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:41:23 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-667c07c0-70ba-435b-857e-d6b1538253b6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Deleted volume successfully. Jul 07 17:41:24 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-667c07c0-70ba-435b-857e-d6b1538253b6 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "cinder-cb7e6f56-fb5b-4dbf-a217-663efa646c7c-delete_volume" released by "delete_volume" :: held 3.094s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:24 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3afc076a-4cf7-4093-a0b4-dacf60e635b3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Acquiring lock "cinder-d7ad4f55-d720-42a9-9d29-9113cdaee017-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:24 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3afc076a-4cf7-4093-a0b4-dacf60e635b3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "cinder-d7ad4f55-d720-42a9-9d29-9113cdaee017-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:24 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3afc076a-4cf7-4093-a0b4-dacf60e635b3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Acquiring lock "cinder-quobyte-d7ad4f55-d720-42a9-9d29-9113cdaee017" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:24 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3afc076a-4cf7-4093-a0b4-dacf60e635b3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "cinder-quobyte-d7ad4f55-d720-42a9-9d29-9113cdaee017" acquired by "delete_volume" :: waited 0.023s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:24 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[762fccfb-1ccb-4256-b4aa-c011e5e4ada1]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3afc076a-4cf7-4093-a0b4-dacf60e635b3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7ad4f55-d720-42a9-9d29-9113cdaee017 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:24 devstack sudo[105808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7ad4f55-d720-42a9-9d29-9113cdaee017 Jul 07 17:41:24 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:25 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3afc076a-4cf7-4093-a0b4-dacf60e635b3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7ad4f55-d720-42a9-9d29-9113cdaee017" returned: 0 in 1.042s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3afc076a-4cf7-4093-a0b4-dacf60e635b3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7ad4f55-d720-42a9-9d29-9113cdaee017 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:25 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7ad4f55-d720-42a9-9d29-9113cdaee017 Jul 07 17:41:25 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:26 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3afc076a-4cf7-4093-a0b4-dacf60e635b3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-d7ad4f55-d720-42a9-9d29-9113cdaee017" returned: 0 in 0.965s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:26 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3afc076a-4cf7-4093-a0b4-dacf60e635b3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "cinder-quobyte-d7ad4f55-d720-42a9-9d29-9113cdaee017" released by "delete_volume" :: held 2.057s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:26 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-3afc076a-4cf7-4093-a0b4-dacf60e635b3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Created reservations ['1fd33819-3cfe-4c15-8999-2ff704cb049f', 'f7e814e6-5e20-495c-a002-8d5cfe5bbf13', 'febb995c-91be-448a-bbb9-4b21eeb60109', '63fa740b-274c-4e30-b35c-eeff4899c4f6'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:41:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-3afc076a-4cf7-4093-a0b4-dacf60e635b3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-3afc076a-4cf7-4093-a0b4-dacf60e635b3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:26 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-3afc076a-4cf7-4093-a0b4-dacf60e635b3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:26 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-3afc076a-4cf7-4093-a0b4-dacf60e635b3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-3afc076a-4cf7-4093-a0b4-dacf60e635b3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3afc076a-4cf7-4093-a0b4-dacf60e635b3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:26 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:41:26 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:27 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b3d70cb-febe-4d13-b704-9647b6ab3acd tempest-CinderUnicodeTest-1153038688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:41:27 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-6b3d70cb-febe-4d13-b704-9647b6ab3acd tempest-CinderUnicodeTest-1153038688 None] Flow 'volume_create_manager' (9c94cf41-d3cc-4d6c-aaec-8bb114e3bd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:27 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-6b3d70cb-febe-4d13-b704-9647b6ab3acd tempest-CinderUnicodeTest-1153038688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c76a8093-5730-4888-8cc1-1cfaf9e9bf66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:27 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-6b3d70cb-febe-4d13-b704-9647b6ab3acd tempest-CinderUnicodeTest-1153038688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c76a8093-5730-4888-8cc1-1cfaf9e9bf66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c06e66f-ea13-446a-bf5c-a437ab7c70c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35df88b117074e8b8341079d8e579183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:27Z,use_quota=True,user_id='1d785ce28ec247ce84cbb0cb59e6d424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:27 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-6b3d70cb-febe-4d13-b704-9647b6ab3acd tempest-CinderUnicodeTest-1153038688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc1487ba-cd5e-4dde-a29b-c06b822d5a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:27 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-6b3d70cb-febe-4d13-b704-9647b6ab3acd tempest-CinderUnicodeTest-1153038688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc1487ba-cd5e-4dde-a29b-c06b822d5a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:27 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-6b3d70cb-febe-4d13-b704-9647b6ab3acd tempest-CinderUnicodeTest-1153038688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96ca3442-66b5-4f27-a38a-73ba7cbd98b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:27 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-6b3d70cb-febe-4d13-b704-9647b6ab3acd tempest-CinderUnicodeTest-1153038688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96ca3442-66b5-4f27-a38a-73ba7cbd98b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c06e66f-ea13-446a-bf5c-a437ab7c70c5', 'volume_name': 'volume-9c06e66f-ea13-446a-bf5c-a437ab7c70c5', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:27 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-6b3d70cb-febe-4d13-b704-9647b6ab3acd tempest-CinderUnicodeTest-1153038688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfcc28d8-682c-4f2f-8d6e-12a403ed90e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:27 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-6b3d70cb-febe-4d13-b704-9647b6ab3acd tempest-CinderUnicodeTest-1153038688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfcc28d8-682c-4f2f-8d6e-12a403ed90e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:27 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-6b3d70cb-febe-4d13-b704-9647b6ab3acd tempest-CinderUnicodeTest-1153038688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67c8b2ed-f222-4446-b559-6dac66a1fcf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:27 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-6b3d70cb-febe-4d13-b704-9647b6ab3acd tempest-CinderUnicodeTest-1153038688 None] Volume 9c06e66f-ea13-446a-bf5c-a437ab7c70c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c06e66f-ea13-446a-bf5c-a437ab7c70c5', 'volume_size': 1} Jul 07 17:41:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-6b3d70cb-febe-4d13-b704-9647b6ab3acd tempest-CinderUnicodeTest-1153038688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-6b3d70cb-febe-4d13-b704-9647b6ab3acd tempest-CinderUnicodeTest-1153038688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:27 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-6b3d70cb-febe-4d13-b704-9647b6ab3acd tempest-CinderUnicodeTest-1153038688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c06e66f-ea13-446a-bf5c-a437ab7c70c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35df88b117074e8b8341079d8e579183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:27Z,use_quota=True,user_id='1d785ce28ec247ce84cbb0cb59e6d424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:41:27 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-6b3d70cb-febe-4d13-b704-9647b6ab3acd tempest-CinderUnicodeTest-1153038688 None] Creating volume 9c06e66f-ea13-446a-bf5c-a437ab7c70c5 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:41:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-6b3d70cb-febe-4d13-b704-9647b6ab3acd tempest-CinderUnicodeTest-1153038688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-6b3d70cb-febe-4d13-b704-9647b6ab3acd tempest-CinderUnicodeTest-1153038688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:27 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-6b3d70cb-febe-4d13-b704-9647b6ab3acd tempest-CinderUnicodeTest-1153038688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:27 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-6b3d70cb-febe-4d13-b704-9647b6ab3acd tempest-CinderUnicodeTest-1153038688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-6b3d70cb-febe-4d13-b704-9647b6ab3acd tempest-CinderUnicodeTest-1153038688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:27 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-6b3d70cb-febe-4d13-b704-9647b6ab3acd tempest-CinderUnicodeTest-1153038688 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:41:27 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-6b3d70cb-febe-4d13-b704-9647b6ab3acd tempest-CinderUnicodeTest-1153038688 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:41:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6b3d70cb-febe-4d13-b704-9647b6ab3acd tempest-CinderUnicodeTest-1153038688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-9c06e66f-ea13-446a-bf5c-a437ab7c70c5 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:27 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-9c06e66f-ea13-446a-bf5c-a437ab7c70c5 1073741824 Jul 07 17:41:27 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:27 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3afc076a-4cf7-4093-a0b4-dacf60e635b3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.898s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:27 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-3afc076a-4cf7-4093-a0b4-dacf60e635b3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:41:27 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-3afc076a-4cf7-4093-a0b4-dacf60e635b3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Deleted volume successfully. Jul 07 17:41:27 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3afc076a-4cf7-4093-a0b4-dacf60e635b3 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "cinder-d7ad4f55-d720-42a9-9d29-9113cdaee017-delete_volume" released by "delete_volume" :: held 3.397s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:27 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-31500cf3-4c0e-4d82-b87e-aad067820798 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Acquiring lock "cinder-5c5e94ef-906f-4282-a601-c280a113905d-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:27 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-31500cf3-4c0e-4d82-b87e-aad067820798 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "cinder-5c5e94ef-906f-4282-a601-c280a113905d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:27 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-31500cf3-4c0e-4d82-b87e-aad067820798 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Acquiring lock "cinder-quobyte-5c5e94ef-906f-4282-a601-c280a113905d" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:27 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-31500cf3-4c0e-4d82-b87e-aad067820798 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "cinder-quobyte-5c5e94ef-906f-4282-a601-c280a113905d" acquired by "delete_volume" :: waited 0.033s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:28 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e77225c-b986-4d6e-8a6e-776c4f0baaf1]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-31500cf3-4c0e-4d82-b87e-aad067820798 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c5e94ef-906f-4282-a601-c280a113905d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:28 devstack sudo[105821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c5e94ef-906f-4282-a601-c280a113905d Jul 07 17:41:28 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:28 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-55de05a3-c7ac-4fe4-a884-52a5a3bab621 tempest-CreateVolumesFromImageTest-1508703777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:41:28 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-55de05a3-c7ac-4fe4-a884-52a5a3bab621 tempest-CreateVolumesFromImageTest-1508703777 None] Flow 'volume_create_manager' (ecab715d-219e-4929-a08d-5ee878ebba5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:28 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-55de05a3-c7ac-4fe4-a884-52a5a3bab621 tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59e2ae87-98ec-4c50-bf84-2b5047ee314c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:28 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-55de05a3-c7ac-4fe4-a884-52a5a3bab621 tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59e2ae87-98ec-4c50-bf84-2b5047ee314c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-48951226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a77d2aaf-d510-42b1-9e0d-2ba870ef055b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf3f015746e543b48bc5f4f27deca6ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:28Z,use_quota=True,user_id='0ab6f04f57a44a87aedad1410833a2fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:28 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-55de05a3-c7ac-4fe4-a884-52a5a3bab621 tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69efe52d-78e1-4403-bffe-52e8bc540999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:28 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-55de05a3-c7ac-4fe4-a884-52a5a3bab621 tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69efe52d-78e1-4403-bffe-52e8bc540999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:28 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-55de05a3-c7ac-4fe4-a884-52a5a3bab621 tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57c459c5-29fe-43cd-a666-117a4fa16b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:28 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-55de05a3-c7ac-4fe4-a884-52a5a3bab621 tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57c459c5-29fe-43cd-a666-117a4fa16b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a77d2aaf-d510-42b1-9e0d-2ba870ef055b', 'volume_name': 'volume-a77d2aaf-d510-42b1-9e0d-2ba870ef055b', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:28 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-55de05a3-c7ac-4fe4-a884-52a5a3bab621 tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c84676c1-eb4c-4469-9595-99405c7408e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:28 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-55de05a3-c7ac-4fe4-a884-52a5a3bab621 tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c84676c1-eb4c-4469-9595-99405c7408e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:28 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-55de05a3-c7ac-4fe4-a884-52a5a3bab621 tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (091e6d1b-8c44-48d2-b7ea-baa8d7d477a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:28 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-55de05a3-c7ac-4fe4-a884-52a5a3bab621 tempest-CreateVolumesFromImageTest-1508703777 None] Volume a77d2aaf-d510-42b1-9e0d-2ba870ef055b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a77d2aaf-d510-42b1-9e0d-2ba870ef055b', 'volume_size': 1} Jul 07 17:41:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-55de05a3-c7ac-4fe4-a884-52a5a3bab621 tempest-CreateVolumesFromImageTest-1508703777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:28 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6b3d70cb-febe-4d13-b704-9647b6ab3acd tempest-CinderUnicodeTest-1153038688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-9c06e66f-ea13-446a-bf5c-a437ab7c70c5 1073741824" returned: 0 in 1.277s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6b3d70cb-febe-4d13-b704-9647b6ab3acd tempest-CinderUnicodeTest-1153038688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-9c06e66f-ea13-446a-bf5c-a437ab7c70c5 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:28 devstack sudo[105826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-9c06e66f-ea13-446a-bf5c-a437ab7c70c5 Jul 07 17:41:28 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:29 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc3517a0-69d2-4467-ba5b-ae07dab2189c tempest-CreateVolumesFromImageTest-1508703777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:41:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-cc3517a0-69d2-4467-ba5b-ae07dab2189c tempest-CreateVolumesFromImageTest-1508703777 None] Flow 'volume_create_manager' (1edc15bb-df3c-410c-889c-36dea8bc9d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-cc3517a0-69d2-4467-ba5b-ae07dab2189c tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecd5fc4d-03cb-4136-af1b-080815dec97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-cc3517a0-69d2-4467-ba5b-ae07dab2189c tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecd5fc4d-03cb-4136-af1b-080815dec97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2108883127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0489535a-05e2-41c3-8f27-a7a649ed13c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf3f015746e543b48bc5f4f27deca6ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:29Z,use_quota=True,user_id='0ab6f04f57a44a87aedad1410833a2fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-cc3517a0-69d2-4467-ba5b-ae07dab2189c tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6546a2b2-1ece-4ea6-892a-1ee3985f979f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-cc3517a0-69d2-4467-ba5b-ae07dab2189c tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6546a2b2-1ece-4ea6-892a-1ee3985f979f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-cc3517a0-69d2-4467-ba5b-ae07dab2189c tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f394fbe0-f00b-4702-a637-b75fd540a919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-cc3517a0-69d2-4467-ba5b-ae07dab2189c tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f394fbe0-f00b-4702-a637-b75fd540a919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0489535a-05e2-41c3-8f27-a7a649ed13c9', 'volume_name': 'volume-0489535a-05e2-41c3-8f27-a7a649ed13c9', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-cc3517a0-69d2-4467-ba5b-ae07dab2189c tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9445957e-bafb-4efe-baba-a676dc4ac7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-cc3517a0-69d2-4467-ba5b-ae07dab2189c tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9445957e-bafb-4efe-baba-a676dc4ac7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-cc3517a0-69d2-4467-ba5b-ae07dab2189c tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8c4a71c-79ff-4f6d-9094-a08e0dae8f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:29 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-cc3517a0-69d2-4467-ba5b-ae07dab2189c tempest-CreateVolumesFromImageTest-1508703777 None] Volume 0489535a-05e2-41c3-8f27-a7a649ed13c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0489535a-05e2-41c3-8f27-a7a649ed13c9', 'volume_size': 1} Jul 07 17:41:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-cc3517a0-69d2-4467-ba5b-ae07dab2189c tempest-CreateVolumesFromImageTest-1508703777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:29 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-31500cf3-4c0e-4d82-b87e-aad067820798 tempest-CreateVolumesFromSnapshotTest-1739026630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c5e94ef-906f-4282-a601-c280a113905d" returned: 0 in 1.427s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-31500cf3-4c0e-4d82-b87e-aad067820798 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c5e94ef-906f-4282-a601-c280a113905d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:29 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c5e94ef-906f-4282-a601-c280a113905d Jul 07 17:41:29 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:29 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-87f1ab88-1fc3-4eb4-925d-9438bf5c3597 tempest-CreateVolumesFromImageTest-1508703777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:41:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-87f1ab88-1fc3-4eb4-925d-9438bf5c3597 tempest-CreateVolumesFromImageTest-1508703777 None] Flow 'volume_create_manager' (592c2866-7321-4d02-93e2-873ea9ea9e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-87f1ab88-1fc3-4eb4-925d-9438bf5c3597 tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79235c13-a541-403b-84a7-cc8080deaca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-87f1ab88-1fc3-4eb4-925d-9438bf5c3597 tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79235c13-a541-403b-84a7-cc8080deaca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1248628166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0657ac7c-aac0-44c0-ab97-d4630a3332e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf3f015746e543b48bc5f4f27deca6ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:30Z,use_quota=True,user_id='0ab6f04f57a44a87aedad1410833a2fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-87f1ab88-1fc3-4eb4-925d-9438bf5c3597 tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3efaf5cc-4f3d-4a41-8e91-4c27ed5d734e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-87f1ab88-1fc3-4eb4-925d-9438bf5c3597 tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3efaf5cc-4f3d-4a41-8e91-4c27ed5d734e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-87f1ab88-1fc3-4eb4-925d-9438bf5c3597 tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84815f23-6013-4e28-9e37-8fd7d1109cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-87f1ab88-1fc3-4eb4-925d-9438bf5c3597 tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84815f23-6013-4e28-9e37-8fd7d1109cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0657ac7c-aac0-44c0-ab97-d4630a3332e3', 'volume_name': 'volume-0657ac7c-aac0-44c0-ab97-d4630a3332e3', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-87f1ab88-1fc3-4eb4-925d-9438bf5c3597 tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0337f60c-716c-40f4-8d58-876ea1173cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-87f1ab88-1fc3-4eb4-925d-9438bf5c3597 tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0337f60c-716c-40f4-8d58-876ea1173cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-87f1ab88-1fc3-4eb4-925d-9438bf5c3597 tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f491644f-d59e-485b-88ba-a16a9229f962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:29 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-87f1ab88-1fc3-4eb4-925d-9438bf5c3597 tempest-CreateVolumesFromImageTest-1508703777 None] Volume 0657ac7c-aac0-44c0-ab97-d4630a3332e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0657ac7c-aac0-44c0-ab97-d4630a3332e3', 'volume_size': 1} Jul 07 17:41:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-87f1ab88-1fc3-4eb4-925d-9438bf5c3597 tempest-CreateVolumesFromImageTest-1508703777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:29 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6b3d70cb-febe-4d13-b704-9647b6ab3acd tempest-CinderUnicodeTest-1153038688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-9c06e66f-ea13-446a-bf5c-a437ab7c70c5" returned: 0 in 1.038s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:29 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-6b3d70cb-febe-4d13-b704-9647b6ab3acd tempest-CinderUnicodeTest-1153038688 None] <== create_volume: return (2389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:41:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-6b3d70cb-febe-4d13-b704-9647b6ab3acd tempest-CinderUnicodeTest-1153038688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.392s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-55de05a3-c7ac-4fe4-a884-52a5a3bab621 tempest-CreateVolumesFromImageTest-1508703777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.132s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:29 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-55de05a3-c7ac-4fe4-a884-52a5a3bab621 tempest-CreateVolumesFromImageTest-1508703777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-48951226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a77d2aaf-d510-42b1-9e0d-2ba870ef055b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf3f015746e543b48bc5f4f27deca6ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:28Z,use_quota=True,user_id='0ab6f04f57a44a87aedad1410833a2fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:41:29 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-55de05a3-c7ac-4fe4-a884-52a5a3bab621 tempest-CreateVolumesFromImageTest-1508703777 None] Creating volume a77d2aaf-d510-42b1-9e0d-2ba870ef055b {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:41:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-55de05a3-c7ac-4fe4-a884-52a5a3bab621 tempest-CreateVolumesFromImageTest-1508703777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-55de05a3-c7ac-4fe4-a884-52a5a3bab621 tempest-CreateVolumesFromImageTest-1508703777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:29 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-55de05a3-c7ac-4fe4-a884-52a5a3bab621 tempest-CreateVolumesFromImageTest-1508703777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:29 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-55de05a3-c7ac-4fe4-a884-52a5a3bab621 tempest-CreateVolumesFromImageTest-1508703777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-55de05a3-c7ac-4fe4-a884-52a5a3bab621 tempest-CreateVolumesFromImageTest-1508703777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:29 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-55de05a3-c7ac-4fe4-a884-52a5a3bab621 tempest-CreateVolumesFromImageTest-1508703777 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:41:29 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-55de05a3-c7ac-4fe4-a884-52a5a3bab621 tempest-CreateVolumesFromImageTest-1508703777 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:41:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-55de05a3-c7ac-4fe4-a884-52a5a3bab621 tempest-CreateVolumesFromImageTest-1508703777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a77d2aaf-d510-42b1-9e0d-2ba870ef055b 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-6b3d70cb-febe-4d13-b704-9647b6ab3acd tempest-CinderUnicodeTest-1153038688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67c8b2ed-f222-4446-b559-6dac66a1fcf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c06e66f-ea13-446a-bf5c-a437ab7c70c5', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:29 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a77d2aaf-d510-42b1-9e0d-2ba870ef055b 1073741824 Jul 07 17:41:29 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-6b3d70cb-febe-4d13-b704-9647b6ab3acd tempest-CinderUnicodeTest-1153038688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c88a559c-f7b4-4f63-a1ef-94b14d625744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:29 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-6b3d70cb-febe-4d13-b704-9647b6ab3acd tempest-CinderUnicodeTest-1153038688 None] Volume volume-9c06e66f-ea13-446a-bf5c-a437ab7c70c5 (9c06e66f-ea13-446a-bf5c-a437ab7c70c5): created successfully Jul 07 17:41:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-6b3d70cb-febe-4d13-b704-9647b6ab3acd tempest-CinderUnicodeTest-1153038688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c88a559c-f7b4-4f63-a1ef-94b14d625744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:29 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-6b3d70cb-febe-4d13-b704-9647b6ab3acd tempest-CinderUnicodeTest-1153038688 None] Flow 'volume_create_manager' (9c94cf41-d3cc-4d6c-aaec-8bb114e3bd8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:29 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-6b3d70cb-febe-4d13-b704-9647b6ab3acd tempest-CinderUnicodeTest-1153038688 None] Created volume successfully. Jul 07 17:41:30 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-e16210f3-9276-4561-9986-6de105ea70ae tempest-CreateVolumesFromImageTest-1508703777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:41:30 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e16210f3-9276-4561-9986-6de105ea70ae tempest-CreateVolumesFromImageTest-1508703777 None] Flow 'volume_create_manager' (32c88ec2-34ba-48bb-84f2-670fae54bc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:30 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e16210f3-9276-4561-9986-6de105ea70ae tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4206104-7099-469d-81a3-67e88d1c5819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:30 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e16210f3-9276-4561-9986-6de105ea70ae tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4206104-7099-469d-81a3-67e88d1c5819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1837809492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfb67a36-efcd-4dc3-a08b-5526404453b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf3f015746e543b48bc5f4f27deca6ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:30Z,use_quota=True,user_id='0ab6f04f57a44a87aedad1410833a2fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:30 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e16210f3-9276-4561-9986-6de105ea70ae tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d66c5f1-3a1c-4753-ba43-57533c77de34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:30 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e16210f3-9276-4561-9986-6de105ea70ae tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d66c5f1-3a1c-4753-ba43-57533c77de34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:30 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e16210f3-9276-4561-9986-6de105ea70ae tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ffd01ff-0432-4f30-a0f6-3fc1fa295344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:30 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e16210f3-9276-4561-9986-6de105ea70ae tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ffd01ff-0432-4f30-a0f6-3fc1fa295344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfb67a36-efcd-4dc3-a08b-5526404453b5', 'volume_name': 'volume-dfb67a36-efcd-4dc3-a08b-5526404453b5', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:30 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e16210f3-9276-4561-9986-6de105ea70ae tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81ae20a1-2257-4de3-a800-63b7d2c9962b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:30 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e16210f3-9276-4561-9986-6de105ea70ae tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81ae20a1-2257-4de3-a800-63b7d2c9962b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:30 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e16210f3-9276-4561-9986-6de105ea70ae tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (235e7bba-3d9d-43fb-abc0-91bcae8ab8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:30 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-e16210f3-9276-4561-9986-6de105ea70ae tempest-CreateVolumesFromImageTest-1508703777 None] Volume dfb67a36-efcd-4dc3-a08b-5526404453b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfb67a36-efcd-4dc3-a08b-5526404453b5', 'volume_size': 1} Jul 07 17:41:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e16210f3-9276-4561-9986-6de105ea70ae tempest-CreateVolumesFromImageTest-1508703777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:30 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-31500cf3-4c0e-4d82-b87e-aad067820798 tempest-CreateVolumesFromSnapshotTest-1739026630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c5e94ef-906f-4282-a601-c280a113905d" returned: 0 in 1.095s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:30 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-31500cf3-4c0e-4d82-b87e-aad067820798 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "cinder-quobyte-5c5e94ef-906f-4282-a601-c280a113905d" released by "delete_volume" :: held 2.594s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:30 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-31500cf3-4c0e-4d82-b87e-aad067820798 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Created reservations ['c0d6808d-ad74-4b80-8b6c-05f86f2b3784', '61c9e833-186f-403c-bc82-a2f27de295b3', 'bbcf0395-18a3-4a22-8c85-d022d5d03fc2', '73dd9b7d-8162-432c-b332-b526e1845818'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:41:30 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-17d3cd74-8e06-4f7e-822e-e2ba01b2cef1 tempest-CreateVolumesFromImageTest-1508703777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:41:30 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-17d3cd74-8e06-4f7e-822e-e2ba01b2cef1 tempest-CreateVolumesFromImageTest-1508703777 None] Flow 'volume_create_manager' (b8a4ad0a-6f23-4329-a554-0051c285ea51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:30 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-17d3cd74-8e06-4f7e-822e-e2ba01b2cef1 tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7175132a-8e1e-47dd-8efe-e92aa189c7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-31500cf3-4c0e-4d82-b87e-aad067820798 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-31500cf3-4c0e-4d82-b87e-aad067820798 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:30 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-31500cf3-4c0e-4d82-b87e-aad067820798 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:30 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-31500cf3-4c0e-4d82-b87e-aad067820798 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-31500cf3-4c0e-4d82-b87e-aad067820798 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-31500cf3-4c0e-4d82-b87e-aad067820798 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:30 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-17d3cd74-8e06-4f7e-822e-e2ba01b2cef1 tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7175132a-8e1e-47dd-8efe-e92aa189c7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-375143783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa948294-5957-42f8-a4d8-2ed8ba6fdabc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf3f015746e543b48bc5f4f27deca6ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:31Z,use_quota=True,user_id='0ab6f04f57a44a87aedad1410833a2fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:30 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-17d3cd74-8e06-4f7e-822e-e2ba01b2cef1 tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d02a224a-92c6-47f8-b5eb-2758699ebe60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:30 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:41:30 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:30 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-17d3cd74-8e06-4f7e-822e-e2ba01b2cef1 tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d02a224a-92c6-47f8-b5eb-2758699ebe60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:30 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-17d3cd74-8e06-4f7e-822e-e2ba01b2cef1 tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91d2acae-f3a0-4581-9bf4-779242171892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:30 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-17d3cd74-8e06-4f7e-822e-e2ba01b2cef1 tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91d2acae-f3a0-4581-9bf4-779242171892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa948294-5957-42f8-a4d8-2ed8ba6fdabc', 'volume_name': 'volume-fa948294-5957-42f8-a4d8-2ed8ba6fdabc', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:30 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-17d3cd74-8e06-4f7e-822e-e2ba01b2cef1 tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ff383e4-a2e0-4b8f-a66a-26fe27be7e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:30 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-17d3cd74-8e06-4f7e-822e-e2ba01b2cef1 tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ff383e4-a2e0-4b8f-a66a-26fe27be7e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:30 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-17d3cd74-8e06-4f7e-822e-e2ba01b2cef1 tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac2448b4-8d2d-49bc-9f78-5fb345a432a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:30 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-17d3cd74-8e06-4f7e-822e-e2ba01b2cef1 tempest-CreateVolumesFromImageTest-1508703777 None] Volume fa948294-5957-42f8-a4d8-2ed8ba6fdabc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa948294-5957-42f8-a4d8-2ed8ba6fdabc', 'volume_size': 1} Jul 07 17:41:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-17d3cd74-8e06-4f7e-822e-e2ba01b2cef1 tempest-CreateVolumesFromImageTest-1508703777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:31 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-55de05a3-c7ac-4fe4-a884-52a5a3bab621 tempest-CreateVolumesFromImageTest-1508703777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a77d2aaf-d510-42b1-9e0d-2ba870ef055b 1073741824" returned: 0 in 1.299s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-55de05a3-c7ac-4fe4-a884-52a5a3bab621 tempest-CreateVolumesFromImageTest-1508703777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a77d2aaf-d510-42b1-9e0d-2ba870ef055b {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:31 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a77d2aaf-d510-42b1-9e0d-2ba870ef055b Jul 07 17:41:31 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:31 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-e1865aa9-034d-4c4f-b566-585baadfb8f1 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Acquiring lock "cinder-cc13bf28-c443-45ac-a1b2-ea79020316f6-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:31 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-e1865aa9-034d-4c4f-b566-585baadfb8f1 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "cinder-cc13bf28-c443-45ac-a1b2-ea79020316f6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:31 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d3fddb0-3fef-475e-9da2-4006050ebe3e tempest-CinderUnicodeTest-1153038688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:41:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0d3fddb0-3fef-475e-9da2-4006050ebe3e tempest-CinderUnicodeTest-1153038688 None] Flow 'volume_create_manager' (50e3d7f2-90bf-4e4f-b36c-ccbc8ffea0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0d3fddb0-3fef-475e-9da2-4006050ebe3e tempest-CinderUnicodeTest-1153038688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c18c5bce-8730-4227-b0c3-f76f1eb2f441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0d3fddb0-3fef-475e-9da2-4006050ebe3e tempest-CinderUnicodeTest-1153038688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c18c5bce-8730-4227-b0c3-f76f1eb2f441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:31Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1075690381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=269b819f-8505-4e07-869e-794edc326641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35df88b117074e8b8341079d8e579183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:31Z,use_quota=True,user_id='1d785ce28ec247ce84cbb0cb59e6d424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0d3fddb0-3fef-475e-9da2-4006050ebe3e tempest-CinderUnicodeTest-1153038688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52da44db-5230-4e58-a468-1d193bb701fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0d3fddb0-3fef-475e-9da2-4006050ebe3e tempest-CinderUnicodeTest-1153038688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52da44db-5230-4e58-a468-1d193bb701fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0d3fddb0-3fef-475e-9da2-4006050ebe3e tempest-CinderUnicodeTest-1153038688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f034a72-420a-4f14-b20f-4b69a2980bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0d3fddb0-3fef-475e-9da2-4006050ebe3e tempest-CinderUnicodeTest-1153038688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f034a72-420a-4f14-b20f-4b69a2980bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '269b819f-8505-4e07-869e-794edc326641', 'volume_name': 'volume-269b819f-8505-4e07-869e-794edc326641', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0d3fddb0-3fef-475e-9da2-4006050ebe3e tempest-CinderUnicodeTest-1153038688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5400d6d-1bb6-4021-9b99-b97d215919d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0d3fddb0-3fef-475e-9da2-4006050ebe3e tempest-CinderUnicodeTest-1153038688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5400d6d-1bb6-4021-9b99-b97d215919d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0d3fddb0-3fef-475e-9da2-4006050ebe3e tempest-CinderUnicodeTest-1153038688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (337afd20-c1c5-4ef3-ac54-b6044503dd06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:31 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-0d3fddb0-3fef-475e-9da2-4006050ebe3e tempest-CinderUnicodeTest-1153038688 None] Volume 269b819f-8505-4e07-869e-794edc326641: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-269b819f-8505-4e07-869e-794edc326641', 'volume_size': 1} Jul 07 17:41:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0d3fddb0-3fef-475e-9da2-4006050ebe3e tempest-CinderUnicodeTest-1153038688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:31 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-e1865aa9-034d-4c4f-b566-585baadfb8f1 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Acquiring lock "cinder-quobyte-cc13bf28-c443-45ac-a1b2-ea79020316f6" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:31 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-e1865aa9-034d-4c4f-b566-585baadfb8f1 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "cinder-quobyte-cc13bf28-c443-45ac-a1b2-ea79020316f6" acquired by "delete_volume" :: waited 0.027s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:31 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce7f5d9-4ae6-4f4a-b4eb-2a19337117e6]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e1865aa9-034d-4c4f-b566-585baadfb8f1 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc13bf28-c443-45ac-a1b2-ea79020316f6 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:31 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-31500cf3-4c0e-4d82-b87e-aad067820798 tempest-CreateVolumesFromSnapshotTest-1739026630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.956s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:31 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-31500cf3-4c0e-4d82-b87e-aad067820798 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:41:31 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-31500cf3-4c0e-4d82-b87e-aad067820798 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Deleted volume successfully. Jul 07 17:41:31 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc13bf28-c443-45ac-a1b2-ea79020316f6 Jul 07 17:41:31 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:31 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-31500cf3-4c0e-4d82-b87e-aad067820798 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "cinder-5c5e94ef-906f-4282-a601-c280a113905d-delete_volume" released by "delete_volume" :: held 4.011s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:32 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-55de05a3-c7ac-4fe4-a884-52a5a3bab621 tempest-CreateVolumesFromImageTest-1508703777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a77d2aaf-d510-42b1-9e0d-2ba870ef055b" returned: 0 in 0.968s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:32 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-55de05a3-c7ac-4fe4-a884-52a5a3bab621 tempest-CreateVolumesFromImageTest-1508703777 None] <== create_volume: return (2348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:41:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-55de05a3-c7ac-4fe4-a884-52a5a3bab621 tempest-CreateVolumesFromImageTest-1508703777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.351s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-cc3517a0-69d2-4467-ba5b-ae07dab2189c tempest-CreateVolumesFromImageTest-1508703777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.050s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:32 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-cc3517a0-69d2-4467-ba5b-ae07dab2189c tempest-CreateVolumesFromImageTest-1508703777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2108883127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0489535a-05e2-41c3-8f27-a7a649ed13c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf3f015746e543b48bc5f4f27deca6ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:29Z,use_quota=True,user_id='0ab6f04f57a44a87aedad1410833a2fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:41:32 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-cc3517a0-69d2-4467-ba5b-ae07dab2189c tempest-CreateVolumesFromImageTest-1508703777 None] Creating volume 0489535a-05e2-41c3-8f27-a7a649ed13c9 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:41:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-cc3517a0-69d2-4467-ba5b-ae07dab2189c tempest-CreateVolumesFromImageTest-1508703777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-cc3517a0-69d2-4467-ba5b-ae07dab2189c tempest-CreateVolumesFromImageTest-1508703777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:32 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-cc3517a0-69d2-4467-ba5b-ae07dab2189c tempest-CreateVolumesFromImageTest-1508703777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:32 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-cc3517a0-69d2-4467-ba5b-ae07dab2189c tempest-CreateVolumesFromImageTest-1508703777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-cc3517a0-69d2-4467-ba5b-ae07dab2189c tempest-CreateVolumesFromImageTest-1508703777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:32 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-cc3517a0-69d2-4467-ba5b-ae07dab2189c tempest-CreateVolumesFromImageTest-1508703777 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:41:32 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-cc3517a0-69d2-4467-ba5b-ae07dab2189c tempest-CreateVolumesFromImageTest-1508703777 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:41:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-cc3517a0-69d2-4467-ba5b-ae07dab2189c tempest-CreateVolumesFromImageTest-1508703777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0489535a-05e2-41c3-8f27-a7a649ed13c9 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:32 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-55de05a3-c7ac-4fe4-a884-52a5a3bab621 tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (091e6d1b-8c44-48d2-b7ea-baa8d7d477a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a77d2aaf-d510-42b1-9e0d-2ba870ef055b', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:32 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0489535a-05e2-41c3-8f27-a7a649ed13c9 1073741824 Jul 07 17:41:32 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:32 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-55de05a3-c7ac-4fe4-a884-52a5a3bab621 tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fc09197-8a42-407d-aa36-74e9f1737888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:32 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-55de05a3-c7ac-4fe4-a884-52a5a3bab621 tempest-CreateVolumesFromImageTest-1508703777 None] Volume volume-a77d2aaf-d510-42b1-9e0d-2ba870ef055b (a77d2aaf-d510-42b1-9e0d-2ba870ef055b): created successfully Jul 07 17:41:32 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-55de05a3-c7ac-4fe4-a884-52a5a3bab621 tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fc09197-8a42-407d-aa36-74e9f1737888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:32 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-55de05a3-c7ac-4fe4-a884-52a5a3bab621 tempest-CreateVolumesFromImageTest-1508703777 None] Flow 'volume_create_manager' (ecab715d-219e-4929-a08d-5ee878ebba5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:32 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-55de05a3-c7ac-4fe4-a884-52a5a3bab621 tempest-CreateVolumesFromImageTest-1508703777 None] Created volume successfully. Jul 07 17:41:32 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e1865aa9-034d-4c4f-b566-585baadfb8f1 tempest-CreateVolumesFromSnapshotTest-1739026630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc13bf28-c443-45ac-a1b2-ea79020316f6" returned: 0 in 0.892s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e1865aa9-034d-4c4f-b566-585baadfb8f1 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc13bf28-c443-45ac-a1b2-ea79020316f6 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:32 devstack sudo[105857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc13bf28-c443-45ac-a1b2-ea79020316f6 Jul 07 17:41:32 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:33 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-cc3517a0-69d2-4467-ba5b-ae07dab2189c tempest-CreateVolumesFromImageTest-1508703777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0489535a-05e2-41c3-8f27-a7a649ed13c9 1073741824" returned: 0 in 1.138s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-cc3517a0-69d2-4467-ba5b-ae07dab2189c tempest-CreateVolumesFromImageTest-1508703777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0489535a-05e2-41c3-8f27-a7a649ed13c9 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:33 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e1865aa9-034d-4c4f-b566-585baadfb8f1 tempest-CreateVolumesFromSnapshotTest-1739026630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cc13bf28-c443-45ac-a1b2-ea79020316f6" returned: 0 in 0.777s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:33 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0489535a-05e2-41c3-8f27-a7a649ed13c9 Jul 07 17:41:33 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:33 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-e1865aa9-034d-4c4f-b566-585baadfb8f1 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "cinder-quobyte-cc13bf28-c443-45ac-a1b2-ea79020316f6" released by "delete_volume" :: held 1.742s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:33 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-e1865aa9-034d-4c4f-b566-585baadfb8f1 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Created reservations ['3922d05d-2f87-4ac6-94fd-4dca31b2ad00', '12200569-2a94-4ec0-8352-3cf1dc7829f4', 'bd6c0014-071c-4f6f-a6b1-da5dd5386b4a', '82400ef2-f35d-46ee-aeaa-8adbdb3d3c2d'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:41:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e1865aa9-034d-4c4f-b566-585baadfb8f1 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e1865aa9-034d-4c4f-b566-585baadfb8f1 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:33 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-e1865aa9-034d-4c4f-b566-585baadfb8f1 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:33 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-e1865aa9-034d-4c4f-b566-585baadfb8f1 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e1865aa9-034d-4c4f-b566-585baadfb8f1 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e1865aa9-034d-4c4f-b566-585baadfb8f1 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:33 devstack sudo[105865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:41:33 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:33 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6c098bc3-0bc9-495f-8f3a-a66ac64f3874 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Acquiring lock "cinder-cf0917fc-f1b6-4833-8f07-1b3e52f9d22e-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:33 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6c098bc3-0bc9-495f-8f3a-a66ac64f3874 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "cinder-cf0917fc-f1b6-4833-8f07-1b3e52f9d22e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:33 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6c098bc3-0bc9-495f-8f3a-a66ac64f3874 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Acquiring lock "cinder-quobyte-cf0917fc-f1b6-4833-8f07-1b3e52f9d22e" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:33 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6c098bc3-0bc9-495f-8f3a-a66ac64f3874 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "cinder-quobyte-cf0917fc-f1b6-4833-8f07-1b3e52f9d22e" acquired by "delete_volume" :: waited 0.021s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:34 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8415dd07-5a66-4107-8bf6-f96eaa7c65af]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6c098bc3-0bc9-495f-8f3a-a66ac64f3874 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf0917fc-f1b6-4833-8f07-1b3e52f9d22e {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:34 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf0917fc-f1b6-4833-8f07-1b3e52f9d22e Jul 07 17:41:34 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:34 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-cc3517a0-69d2-4467-ba5b-ae07dab2189c tempest-CreateVolumesFromImageTest-1508703777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0489535a-05e2-41c3-8f27-a7a649ed13c9" returned: 0 in 0.793s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:34 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-cc3517a0-69d2-4467-ba5b-ae07dab2189c tempest-CreateVolumesFromImageTest-1508703777 None] <== create_volume: return (2007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:41:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-cc3517a0-69d2-4467-ba5b-ae07dab2189c tempest-CreateVolumesFromImageTest-1508703777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.010s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-87f1ab88-1fc3-4eb4-925d-9438bf5c3597 tempest-CreateVolumesFromImageTest-1508703777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.380s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:34 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-87f1ab88-1fc3-4eb4-925d-9438bf5c3597 tempest-CreateVolumesFromImageTest-1508703777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1248628166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0657ac7c-aac0-44c0-ab97-d4630a3332e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf3f015746e543b48bc5f4f27deca6ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:30Z,use_quota=True,user_id='0ab6f04f57a44a87aedad1410833a2fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:41:34 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-87f1ab88-1fc3-4eb4-925d-9438bf5c3597 tempest-CreateVolumesFromImageTest-1508703777 None] Creating volume 0657ac7c-aac0-44c0-ab97-d4630a3332e3 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:41:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-87f1ab88-1fc3-4eb4-925d-9438bf5c3597 tempest-CreateVolumesFromImageTest-1508703777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-87f1ab88-1fc3-4eb4-925d-9438bf5c3597 tempest-CreateVolumesFromImageTest-1508703777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:34 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-87f1ab88-1fc3-4eb4-925d-9438bf5c3597 tempest-CreateVolumesFromImageTest-1508703777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:34 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-87f1ab88-1fc3-4eb4-925d-9438bf5c3597 tempest-CreateVolumesFromImageTest-1508703777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-87f1ab88-1fc3-4eb4-925d-9438bf5c3597 tempest-CreateVolumesFromImageTest-1508703777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:34 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-87f1ab88-1fc3-4eb4-925d-9438bf5c3597 tempest-CreateVolumesFromImageTest-1508703777 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:41:34 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-87f1ab88-1fc3-4eb4-925d-9438bf5c3597 tempest-CreateVolumesFromImageTest-1508703777 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:41:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-87f1ab88-1fc3-4eb4-925d-9438bf5c3597 tempest-CreateVolumesFromImageTest-1508703777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0657ac7c-aac0-44c0-ab97-d4630a3332e3 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-cc3517a0-69d2-4467-ba5b-ae07dab2189c tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8c4a71c-79ff-4f6d-9094-a08e0dae8f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0489535a-05e2-41c3-8f27-a7a649ed13c9', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:34 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0657ac7c-aac0-44c0-ab97-d4630a3332e3 1073741824 Jul 07 17:41:34 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-cc3517a0-69d2-4467-ba5b-ae07dab2189c tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5165b9e4-2a90-4598-893b-2a9ffe2a81a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:34 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-cc3517a0-69d2-4467-ba5b-ae07dab2189c tempest-CreateVolumesFromImageTest-1508703777 None] Volume volume-0489535a-05e2-41c3-8f27-a7a649ed13c9 (0489535a-05e2-41c3-8f27-a7a649ed13c9): created successfully Jul 07 17:41:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-cc3517a0-69d2-4467-ba5b-ae07dab2189c tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5165b9e4-2a90-4598-893b-2a9ffe2a81a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:34 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-cc3517a0-69d2-4467-ba5b-ae07dab2189c tempest-CreateVolumesFromImageTest-1508703777 None] Flow 'volume_create_manager' (1edc15bb-df3c-410c-889c-36dea8bc9d11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:34 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-cc3517a0-69d2-4467-ba5b-ae07dab2189c tempest-CreateVolumesFromImageTest-1508703777 None] Created volume successfully. Jul 07 17:41:34 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e1865aa9-034d-4c4f-b566-585baadfb8f1 tempest-CreateVolumesFromSnapshotTest-1739026630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.818s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:34 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-e1865aa9-034d-4c4f-b566-585baadfb8f1 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:41:34 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-e1865aa9-034d-4c4f-b566-585baadfb8f1 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Deleted volume successfully. Jul 07 17:41:34 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-e1865aa9-034d-4c4f-b566-585baadfb8f1 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "cinder-cc13bf28-c443-45ac-a1b2-ea79020316f6-delete_volume" released by "delete_volume" :: held 2.959s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:34 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6c098bc3-0bc9-495f-8f3a-a66ac64f3874 tempest-CreateVolumesFromSnapshotTest-1739026630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf0917fc-f1b6-4833-8f07-1b3e52f9d22e" returned: 0 in 0.850s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6c098bc3-0bc9-495f-8f3a-a66ac64f3874 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf0917fc-f1b6-4833-8f07-1b3e52f9d22e {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:34 devstack sudo[105878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf0917fc-f1b6-4833-8f07-1b3e52f9d22e Jul 07 17:41:34 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:35 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-87f1ab88-1fc3-4eb4-925d-9438bf5c3597 tempest-CreateVolumesFromImageTest-1508703777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0657ac7c-aac0-44c0-ab97-d4630a3332e3 1073741824" returned: 0 in 1.024s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-87f1ab88-1fc3-4eb4-925d-9438bf5c3597 tempest-CreateVolumesFromImageTest-1508703777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0657ac7c-aac0-44c0-ab97-d4630a3332e3 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:35 devstack sudo[105881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0657ac7c-aac0-44c0-ab97-d4630a3332e3 Jul 07 17:41:35 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:35 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6c098bc3-0bc9-495f-8f3a-a66ac64f3874 tempest-CreateVolumesFromSnapshotTest-1739026630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-cf0917fc-f1b6-4833-8f07-1b3e52f9d22e" returned: 0 in 0.786s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:35 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6c098bc3-0bc9-495f-8f3a-a66ac64f3874 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "cinder-quobyte-cf0917fc-f1b6-4833-8f07-1b3e52f9d22e" released by "delete_volume" :: held 1.684s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:35 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-6c098bc3-0bc9-495f-8f3a-a66ac64f3874 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Created reservations ['91b3d8b7-2355-4acc-a299-65a1cf26271c', 'de4a62da-5f41-42c5-953e-189799d937cc', 'ad2fc2f8-e2d1-41e8-a404-5b5a82afd23f', '47cb5647-a109-4597-be8f-5b403bea36d2'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:41:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-6c098bc3-0bc9-495f-8f3a-a66ac64f3874 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-6c098bc3-0bc9-495f-8f3a-a66ac64f3874 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:35 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-6c098bc3-0bc9-495f-8f3a-a66ac64f3874 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:35 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-6c098bc3-0bc9-495f-8f3a-a66ac64f3874 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-6c098bc3-0bc9-495f-8f3a-a66ac64f3874 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6c098bc3-0bc9-495f-8f3a-a66ac64f3874 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:35 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:41:35 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:36 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:36 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-dbca797e-a3e6-4a9d-aa34-bf7b8613808e tempest-CreateVolumesFromSnapshotTest-1739026630 None] Acquiring lock "cinder-7862f33c-3d3d-44dc-a6dd-e91db438aa10-delete_snapshot" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-87f1ab88-1fc3-4eb4-925d-9438bf5c3597 tempest-CreateVolumesFromImageTest-1508703777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0657ac7c-aac0-44c0-ab97-d4630a3332e3" returned: 0 in 0.831s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:36 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-87f1ab88-1fc3-4eb4-925d-9438bf5c3597 tempest-CreateVolumesFromImageTest-1508703777 None] <== create_volume: return (1912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:41:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-87f1ab88-1fc3-4eb4-925d-9438bf5c3597 tempest-CreateVolumesFromImageTest-1508703777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.917s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e16210f3-9276-4561-9986-6de105ea70ae tempest-CreateVolumesFromImageTest-1508703777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.717s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:36 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-e16210f3-9276-4561-9986-6de105ea70ae tempest-CreateVolumesFromImageTest-1508703777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1837809492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfb67a36-efcd-4dc3-a08b-5526404453b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf3f015746e543b48bc5f4f27deca6ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:30Z,use_quota=True,user_id='0ab6f04f57a44a87aedad1410833a2fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:41:36 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-e16210f3-9276-4561-9986-6de105ea70ae tempest-CreateVolumesFromImageTest-1508703777 None] Creating volume dfb67a36-efcd-4dc3-a08b-5526404453b5 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:41:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e16210f3-9276-4561-9986-6de105ea70ae tempest-CreateVolumesFromImageTest-1508703777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e16210f3-9276-4561-9986-6de105ea70ae tempest-CreateVolumesFromImageTest-1508703777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:36 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-e16210f3-9276-4561-9986-6de105ea70ae tempest-CreateVolumesFromImageTest-1508703777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:36 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-e16210f3-9276-4561-9986-6de105ea70ae tempest-CreateVolumesFromImageTest-1508703777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e16210f3-9276-4561-9986-6de105ea70ae tempest-CreateVolumesFromImageTest-1508703777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:36 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-e16210f3-9276-4561-9986-6de105ea70ae tempest-CreateVolumesFromImageTest-1508703777 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:41:36 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-e16210f3-9276-4561-9986-6de105ea70ae tempest-CreateVolumesFromImageTest-1508703777 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:41:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e16210f3-9276-4561-9986-6de105ea70ae tempest-CreateVolumesFromImageTest-1508703777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-dfb67a36-efcd-4dc3-a08b-5526404453b5 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:36 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-dbca797e-a3e6-4a9d-aa34-bf7b8613808e tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "cinder-7862f33c-3d3d-44dc-a6dd-e91db438aa10-delete_snapshot" acquired by "delete_snapshot" :: waited 0.090s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:36 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-dbca797e-a3e6-4a9d-aa34-bf7b8613808e tempest-CreateVolumesFromSnapshotTest-1739026630 None] Acquiring lock "cinder-quobyte-ba78ad4c-332e-4680-98b6-cf29e7754a10" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:36 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-dfb67a36-efcd-4dc3-a08b-5526404453b5 1073741824 Jul 07 17:41:36 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-87f1ab88-1fc3-4eb4-925d-9438bf5c3597 tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f491644f-d59e-485b-88ba-a16a9229f962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0657ac7c-aac0-44c0-ab97-d4630a3332e3', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-87f1ab88-1fc3-4eb4-925d-9438bf5c3597 tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7766047d-36da-4882-a1a4-886d7bd8ccf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:36 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-87f1ab88-1fc3-4eb4-925d-9438bf5c3597 tempest-CreateVolumesFromImageTest-1508703777 None] Volume volume-0657ac7c-aac0-44c0-ab97-d4630a3332e3 (0657ac7c-aac0-44c0-ab97-d4630a3332e3): created successfully Jul 07 17:41:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-87f1ab88-1fc3-4eb4-925d-9438bf5c3597 tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7766047d-36da-4882-a1a4-886d7bd8ccf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:36 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-87f1ab88-1fc3-4eb4-925d-9438bf5c3597 tempest-CreateVolumesFromImageTest-1508703777 None] Flow 'volume_create_manager' (592c2866-7321-4d02-93e2-873ea9ea9e2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:36 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-dbca797e-a3e6-4a9d-aa34-bf7b8613808e tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "cinder-quobyte-ba78ad4c-332e-4680-98b6-cf29e7754a10" acquired by "delete_snapshot" :: waited 0.067s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:36 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-dbca797e-a3e6-4a9d-aa34-bf7b8613808e tempest-CreateVolumesFromSnapshotTest-1739026630 None] Acquiring lock "cinder-quobyte-7862f33c-3d3d-44dc-a6dd-e91db438aa10" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:36 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-87f1ab88-1fc3-4eb4-925d-9438bf5c3597 tempest-CreateVolumesFromImageTest-1508703777 None] Created volume successfully. Jul 07 17:41:36 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-dbca797e-a3e6-4a9d-aa34-bf7b8613808e tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "cinder-quobyte-7862f33c-3d3d-44dc-a6dd-e91db438aa10" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:36 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-dbca797e-a3e6-4a9d-aa34-bf7b8613808e tempest-CreateVolumesFromSnapshotTest-1739026630 None] Deleting offline snapshot 7862f33c-3d3d-44dc-a6dd-e91db438aa10 of volume ba78ad4c-332e-4680-98b6-cf29e7754a10 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:41:36 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-dbca797e-a3e6-4a9d-aa34-bf7b8613808e tempest-CreateVolumesFromSnapshotTest-1739026630 None] snapshot_file for this snap is: volume-ba78ad4c-332e-4680-98b6-cf29e7754a10.7862f33c-3d3d-44dc-a6dd-e91db438aa10 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:41:36 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda02dc1-9aac-4ec0-892a-a62509d0322b]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-dbca797e-a3e6-4a9d-aa34-bf7b8613808e tempest-CreateVolumesFromSnapshotTest-1739026630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ba78ad4c-332e-4680-98b6-cf29e7754a10.7862f33c-3d3d-44dc-a6dd-e91db438aa10 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:36 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ba78ad4c-332e-4680-98b6-cf29e7754a10.7862f33c-3d3d-44dc-a6dd-e91db438aa10 Jul 07 17:41:36 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:36 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6c098bc3-0bc9-495f-8f3a-a66ac64f3874 tempest-CreateVolumesFromSnapshotTest-1739026630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.753s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:36 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-6c098bc3-0bc9-495f-8f3a-a66ac64f3874 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:41:36 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-6c098bc3-0bc9-495f-8f3a-a66ac64f3874 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Deleted volume successfully. Jul 07 17:41:36 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6c098bc3-0bc9-495f-8f3a-a66ac64f3874 tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "cinder-cf0917fc-f1b6-4833-8f07-1b3e52f9d22e-delete_volume" released by "delete_volume" :: held 2.812s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:37 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e16210f3-9276-4561-9986-6de105ea70ae tempest-CreateVolumesFromImageTest-1508703777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-dfb67a36-efcd-4dc3-a08b-5526404453b5 1073741824" returned: 0 in 1.169s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:37 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-dbca797e-a3e6-4a9d-aa34-bf7b8613808e tempest-CreateVolumesFromSnapshotTest-1739026630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ba78ad4c-332e-4680-98b6-cf29e7754a10.7862f33c-3d3d-44dc-a6dd-e91db438aa10" returned: 0 in 1.013s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:37 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-dbca797e-a3e6-4a9d-aa34-bf7b8613808e tempest-CreateVolumesFromSnapshotTest-1739026630 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba78ad4c-332e-4680-98b6-cf29e7754a10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:41:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e16210f3-9276-4561-9986-6de105ea70ae tempest-CreateVolumesFromImageTest-1508703777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-dfb67a36-efcd-4dc3-a08b-5526404453b5 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:37 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e10cac-1204-414b-8a85-d0454a49f1e1]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-dbca797e-a3e6-4a9d-aa34-bf7b8613808e tempest-CreateVolumesFromSnapshotTest-1739026630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ba78ad4c-332e-4680-98b6-cf29e7754a10 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:37 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-dfb67a36-efcd-4dc3-a08b-5526404453b5 Jul 07 17:41:37 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:37 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ba78ad4c-332e-4680-98b6-cf29e7754a10 Jul 07 17:41:37 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:38 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e16210f3-9276-4561-9986-6de105ea70ae tempest-CreateVolumesFromImageTest-1508703777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-dfb67a36-efcd-4dc3-a08b-5526404453b5" returned: 0 in 0.685s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:38 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-e16210f3-9276-4561-9986-6de105ea70ae tempest-CreateVolumesFromImageTest-1508703777 None] <== create_volume: return (1945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:41:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e16210f3-9276-4561-9986-6de105ea70ae tempest-CreateVolumesFromImageTest-1508703777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.952s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-17d3cd74-8e06-4f7e-822e-e2ba01b2cef1 tempest-CreateVolumesFromImageTest-1508703777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.103s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:38 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-17d3cd74-8e06-4f7e-822e-e2ba01b2cef1 tempest-CreateVolumesFromImageTest-1508703777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-375143783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa948294-5957-42f8-a4d8-2ed8ba6fdabc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf3f015746e543b48bc5f4f27deca6ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:31Z,use_quota=True,user_id='0ab6f04f57a44a87aedad1410833a2fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:41:38 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-17d3cd74-8e06-4f7e-822e-e2ba01b2cef1 tempest-CreateVolumesFromImageTest-1508703777 None] Creating volume fa948294-5957-42f8-a4d8-2ed8ba6fdabc {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:41:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-17d3cd74-8e06-4f7e-822e-e2ba01b2cef1 tempest-CreateVolumesFromImageTest-1508703777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-17d3cd74-8e06-4f7e-822e-e2ba01b2cef1 tempest-CreateVolumesFromImageTest-1508703777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:38 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-17d3cd74-8e06-4f7e-822e-e2ba01b2cef1 tempest-CreateVolumesFromImageTest-1508703777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:38 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-17d3cd74-8e06-4f7e-822e-e2ba01b2cef1 tempest-CreateVolumesFromImageTest-1508703777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-17d3cd74-8e06-4f7e-822e-e2ba01b2cef1 tempest-CreateVolumesFromImageTest-1508703777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:38 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-17d3cd74-8e06-4f7e-822e-e2ba01b2cef1 tempest-CreateVolumesFromImageTest-1508703777 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:41:38 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-17d3cd74-8e06-4f7e-822e-e2ba01b2cef1 tempest-CreateVolumesFromImageTest-1508703777 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:41:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-17d3cd74-8e06-4f7e-822e-e2ba01b2cef1 tempest-CreateVolumesFromImageTest-1508703777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fa948294-5957-42f8-a4d8-2ed8ba6fdabc 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e16210f3-9276-4561-9986-6de105ea70ae tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (235e7bba-3d9d-43fb-abc0-91bcae8ab8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfb67a36-efcd-4dc3-a08b-5526404453b5', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:38 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fa948294-5957-42f8-a4d8-2ed8ba6fdabc 1073741824 Jul 07 17:41:38 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e16210f3-9276-4561-9986-6de105ea70ae tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb6a5f94-3d5f-4f32-aa9f-4198500fcb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:38 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-e16210f3-9276-4561-9986-6de105ea70ae tempest-CreateVolumesFromImageTest-1508703777 None] Volume volume-dfb67a36-efcd-4dc3-a08b-5526404453b5 (dfb67a36-efcd-4dc3-a08b-5526404453b5): created successfully Jul 07 17:41:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e16210f3-9276-4561-9986-6de105ea70ae tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb6a5f94-3d5f-4f32-aa9f-4198500fcb18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-e16210f3-9276-4561-9986-6de105ea70ae tempest-CreateVolumesFromImageTest-1508703777 None] Flow 'volume_create_manager' (32c88ec2-34ba-48bb-84f2-670fae54bc00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:38 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-e16210f3-9276-4561-9986-6de105ea70ae tempest-CreateVolumesFromImageTest-1508703777 None] Created volume successfully. Jul 07 17:41:38 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-dbca797e-a3e6-4a9d-aa34-bf7b8613808e tempest-CreateVolumesFromSnapshotTest-1739026630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ba78ad4c-332e-4680-98b6-cf29e7754a10" returned: 0 in 0.885s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-dbca797e-a3e6-4a9d-aa34-bf7b8613808e tempest-CreateVolumesFromSnapshotTest-1739026630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ba78ad4c-332e-4680-98b6-cf29e7754a10.7862f33c-3d3d-44dc-a6dd-e91db438aa10 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:38 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ba78ad4c-332e-4680-98b6-cf29e7754a10.7862f33c-3d3d-44dc-a6dd-e91db438aa10 Jul 07 17:41:38 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:39 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-17d3cd74-8e06-4f7e-822e-e2ba01b2cef1 tempest-CreateVolumesFromImageTest-1508703777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fa948294-5957-42f8-a4d8-2ed8ba6fdabc 1073741824" returned: 0 in 1.038s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:39 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-dbca797e-a3e6-4a9d-aa34-bf7b8613808e tempest-CreateVolumesFromSnapshotTest-1739026630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ba78ad4c-332e-4680-98b6-cf29e7754a10.7862f33c-3d3d-44dc-a6dd-e91db438aa10" returned: 0 in 0.874s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-dbca797e-a3e6-4a9d-aa34-bf7b8613808e tempest-CreateVolumesFromSnapshotTest-1739026630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ba78ad4c-332e-4680-98b6-cf29e7754a10.7862f33c-3d3d-44dc-a6dd-e91db438aa10 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-17d3cd74-8e06-4f7e-822e-e2ba01b2cef1 tempest-CreateVolumesFromImageTest-1508703777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fa948294-5957-42f8-a4d8-2ed8ba6fdabc {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:39 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ba78ad4c-332e-4680-98b6-cf29e7754a10.7862f33c-3d3d-44dc-a6dd-e91db438aa10 Jul 07 17:41:39 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:39 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fa948294-5957-42f8-a4d8-2ed8ba6fdabc Jul 07 17:41:39 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:39 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:39 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-17d3cd74-8e06-4f7e-822e-e2ba01b2cef1 tempest-CreateVolumesFromImageTest-1508703777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fa948294-5957-42f8-a4d8-2ed8ba6fdabc" returned: 0 in 0.713s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:39 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-17d3cd74-8e06-4f7e-822e-e2ba01b2cef1 tempest-CreateVolumesFromImageTest-1508703777 None] <== create_volume: return (1810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:41:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-17d3cd74-8e06-4f7e-822e-e2ba01b2cef1 tempest-CreateVolumesFromImageTest-1508703777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.813s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0d3fddb0-3fef-475e-9da2-4006050ebe3e tempest-CinderUnicodeTest-1153038688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.269s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:39 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-0d3fddb0-3fef-475e-9da2-4006050ebe3e tempest-CinderUnicodeTest-1153038688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:31Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1075690381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=269b819f-8505-4e07-869e-794edc326641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35df88b117074e8b8341079d8e579183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:31Z,use_quota=True,user_id='1d785ce28ec247ce84cbb0cb59e6d424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:41:39 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-0d3fddb0-3fef-475e-9da2-4006050ebe3e tempest-CinderUnicodeTest-1153038688 None] Creating volume 269b819f-8505-4e07-869e-794edc326641 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:41:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0d3fddb0-3fef-475e-9da2-4006050ebe3e tempest-CinderUnicodeTest-1153038688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0d3fddb0-3fef-475e-9da2-4006050ebe3e tempest-CinderUnicodeTest-1153038688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:39 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-0d3fddb0-3fef-475e-9da2-4006050ebe3e tempest-CinderUnicodeTest-1153038688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:39 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-0d3fddb0-3fef-475e-9da2-4006050ebe3e tempest-CinderUnicodeTest-1153038688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0d3fddb0-3fef-475e-9da2-4006050ebe3e tempest-CinderUnicodeTest-1153038688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:39 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-0d3fddb0-3fef-475e-9da2-4006050ebe3e tempest-CinderUnicodeTest-1153038688 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:41:39 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-0d3fddb0-3fef-475e-9da2-4006050ebe3e tempest-CinderUnicodeTest-1153038688 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:41:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0d3fddb0-3fef-475e-9da2-4006050ebe3e tempest-CinderUnicodeTest-1153038688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-269b819f-8505-4e07-869e-794edc326641 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-dbca797e-a3e6-4a9d-aa34-bf7b8613808e tempest-CreateVolumesFromSnapshotTest-1739026630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ba78ad4c-332e-4680-98b6-cf29e7754a10.7862f33c-3d3d-44dc-a6dd-e91db438aa10" returned: 0 in 0.761s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:39 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-269b819f-8505-4e07-869e-794edc326641 1073741824 Jul 07 17:41:39 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:39 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-17d3cd74-8e06-4f7e-822e-e2ba01b2cef1 tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac2448b4-8d2d-49bc-9f78-5fb345a432a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa948294-5957-42f8-a4d8-2ed8ba6fdabc', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:39 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-17d3cd74-8e06-4f7e-822e-e2ba01b2cef1 tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (472413c7-f778-445f-b2e1-84eb6e188922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:40 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-dbca797e-a3e6-4a9d-aa34-bf7b8613808e tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "cinder-quobyte-7862f33c-3d3d-44dc-a6dd-e91db438aa10" released by "_delete_snapshot" :: held 3.731s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:40 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-dbca797e-a3e6-4a9d-aa34-bf7b8613808e tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "cinder-quobyte-ba78ad4c-332e-4680-98b6-cf29e7754a10" released by "delete_snapshot" :: held 3.773s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:40 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-17d3cd74-8e06-4f7e-822e-e2ba01b2cef1 tempest-CreateVolumesFromImageTest-1508703777 None] Volume volume-fa948294-5957-42f8-a4d8-2ed8ba6fdabc (fa948294-5957-42f8-a4d8-2ed8ba6fdabc): created successfully Jul 07 17:41:40 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-17d3cd74-8e06-4f7e-822e-e2ba01b2cef1 tempest-CreateVolumesFromImageTest-1508703777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (472413c7-f778-445f-b2e1-84eb6e188922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:40 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-17d3cd74-8e06-4f7e-822e-e2ba01b2cef1 tempest-CreateVolumesFromImageTest-1508703777 None] Flow 'volume_create_manager' (b8a4ad0a-6f23-4329-a554-0051c285ea51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:40 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-17d3cd74-8e06-4f7e-822e-e2ba01b2cef1 tempest-CreateVolumesFromImageTest-1508703777 None] Created volume successfully. Jul 07 17:41:40 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-dbca797e-a3e6-4a9d-aa34-bf7b8613808e tempest-CreateVolumesFromSnapshotTest-1739026630 None] Created reservations ['15a8c79e-a362-4860-87ae-68b09ff30816', 'ce737d47-e41e-4c55-a36d-1847f5b2d9a7', 'ca44e5f3-49d0-480a-b392-9912e1c831d5', '2e314927-5207-4aa4-aa0c-64b5a1107e5a'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:41:40 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-dbca797e-a3e6-4a9d-aa34-bf7b8613808e tempest-CreateVolumesFromSnapshotTest-1739026630 None] Delete snapshot completed successfully. Jul 07 17:41:40 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-dbca797e-a3e6-4a9d-aa34-bf7b8613808e tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "cinder-7862f33c-3d3d-44dc-a6dd-e91db438aa10-delete_snapshot" released by "delete_snapshot" :: held 4.021s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:40 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-4d8846e5-38c8-4af3-acdb-462580fd592a tempest-CreateVolumesFromSnapshotTest-1739026630 None] Acquiring lock "cinder-ba78ad4c-332e-4680-98b6-cf29e7754a10-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:40 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-4d8846e5-38c8-4af3-acdb-462580fd592a tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "cinder-ba78ad4c-332e-4680-98b6-cf29e7754a10-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:40 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-4d8846e5-38c8-4af3-acdb-462580fd592a tempest-CreateVolumesFromSnapshotTest-1739026630 None] Acquiring lock "cinder-quobyte-ba78ad4c-332e-4680-98b6-cf29e7754a10" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:40 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-4d8846e5-38c8-4af3-acdb-462580fd592a tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "cinder-quobyte-ba78ad4c-332e-4680-98b6-cf29e7754a10" acquired by "delete_volume" :: waited 0.020s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:40 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[856309d4-9d07-4947-8d4c-c04696852454]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4d8846e5-38c8-4af3-acdb-462580fd592a tempest-CreateVolumesFromSnapshotTest-1739026630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ba78ad4c-332e-4680-98b6-cf29e7754a10 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:40 devstack sudo[105926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ba78ad4c-332e-4680-98b6-cf29e7754a10 Jul 07 17:41:40 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:40 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d57b38ba-8ba0-4e01-9443-f0903ae8f876 tempest-CreateVolumesFromImageTest-1508703777 None] Acquiring lock "cinder-fa948294-5957-42f8-a4d8-2ed8ba6fdabc-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:40 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d57b38ba-8ba0-4e01-9443-f0903ae8f876 tempest-CreateVolumesFromImageTest-1508703777 None] Lock "cinder-fa948294-5957-42f8-a4d8-2ed8ba6fdabc-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:40 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d57b38ba-8ba0-4e01-9443-f0903ae8f876 tempest-CreateVolumesFromImageTest-1508703777 None] Acquiring lock "cinder-quobyte-fa948294-5957-42f8-a4d8-2ed8ba6fdabc" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:40 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d57b38ba-8ba0-4e01-9443-f0903ae8f876 tempest-CreateVolumesFromImageTest-1508703777 None] Lock "cinder-quobyte-fa948294-5957-42f8-a4d8-2ed8ba6fdabc" acquired by "delete_volume" :: waited 0.023s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:40 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26345b0-608b-4996-b165-d45278f946e6]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d57b38ba-8ba0-4e01-9443-f0903ae8f876 tempest-CreateVolumesFromImageTest-1508703777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fa948294-5957-42f8-a4d8-2ed8ba6fdabc {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:41 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0d3fddb0-3fef-475e-9da2-4006050ebe3e tempest-CinderUnicodeTest-1153038688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-269b819f-8505-4e07-869e-794edc326641 1073741824" returned: 0 in 1.167s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:41 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fa948294-5957-42f8-a4d8-2ed8ba6fdabc Jul 07 17:41:41 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0d3fddb0-3fef-475e-9da2-4006050ebe3e tempest-CinderUnicodeTest-1153038688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-269b819f-8505-4e07-869e-794edc326641 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:41 devstack sudo[105935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-269b819f-8505-4e07-869e-794edc326641 Jul 07 17:41:41 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:41 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4d8846e5-38c8-4af3-acdb-462580fd592a tempest-CreateVolumesFromSnapshotTest-1739026630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ba78ad4c-332e-4680-98b6-cf29e7754a10" returned: 0 in 1.053s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4d8846e5-38c8-4af3-acdb-462580fd592a tempest-CreateVolumesFromSnapshotTest-1739026630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ba78ad4c-332e-4680-98b6-cf29e7754a10 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:41 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ba78ad4c-332e-4680-98b6-cf29e7754a10 Jul 07 17:41:41 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:41 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d57b38ba-8ba0-4e01-9443-f0903ae8f876 tempest-CreateVolumesFromImageTest-1508703777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fa948294-5957-42f8-a4d8-2ed8ba6fdabc" returned: 0 in 1.014s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d57b38ba-8ba0-4e01-9443-f0903ae8f876 tempest-CreateVolumesFromImageTest-1508703777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fa948294-5957-42f8-a4d8-2ed8ba6fdabc {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:41 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0d3fddb0-3fef-475e-9da2-4006050ebe3e tempest-CinderUnicodeTest-1153038688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-269b819f-8505-4e07-869e-794edc326641" returned: 0 in 0.841s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:41 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-0d3fddb0-3fef-475e-9da2-4006050ebe3e tempest-CinderUnicodeTest-1153038688 None] <== create_volume: return (2086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:41:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0d3fddb0-3fef-475e-9da2-4006050ebe3e tempest-CinderUnicodeTest-1153038688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.091s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:42 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fa948294-5957-42f8-a4d8-2ed8ba6fdabc Jul 07 17:41:42 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:42 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0d3fddb0-3fef-475e-9da2-4006050ebe3e tempest-CinderUnicodeTest-1153038688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (337afd20-c1c5-4ef3-ac54-b6044503dd06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-269b819f-8505-4e07-869e-794edc326641', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:42 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0d3fddb0-3fef-475e-9da2-4006050ebe3e tempest-CinderUnicodeTest-1153038688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a00548e-25d9-41da-a9a1-5a37f359ea85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:42 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:UPDATE=178,cinder:SELECT=138,cinder:DELETE=18,cinder:INSERT=48 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:41:42 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-0d3fddb0-3fef-475e-9da2-4006050ebe3e tempest-CinderUnicodeTest-1153038688 None] Volume volume-269b819f-8505-4e07-869e-794edc326641 (269b819f-8505-4e07-869e-794edc326641): created successfully Jul 07 17:41:42 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0d3fddb0-3fef-475e-9da2-4006050ebe3e tempest-CinderUnicodeTest-1153038688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a00548e-25d9-41da-a9a1-5a37f359ea85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:42 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-0d3fddb0-3fef-475e-9da2-4006050ebe3e tempest-CinderUnicodeTest-1153038688 None] Flow 'volume_create_manager' (50e3d7f2-90bf-4e4f-b36c-ccbc8ffea0b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:42 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-0d3fddb0-3fef-475e-9da2-4006050ebe3e tempest-CinderUnicodeTest-1153038688 None] Created volume successfully. Jul 07 17:41:42 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4d8846e5-38c8-4af3-acdb-462580fd592a tempest-CreateVolumesFromSnapshotTest-1739026630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ba78ad4c-332e-4680-98b6-cf29e7754a10" returned: 0 in 0.803s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:42 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-4d8846e5-38c8-4af3-acdb-462580fd592a tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "cinder-quobyte-ba78ad4c-332e-4680-98b6-cf29e7754a10" released by "delete_volume" :: held 1.933s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:42 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-4d8846e5-38c8-4af3-acdb-462580fd592a tempest-CreateVolumesFromSnapshotTest-1739026630 None] Created reservations ['ffb374f6-b3ea-466f-9506-a3ca924467b9', '0e7931ae-a1e1-4c21-8029-9e7166405050', 'b586aa74-f6f8-4fa4-bf63-ce19e67dbff9', '8cb9d0a6-9033-49d1-af16-22a420eac5d9'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:41:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4d8846e5-38c8-4af3-acdb-462580fd592a tempest-CreateVolumesFromSnapshotTest-1739026630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4d8846e5-38c8-4af3-acdb-462580fd592a tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:42 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-4d8846e5-38c8-4af3-acdb-462580fd592a tempest-CreateVolumesFromSnapshotTest-1739026630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:42 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-4d8846e5-38c8-4af3-acdb-462580fd592a tempest-CreateVolumesFromSnapshotTest-1739026630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4d8846e5-38c8-4af3-acdb-462580fd592a tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4d8846e5-38c8-4af3-acdb-462580fd592a tempest-CreateVolumesFromSnapshotTest-1739026630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:42 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:SELECT=131,cinder:UPDATE=204,cinder:INSERT=48,cinder:DELETE=19 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:41:42 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:41:42 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a1d56802-203b-4180-b609-54bfa1154ed5 tempest-CinderUnicodeTest-1153038688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a1d56802-203b-4180-b609-54bfa1154ed5 tempest-CinderUnicodeTest-1153038688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:42 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-a1d56802-203b-4180-b609-54bfa1154ed5 tempest-CinderUnicodeTest-1153038688 None] Creating offline snapshot a6491aad-5590-4fe4-ba7a-e2bce4c30771 of volume 269b819f-8505-4e07-869e-794edc326641 {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:41:42 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9d6dd0-8220-4180-bdba-8cade313f67e]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a1d56802-203b-4180-b609-54bfa1154ed5 tempest-CinderUnicodeTest-1153038688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-269b819f-8505-4e07-869e-794edc326641 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:42 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d57b38ba-8ba0-4e01-9443-f0903ae8f876 tempest-CreateVolumesFromImageTest-1508703777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fa948294-5957-42f8-a4d8-2ed8ba6fdabc" returned: 0 in 0.974s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:42 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d57b38ba-8ba0-4e01-9443-f0903ae8f876 tempest-CreateVolumesFromImageTest-1508703777 None] Lock "cinder-quobyte-fa948294-5957-42f8-a4d8-2ed8ba6fdabc" released by "delete_volume" :: held 2.071s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:43 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-269b819f-8505-4e07-869e-794edc326641 Jul 07 17:41:43 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:43 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-d57b38ba-8ba0-4e01-9443-f0903ae8f876 tempest-CreateVolumesFromImageTest-1508703777 None] Created reservations ['13a13465-d3b3-4f41-b673-2b30f46a76c0', '1103c9cf-0c95-4446-acd3-537a5ad34825', '8631e0b4-4bfe-47eb-a88b-ad921634d32d', '34a7531f-a36c-41b4-8e02-5d7eaa5e0c3f'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:41:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d57b38ba-8ba0-4e01-9443-f0903ae8f876 tempest-CreateVolumesFromImageTest-1508703777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d57b38ba-8ba0-4e01-9443-f0903ae8f876 tempest-CreateVolumesFromImageTest-1508703777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d57b38ba-8ba0-4e01-9443-f0903ae8f876 tempest-CreateVolumesFromImageTest-1508703777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d57b38ba-8ba0-4e01-9443-f0903ae8f876 tempest-CreateVolumesFromImageTest-1508703777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d57b38ba-8ba0-4e01-9443-f0903ae8f876 tempest-CreateVolumesFromImageTest-1508703777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d57b38ba-8ba0-4e01-9443-f0903ae8f876 tempest-CreateVolumesFromImageTest-1508703777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:43 devstack sudo[105954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:41:43 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:43 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:41:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:43 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:41:43 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:43 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4d8846e5-38c8-4af3-acdb-462580fd592a tempest-CreateVolumesFromSnapshotTest-1739026630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.900s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:43 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-4d8846e5-38c8-4af3-acdb-462580fd592a tempest-CreateVolumesFromSnapshotTest-1739026630 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:41:43 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-4d8846e5-38c8-4af3-acdb-462580fd592a tempest-CreateVolumesFromSnapshotTest-1739026630 None] Deleted volume successfully. Jul 07 17:41:43 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-4d8846e5-38c8-4af3-acdb-462580fd592a tempest-CreateVolumesFromSnapshotTest-1739026630 None] Lock "cinder-ba78ad4c-332e-4680-98b6-cf29e7754a10-delete_volume" released by "delete_volume" :: held 3.295s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:44 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ee262636-ee60-430e-b6ce-e7dd562cf779 tempest-CreateVolumesFromImageTest-1508703777 None] Acquiring lock "cinder-dfb67a36-efcd-4dc3-a08b-5526404453b5-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:44 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ee262636-ee60-430e-b6ce-e7dd562cf779 tempest-CreateVolumesFromImageTest-1508703777 None] Lock "cinder-dfb67a36-efcd-4dc3-a08b-5526404453b5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:44 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ee262636-ee60-430e-b6ce-e7dd562cf779 tempest-CreateVolumesFromImageTest-1508703777 None] Acquiring lock "cinder-quobyte-dfb67a36-efcd-4dc3-a08b-5526404453b5" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:44 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ee262636-ee60-430e-b6ce-e7dd562cf779 tempest-CreateVolumesFromImageTest-1508703777 None] Lock "cinder-quobyte-dfb67a36-efcd-4dc3-a08b-5526404453b5" acquired by "delete_volume" :: waited 0.034s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:44 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d57b38ba-8ba0-4e01-9443-f0903ae8f876 tempest-CreateVolumesFromImageTest-1508703777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 1.213s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:44 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-d57b38ba-8ba0-4e01-9443-f0903ae8f876 tempest-CreateVolumesFromImageTest-1508703777 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:41:44 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-d57b38ba-8ba0-4e01-9443-f0903ae8f876 tempest-CreateVolumesFromImageTest-1508703777 None] Deleted volume successfully. Jul 07 17:41:44 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:44 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[213b134b-2432-48d0-98f3-3253ed4081ca]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ee262636-ee60-430e-b6ce-e7dd562cf779 tempest-CreateVolumesFromImageTest-1508703777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-dfb67a36-efcd-4dc3-a08b-5526404453b5 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a1d56802-203b-4180-b609-54bfa1154ed5 tempest-CinderUnicodeTest-1153038688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-269b819f-8505-4e07-869e-794edc326641" returned: 0 in 1.645s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a1d56802-203b-4180-b609-54bfa1154ed5 tempest-CinderUnicodeTest-1153038688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-269b819f-8505-4e07-869e-794edc326641,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-269b819f-8505-4e07-869e-794edc326641.a6491aad-5590-4fe4-ba7a-e2bce4c30771 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:44 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d57b38ba-8ba0-4e01-9443-f0903ae8f876 tempest-CreateVolumesFromImageTest-1508703777 None] Lock "cinder-fa948294-5957-42f8-a4d8-2ed8ba6fdabc-delete_volume" released by "delete_volume" :: held 3.705s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:44 devstack sudo[105966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-269b819f-8505-4e07-869e-794edc326641,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-269b819f-8505-4e07-869e-794edc326641.a6491aad-5590-4fe4-ba7a-e2bce4c30771 1G Jul 07 17:41:44 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:44 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 1.201s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:44 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:41:44 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:41:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread count: 28 {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:41:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread info: [<_MainThread(MainThread, started 126077716062336)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:41:44 devstack sudo[105965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-dfb67a36-efcd-4dc3-a08b-5526404453b5 Jul 07 17:41:44 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:45 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa96e13e-42ca-4893-89b3-f0387a2a5eb6 tempest-SnapshotDependencyTests-1095643674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:41:45 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fa96e13e-42ca-4893-89b3-f0387a2a5eb6 tempest-SnapshotDependencyTests-1095643674 None] Flow 'volume_create_manager' (6b8a3804-b09b-4f17-a59d-0586694292a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:45 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fa96e13e-42ca-4893-89b3-f0387a2a5eb6 tempest-SnapshotDependencyTests-1095643674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea3e55c6-2e54-49e7-bac5-9360aaa02bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:45 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fa96e13e-42ca-4893-89b3-f0387a2a5eb6 tempest-SnapshotDependencyTests-1095643674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea3e55c6-2e54-49e7-bac5-9360aaa02bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1011198039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33df7410-2a6d-4cf1-be85-23d8893807be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c90cab656eb44e78e898d294b8704c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:45Z,use_quota=True,user_id='9bfd1f6d5d41463c8a28a8cfcdbcaec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:45 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fa96e13e-42ca-4893-89b3-f0387a2a5eb6 tempest-SnapshotDependencyTests-1095643674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b020ac8-c7bf-4170-a821-795f21ee6ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:45 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fa96e13e-42ca-4893-89b3-f0387a2a5eb6 tempest-SnapshotDependencyTests-1095643674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b020ac8-c7bf-4170-a821-795f21ee6ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:45 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fa96e13e-42ca-4893-89b3-f0387a2a5eb6 tempest-SnapshotDependencyTests-1095643674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f055680-fcdd-4bff-b788-6534d9da736d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:45 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fa96e13e-42ca-4893-89b3-f0387a2a5eb6 tempest-SnapshotDependencyTests-1095643674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f055680-fcdd-4bff-b788-6534d9da736d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33df7410-2a6d-4cf1-be85-23d8893807be', 'volume_name': 'volume-33df7410-2a6d-4cf1-be85-23d8893807be', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:45 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:45 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fa96e13e-42ca-4893-89b3-f0387a2a5eb6 tempest-SnapshotDependencyTests-1095643674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (755f8750-6404-4816-a14d-d48cd76d89b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:45 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fa96e13e-42ca-4893-89b3-f0387a2a5eb6 tempest-SnapshotDependencyTests-1095643674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (755f8750-6404-4816-a14d-d48cd76d89b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:45 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fa96e13e-42ca-4893-89b3-f0387a2a5eb6 tempest-SnapshotDependencyTests-1095643674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8020144c-d332-4ae0-8b44-f129209d073b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:45 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-fa96e13e-42ca-4893-89b3-f0387a2a5eb6 tempest-SnapshotDependencyTests-1095643674 None] Volume 33df7410-2a6d-4cf1-be85-23d8893807be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33df7410-2a6d-4cf1-be85-23d8893807be', 'volume_size': 1} Jul 07 17:41:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-fa96e13e-42ca-4893-89b3-f0387a2a5eb6 tempest-SnapshotDependencyTests-1095643674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ee262636-ee60-430e-b6ce-e7dd562cf779 tempest-CreateVolumesFromImageTest-1508703777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-dfb67a36-efcd-4dc3-a08b-5526404453b5" returned: 0 in 1.059s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ee262636-ee60-430e-b6ce-e7dd562cf779 tempest-CreateVolumesFromImageTest-1508703777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-dfb67a36-efcd-4dc3-a08b-5526404453b5 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:45 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:45 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-dfb67a36-efcd-4dc3-a08b-5526404453b5 Jul 07 17:41:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a1d56802-203b-4180-b609-54bfa1154ed5 tempest-CinderUnicodeTest-1153038688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-269b819f-8505-4e07-869e-794edc326641,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-269b819f-8505-4e07-869e-794edc326641.a6491aad-5590-4fe4-ba7a-e2bce4c30771 1G" returned: 0 in 1.065s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a1d56802-203b-4180-b609-54bfa1154ed5 tempest-CinderUnicodeTest-1153038688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-269b819f-8505-4e07-869e-794edc326641 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-269b819f-8505-4e07-869e-794edc326641.a6491aad-5590-4fe4-ba7a-e2bce4c30771 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:45 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:45 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-269b819f-8505-4e07-869e-794edc326641 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-269b819f-8505-4e07-869e-794edc326641.a6491aad-5590-4fe4-ba7a-e2bce4c30771 Jul 07 17:41:45 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:46 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ee262636-ee60-430e-b6ce-e7dd562cf779 tempest-CreateVolumesFromImageTest-1508703777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-dfb67a36-efcd-4dc3-a08b-5526404453b5" returned: 0 in 0.671s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:46 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ee262636-ee60-430e-b6ce-e7dd562cf779 tempest-CreateVolumesFromImageTest-1508703777 None] Lock "cinder-quobyte-dfb67a36-efcd-4dc3-a08b-5526404453b5" released by "delete_volume" :: held 1.798s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:46 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a1d56802-203b-4180-b609-54bfa1154ed5 tempest-CinderUnicodeTest-1153038688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-269b819f-8505-4e07-869e-794edc326641 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-269b819f-8505-4e07-869e-794edc326641.a6491aad-5590-4fe4-ba7a-e2bce4c30771" returned: 0 in 0.788s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:46 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-a1d56802-203b-4180-b609-54bfa1154ed5 tempest-CinderUnicodeTest-1153038688 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-269b819f-8505-4e07-869e-794edc326641.a6491aad-5590-4fe4-ba7a-e2bce4c30771 is being set with open permissions: ugo+rw Jul 07 17:41:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a1d56802-203b-4180-b609-54bfa1154ed5 tempest-CinderUnicodeTest-1153038688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-269b819f-8505-4e07-869e-794edc326641.a6491aad-5590-4fe4-ba7a-e2bce4c30771 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:46 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-ee262636-ee60-430e-b6ce-e7dd562cf779 tempest-CreateVolumesFromImageTest-1508703777 None] Created reservations ['3d993108-c0bf-4429-944b-d40f6970bd34', '5788768b-f83f-4f44-8fea-15761a548294', '5f0c34ef-bf4b-4b3d-9af8-e24447dbeacb', '802a14d1-eb52-4a9c-93bb-eda835fe9c2d'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:41:46 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-269b819f-8505-4e07-869e-794edc326641.a6491aad-5590-4fe4-ba7a-e2bce4c30771 Jul 07 17:41:46 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ee262636-ee60-430e-b6ce-e7dd562cf779 tempest-CreateVolumesFromImageTest-1508703777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ee262636-ee60-430e-b6ce-e7dd562cf779 tempest-CreateVolumesFromImageTest-1508703777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:46 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ee262636-ee60-430e-b6ce-e7dd562cf779 tempest-CreateVolumesFromImageTest-1508703777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:46 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ee262636-ee60-430e-b6ce-e7dd562cf779 tempest-CreateVolumesFromImageTest-1508703777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ee262636-ee60-430e-b6ce-e7dd562cf779 tempest-CreateVolumesFromImageTest-1508703777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ee262636-ee60-430e-b6ce-e7dd562cf779 tempest-CreateVolumesFromImageTest-1508703777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:46 devstack sudo[105986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:41:46 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:46 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c8e21f99-f9e6-48e5-884c-ae6e20a3de6d tempest-CreateVolumesFromImageTest-1508703777 None] Acquiring lock "cinder-0657ac7c-aac0-44c0-ab97-d4630a3332e3-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:46 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c8e21f99-f9e6-48e5-884c-ae6e20a3de6d tempest-CreateVolumesFromImageTest-1508703777 None] Lock "cinder-0657ac7c-aac0-44c0-ab97-d4630a3332e3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:46 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c8e21f99-f9e6-48e5-884c-ae6e20a3de6d tempest-CreateVolumesFromImageTest-1508703777 None] Acquiring lock "cinder-quobyte-0657ac7c-aac0-44c0-ab97-d4630a3332e3" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:46 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c8e21f99-f9e6-48e5-884c-ae6e20a3de6d tempest-CreateVolumesFromImageTest-1508703777 None] Lock "cinder-quobyte-0657ac7c-aac0-44c0-ab97-d4630a3332e3" acquired by "delete_volume" :: waited 0.040s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:46 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e2a5d2-629c-48b8-bb52-2733c4750bd6]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c8e21f99-f9e6-48e5-884c-ae6e20a3de6d tempest-CreateVolumesFromImageTest-1508703777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0657ac7c-aac0-44c0-ab97-d4630a3332e3 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:46 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0657ac7c-aac0-44c0-ab97-d4630a3332e3 Jul 07 17:41:46 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:47 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a1d56802-203b-4180-b609-54bfa1154ed5 tempest-CinderUnicodeTest-1153038688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-269b819f-8505-4e07-869e-794edc326641.a6491aad-5590-4fe4-ba7a-e2bce4c30771" returned: 0 in 0.776s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a1d56802-203b-4180-b609-54bfa1154ed5 tempest-CinderUnicodeTest-1153038688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-269b819f-8505-4e07-869e-794edc326641.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:47 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-269b819f-8505-4e07-869e-794edc326641.info Jul 07 17:41:47 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:47 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d90636b-d41d-48a5-9a61-49a48f8ec93b tempest-VolumeDependencyTests-1572773163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:41:47 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-1d90636b-d41d-48a5-9a61-49a48f8ec93b tempest-VolumeDependencyTests-1572773163 None] Flow 'volume_create_manager' (3335e1ba-24f2-4447-9826-c8c99bb49986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:47 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-1d90636b-d41d-48a5-9a61-49a48f8ec93b tempest-VolumeDependencyTests-1572773163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (141e8321-3d22-4b6b-8fb2-82807de1d881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:47 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-1d90636b-d41d-48a5-9a61-49a48f8ec93b tempest-VolumeDependencyTests-1572773163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (141e8321-3d22-4b6b-8fb2-82807de1d881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1289044578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb3094b4-dc7f-4146-8b43-b5dd08571e1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cb5b3d7549940e5b1736134bbc2f2d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:47Z,use_quota=True,user_id='796dd6ecf9884c659fb8432e0d99a4be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:47 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-1d90636b-d41d-48a5-9a61-49a48f8ec93b tempest-VolumeDependencyTests-1572773163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (395a16da-7771-47ca-a227-2fc12631cc84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:47 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-1d90636b-d41d-48a5-9a61-49a48f8ec93b tempest-VolumeDependencyTests-1572773163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (395a16da-7771-47ca-a227-2fc12631cc84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:47 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-1d90636b-d41d-48a5-9a61-49a48f8ec93b tempest-VolumeDependencyTests-1572773163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e163c09-68d3-41ba-9fbf-cd68238bb881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:47 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:47 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-1d90636b-d41d-48a5-9a61-49a48f8ec93b tempest-VolumeDependencyTests-1572773163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e163c09-68d3-41ba-9fbf-cd68238bb881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb3094b4-dc7f-4146-8b43-b5dd08571e1e', 'volume_name': 'volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:47 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-1d90636b-d41d-48a5-9a61-49a48f8ec93b tempest-VolumeDependencyTests-1572773163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95809f65-510f-4eb6-842e-8c69ad38b755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:47 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-1d90636b-d41d-48a5-9a61-49a48f8ec93b tempest-VolumeDependencyTests-1572773163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95809f65-510f-4eb6-842e-8c69ad38b755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:47 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-1d90636b-d41d-48a5-9a61-49a48f8ec93b tempest-VolumeDependencyTests-1572773163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f804482f-bfcd-4ac8-bce7-5fe6bd5ce146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:47 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-1d90636b-d41d-48a5-9a61-49a48f8ec93b tempest-VolumeDependencyTests-1572773163 None] Volume fb3094b4-dc7f-4146-8b43-b5dd08571e1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e', 'volume_size': 1} Jul 07 17:41:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1d90636b-d41d-48a5-9a61-49a48f8ec93b tempest-VolumeDependencyTests-1572773163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ee262636-ee60-430e-b6ce-e7dd562cf779 tempest-CreateVolumesFromImageTest-1508703777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.879s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:47 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-ee262636-ee60-430e-b6ce-e7dd562cf779 tempest-CreateVolumesFromImageTest-1508703777 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:41:47 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-ee262636-ee60-430e-b6ce-e7dd562cf779 tempest-CreateVolumesFromImageTest-1508703777 None] Deleted volume successfully. Jul 07 17:41:47 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ee262636-ee60-430e-b6ce-e7dd562cf779 tempest-CreateVolumesFromImageTest-1508703777 None] Lock "cinder-dfb67a36-efcd-4dc3-a08b-5526404453b5-delete_volume" released by "delete_volume" :: held 3.074s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:47 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c8e21f99-f9e6-48e5-884c-ae6e20a3de6d tempest-CreateVolumesFromImageTest-1508703777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0657ac7c-aac0-44c0-ab97-d4630a3332e3" returned: 0 in 0.889s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c8e21f99-f9e6-48e5-884c-ae6e20a3de6d tempest-CreateVolumesFromImageTest-1508703777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0657ac7c-aac0-44c0-ab97-d4630a3332e3 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:47 devstack sudo[105997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0657ac7c-aac0-44c0-ab97-d4630a3332e3 Jul 07 17:41:47 devstack sudo[105997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:47 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a1d56802-203b-4180-b609-54bfa1154ed5 tempest-CinderUnicodeTest-1153038688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-269b819f-8505-4e07-869e-794edc326641.info" returned: 0 in 0.721s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:47 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-a1d56802-203b-4180-b609-54bfa1154ed5 tempest-CinderUnicodeTest-1153038688 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-269b819f-8505-4e07-869e-794edc326641.info is being set with open permissions: ugo+rw Jul 07 17:41:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a1d56802-203b-4180-b609-54bfa1154ed5 tempest-CinderUnicodeTest-1153038688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-269b819f-8505-4e07-869e-794edc326641.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:47 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-269b819f-8505-4e07-869e-794edc326641.info Jul 07 17:41:47 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:48 devstack sudo[105997]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c8e21f99-f9e6-48e5-884c-ae6e20a3de6d tempest-CreateVolumesFromImageTest-1508703777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0657ac7c-aac0-44c0-ab97-d4630a3332e3" returned: 0 in 0.649s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:48 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c8e21f99-f9e6-48e5-884c-ae6e20a3de6d tempest-CreateVolumesFromImageTest-1508703777 None] Lock "cinder-quobyte-0657ac7c-aac0-44c0-ab97-d4630a3332e3" released by "delete_volume" :: held 1.602s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:48 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-c8e21f99-f9e6-48e5-884c-ae6e20a3de6d tempest-CreateVolumesFromImageTest-1508703777 None] Created reservations ['1ea9468e-2657-4a3b-9753-759c7f67a01d', 'c113e1e5-6c48-4dbc-be19-1813b1683c01', 'a3142cd3-30d3-4361-a9d7-f0f29dadec62', '67d58a93-930d-4ee3-8553-a6ad5b360b7b'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:41:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c8e21f99-f9e6-48e5-884c-ae6e20a3de6d tempest-CreateVolumesFromImageTest-1508703777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c8e21f99-f9e6-48e5-884c-ae6e20a3de6d tempest-CreateVolumesFromImageTest-1508703777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:48 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c8e21f99-f9e6-48e5-884c-ae6e20a3de6d tempest-CreateVolumesFromImageTest-1508703777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:48 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c8e21f99-f9e6-48e5-884c-ae6e20a3de6d tempest-CreateVolumesFromImageTest-1508703777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c8e21f99-f9e6-48e5-884c-ae6e20a3de6d tempest-CreateVolumesFromImageTest-1508703777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c8e21f99-f9e6-48e5-884c-ae6e20a3de6d tempest-CreateVolumesFromImageTest-1508703777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:48 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:41:48 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:48 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a1d56802-203b-4180-b609-54bfa1154ed5 tempest-CinderUnicodeTest-1153038688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-269b819f-8505-4e07-869e-794edc326641.info" returned: 0 in 0.632s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a1d56802-203b-4180-b609-54bfa1154ed5 tempest-CinderUnicodeTest-1153038688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.749s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-fa96e13e-42ca-4893-89b3-f0387a2a5eb6 tempest-SnapshotDependencyTests-1095643674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.013s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:48 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-fa96e13e-42ca-4893-89b3-f0387a2a5eb6 tempest-SnapshotDependencyTests-1095643674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1011198039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33df7410-2a6d-4cf1-be85-23d8893807be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c90cab656eb44e78e898d294b8704c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:45Z,use_quota=True,user_id='9bfd1f6d5d41463c8a28a8cfcdbcaec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:41:48 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-fa96e13e-42ca-4893-89b3-f0387a2a5eb6 tempest-SnapshotDependencyTests-1095643674 None] Creating volume 33df7410-2a6d-4cf1-be85-23d8893807be {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:41:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-fa96e13e-42ca-4893-89b3-f0387a2a5eb6 tempest-SnapshotDependencyTests-1095643674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-fa96e13e-42ca-4893-89b3-f0387a2a5eb6 tempest-SnapshotDependencyTests-1095643674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:48 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-fa96e13e-42ca-4893-89b3-f0387a2a5eb6 tempest-SnapshotDependencyTests-1095643674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:48 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-fa96e13e-42ca-4893-89b3-f0387a2a5eb6 tempest-SnapshotDependencyTests-1095643674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-fa96e13e-42ca-4893-89b3-f0387a2a5eb6 tempest-SnapshotDependencyTests-1095643674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:48 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-fa96e13e-42ca-4893-89b3-f0387a2a5eb6 tempest-SnapshotDependencyTests-1095643674 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:41:48 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-fa96e13e-42ca-4893-89b3-f0387a2a5eb6 tempest-SnapshotDependencyTests-1095643674 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:41:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fa96e13e-42ca-4893-89b3-f0387a2a5eb6 tempest-SnapshotDependencyTests-1095643674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:48 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be 1073741824 Jul 07 17:41:48 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:48 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-a1d56802-203b-4180-b609-54bfa1154ed5 tempest-CinderUnicodeTest-1153038688 None] Create snapshot completed successfully Jul 07 17:41:48 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-919ae48e-fc55-44d4-9d2a-2ca82d79a010 tempest-CreateVolumesFromImageTest-1508703777 None] Acquiring lock "cinder-0489535a-05e2-41c3-8f27-a7a649ed13c9-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:48 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-919ae48e-fc55-44d4-9d2a-2ca82d79a010 tempest-CreateVolumesFromImageTest-1508703777 None] Lock "cinder-0489535a-05e2-41c3-8f27-a7a649ed13c9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:48 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-919ae48e-fc55-44d4-9d2a-2ca82d79a010 tempest-CreateVolumesFromImageTest-1508703777 None] Acquiring lock "cinder-quobyte-0489535a-05e2-41c3-8f27-a7a649ed13c9" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:48 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-919ae48e-fc55-44d4-9d2a-2ca82d79a010 tempest-CreateVolumesFromImageTest-1508703777 None] Lock "cinder-quobyte-0489535a-05e2-41c3-8f27-a7a649ed13c9" acquired by "delete_volume" :: waited 0.020s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:48 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43f9a1b-3121-419b-bc67-214609483f84]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-919ae48e-fc55-44d4-9d2a-2ca82d79a010 tempest-CreateVolumesFromImageTest-1508703777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0489535a-05e2-41c3-8f27-a7a649ed13c9 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:49 devstack sudo[106008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0489535a-05e2-41c3-8f27-a7a649ed13c9 Jul 07 17:41:49 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:49 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-8bcd5465-481e-4142-abb6-6d2e3d599d59 tempest-CinderUnicodeTest-1153038688 None] Acquiring lock "cinder-a6491aad-5590-4fe4-ba7a-e2bce4c30771-delete_snapshot" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:49 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c8e21f99-f9e6-48e5-884c-ae6e20a3de6d tempest-CreateVolumesFromImageTest-1508703777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.727s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:49 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-c8e21f99-f9e6-48e5-884c-ae6e20a3de6d tempest-CreateVolumesFromImageTest-1508703777 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:41:49 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-c8e21f99-f9e6-48e5-884c-ae6e20a3de6d tempest-CreateVolumesFromImageTest-1508703777 None] Deleted volume successfully. Jul 07 17:41:49 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-8bcd5465-481e-4142-abb6-6d2e3d599d59 tempest-CinderUnicodeTest-1153038688 None] Lock "cinder-a6491aad-5590-4fe4-ba7a-e2bce4c30771-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:49 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-8bcd5465-481e-4142-abb6-6d2e3d599d59 tempest-CinderUnicodeTest-1153038688 None] Acquiring lock "cinder-quobyte-269b819f-8505-4e07-869e-794edc326641" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:49 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-8bcd5465-481e-4142-abb6-6d2e3d599d59 tempest-CinderUnicodeTest-1153038688 None] Lock "cinder-quobyte-269b819f-8505-4e07-869e-794edc326641" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:49 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-8bcd5465-481e-4142-abb6-6d2e3d599d59 tempest-CinderUnicodeTest-1153038688 None] Acquiring lock "cinder-quobyte-a6491aad-5590-4fe4-ba7a-e2bce4c30771" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:49 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c8e21f99-f9e6-48e5-884c-ae6e20a3de6d tempest-CreateVolumesFromImageTest-1508703777 None] Lock "cinder-0657ac7c-aac0-44c0-ab97-d4630a3332e3-delete_volume" released by "delete_volume" :: held 2.619s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:49 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-8bcd5465-481e-4142-abb6-6d2e3d599d59 tempest-CinderUnicodeTest-1153038688 None] Lock "cinder-quobyte-a6491aad-5590-4fe4-ba7a-e2bce4c30771" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:49 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-8bcd5465-481e-4142-abb6-6d2e3d599d59 tempest-CinderUnicodeTest-1153038688 None] Deleting offline snapshot a6491aad-5590-4fe4-ba7a-e2bce4c30771 of volume 269b819f-8505-4e07-869e-794edc326641 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:41:49 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-8bcd5465-481e-4142-abb6-6d2e3d599d59 tempest-CinderUnicodeTest-1153038688 None] snapshot_file for this snap is: volume-269b819f-8505-4e07-869e-794edc326641.a6491aad-5590-4fe4-ba7a-e2bce4c30771 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:41:49 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[536d0596-c368-473c-bed2-94593bae9109]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8bcd5465-481e-4142-abb6-6d2e3d599d59 tempest-CinderUnicodeTest-1153038688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-269b819f-8505-4e07-869e-794edc326641.a6491aad-5590-4fe4-ba7a-e2bce4c30771 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:49 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-269b819f-8505-4e07-869e-794edc326641.a6491aad-5590-4fe4-ba7a-e2bce4c30771 Jul 07 17:41:49 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:49 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fa96e13e-42ca-4893-89b3-f0387a2a5eb6 tempest-SnapshotDependencyTests-1095643674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be 1073741824" returned: 0 in 1.005s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fa96e13e-42ca-4893-89b3-f0387a2a5eb6 tempest-SnapshotDependencyTests-1095643674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:49 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be Jul 07 17:41:49 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:49 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-919ae48e-fc55-44d4-9d2a-2ca82d79a010 tempest-CreateVolumesFromImageTest-1508703777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0489535a-05e2-41c3-8f27-a7a649ed13c9" returned: 0 in 0.951s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-919ae48e-fc55-44d4-9d2a-2ca82d79a010 tempest-CreateVolumesFromImageTest-1508703777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0489535a-05e2-41c3-8f27-a7a649ed13c9 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:49 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0489535a-05e2-41c3-8f27-a7a649ed13c9 Jul 07 17:41:49 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:50 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8bcd5465-481e-4142-abb6-6d2e3d599d59 tempest-CinderUnicodeTest-1153038688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-269b819f-8505-4e07-869e-794edc326641.a6491aad-5590-4fe4-ba7a-e2bce4c30771" returned: 0 in 0.960s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:50 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-8bcd5465-481e-4142-abb6-6d2e3d599d59 tempest-CinderUnicodeTest-1153038688 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-269b819f-8505-4e07-869e-794edc326641(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:41:50 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3a0069-56bd-4529-b86f-7b0e0e1a1d2d]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8bcd5465-481e-4142-abb6-6d2e3d599d59 tempest-CinderUnicodeTest-1153038688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-269b819f-8505-4e07-869e-794edc326641 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:50 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:50 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-269b819f-8505-4e07-869e-794edc326641 Jul 07 17:41:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-fa96e13e-42ca-4893-89b3-f0387a2a5eb6 tempest-SnapshotDependencyTests-1095643674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be" returned: 0 in 0.724s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:50 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:50 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-fa96e13e-42ca-4893-89b3-f0387a2a5eb6 tempest-SnapshotDependencyTests-1095643674 None] <== create_volume: return (1811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:41:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-fa96e13e-42ca-4893-89b3-f0387a2a5eb6 tempest-SnapshotDependencyTests-1095643674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.816s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1d90636b-d41d-48a5-9a61-49a48f8ec93b tempest-VolumeDependencyTests-1572773163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.029s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:50 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-1d90636b-d41d-48a5-9a61-49a48f8ec93b tempest-VolumeDependencyTests-1572773163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1289044578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb3094b4-dc7f-4146-8b43-b5dd08571e1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cb5b3d7549940e5b1736134bbc2f2d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:47Z,use_quota=True,user_id='796dd6ecf9884c659fb8432e0d99a4be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:41:50 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-1d90636b-d41d-48a5-9a61-49a48f8ec93b tempest-VolumeDependencyTests-1572773163 None] Creating volume fb3094b4-dc7f-4146-8b43-b5dd08571e1e {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:41:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1d90636b-d41d-48a5-9a61-49a48f8ec93b tempest-VolumeDependencyTests-1572773163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1d90636b-d41d-48a5-9a61-49a48f8ec93b tempest-VolumeDependencyTests-1572773163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:50 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-1d90636b-d41d-48a5-9a61-49a48f8ec93b tempest-VolumeDependencyTests-1572773163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:50 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-1d90636b-d41d-48a5-9a61-49a48f8ec93b tempest-VolumeDependencyTests-1572773163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1d90636b-d41d-48a5-9a61-49a48f8ec93b tempest-VolumeDependencyTests-1572773163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:50 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-1d90636b-d41d-48a5-9a61-49a48f8ec93b tempest-VolumeDependencyTests-1572773163 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:41:50 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-1d90636b-d41d-48a5-9a61-49a48f8ec93b tempest-VolumeDependencyTests-1572773163 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:41:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1d90636b-d41d-48a5-9a61-49a48f8ec93b tempest-VolumeDependencyTests-1572773163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:50 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fa96e13e-42ca-4893-89b3-f0387a2a5eb6 tempest-SnapshotDependencyTests-1095643674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8020144c-d332-4ae0-8b44-f129209d073b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33df7410-2a6d-4cf1-be85-23d8893807be', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:50 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fa96e13e-42ca-4893-89b3-f0387a2a5eb6 tempest-SnapshotDependencyTests-1095643674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd1e91b6-580c-4d44-bf4c-a53569dd18a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:50 devstack sudo[106030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e 1073741824 Jul 07 17:41:50 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:50 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-fa96e13e-42ca-4893-89b3-f0387a2a5eb6 tempest-SnapshotDependencyTests-1095643674 None] Volume volume-33df7410-2a6d-4cf1-be85-23d8893807be (33df7410-2a6d-4cf1-be85-23d8893807be): created successfully Jul 07 17:41:50 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fa96e13e-42ca-4893-89b3-f0387a2a5eb6 tempest-SnapshotDependencyTests-1095643674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd1e91b6-580c-4d44-bf4c-a53569dd18a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:50 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-fa96e13e-42ca-4893-89b3-f0387a2a5eb6 tempest-SnapshotDependencyTests-1095643674 None] Flow 'volume_create_manager' (6b8a3804-b09b-4f17-a59d-0586694292a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:50 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-fa96e13e-42ca-4893-89b3-f0387a2a5eb6 tempest-SnapshotDependencyTests-1095643674 None] Created volume successfully. Jul 07 17:41:50 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-919ae48e-fc55-44d4-9d2a-2ca82d79a010 tempest-CreateVolumesFromImageTest-1508703777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0489535a-05e2-41c3-8f27-a7a649ed13c9" returned: 0 in 0.711s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:50 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-919ae48e-fc55-44d4-9d2a-2ca82d79a010 tempest-CreateVolumesFromImageTest-1508703777 None] Lock "cinder-quobyte-0489535a-05e2-41c3-8f27-a7a649ed13c9" released by "delete_volume" :: held 1.709s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:50 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-919ae48e-fc55-44d4-9d2a-2ca82d79a010 tempest-CreateVolumesFromImageTest-1508703777 None] Created reservations ['9eb1bb68-5fd6-44db-8bc6-0f66a3d32701', '5b54d921-7cef-44de-889a-e04f74a8a6a4', '2b47a4b5-63d4-4a49-9bab-beb319dc5859', 'b21bc0b0-82f5-4661-931a-82d691c8fc04'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:41:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-919ae48e-fc55-44d4-9d2a-2ca82d79a010 tempest-CreateVolumesFromImageTest-1508703777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-919ae48e-fc55-44d4-9d2a-2ca82d79a010 tempest-CreateVolumesFromImageTest-1508703777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:50 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-919ae48e-fc55-44d4-9d2a-2ca82d79a010 tempest-CreateVolumesFromImageTest-1508703777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:50 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-919ae48e-fc55-44d4-9d2a-2ca82d79a010 tempest-CreateVolumesFromImageTest-1508703777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-919ae48e-fc55-44d4-9d2a-2ca82d79a010 tempest-CreateVolumesFromImageTest-1508703777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-919ae48e-fc55-44d4-9d2a-2ca82d79a010 tempest-CreateVolumesFromImageTest-1508703777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:50 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:41:50 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e1893f65-f163-4ac4-95d2-2b19eb592178 tempest-SnapshotDependencyTests-1095643674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:51 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c9653de3-2082-4553-9962-a939c9a97e9e tempest-CreateVolumesFromImageTest-1508703777 None] Acquiring lock "cinder-a77d2aaf-d510-42b1-9e0d-2ba870ef055b-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:51 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c9653de3-2082-4553-9962-a939c9a97e9e tempest-CreateVolumesFromImageTest-1508703777 None] Lock "cinder-a77d2aaf-d510-42b1-9e0d-2ba870ef055b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:51 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8bcd5465-481e-4142-abb6-6d2e3d599d59 tempest-CinderUnicodeTest-1153038688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-269b819f-8505-4e07-869e-794edc326641" returned: 0 in 0.884s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8bcd5465-481e-4142-abb6-6d2e3d599d59 tempest-CinderUnicodeTest-1153038688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-269b819f-8505-4e07-869e-794edc326641.a6491aad-5590-4fe4-ba7a-e2bce4c30771 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:51 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-269b819f-8505-4e07-869e-794edc326641.a6491aad-5590-4fe4-ba7a-e2bce4c30771 Jul 07 17:41:51 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:51 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c9653de3-2082-4553-9962-a939c9a97e9e tempest-CreateVolumesFromImageTest-1508703777 None] Acquiring lock "cinder-quobyte-a77d2aaf-d510-42b1-9e0d-2ba870ef055b" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:51 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c9653de3-2082-4553-9962-a939c9a97e9e tempest-CreateVolumesFromImageTest-1508703777 None] Lock "cinder-quobyte-a77d2aaf-d510-42b1-9e0d-2ba870ef055b" acquired by "delete_volume" :: waited 0.029s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:51 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0267da56-52af-489e-965f-b7903c28aa0e]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c9653de3-2082-4553-9962-a939c9a97e9e tempest-CreateVolumesFromImageTest-1508703777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a77d2aaf-d510-42b1-9e0d-2ba870ef055b {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:51 devstack sudo[106044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a77d2aaf-d510-42b1-9e0d-2ba870ef055b Jul 07 17:41:51 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:51 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1d90636b-d41d-48a5-9a61-49a48f8ec93b tempest-VolumeDependencyTests-1572773163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e 1073741824" returned: 0 in 1.102s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1d90636b-d41d-48a5-9a61-49a48f8ec93b tempest-VolumeDependencyTests-1572773163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:51 devstack sudo[106047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e Jul 07 17:41:51 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:51 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-919ae48e-fc55-44d4-9d2a-2ca82d79a010 tempest-CreateVolumesFromImageTest-1508703777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.798s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:51 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-919ae48e-fc55-44d4-9d2a-2ca82d79a010 tempest-CreateVolumesFromImageTest-1508703777 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:41:51 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-919ae48e-fc55-44d4-9d2a-2ca82d79a010 tempest-CreateVolumesFromImageTest-1508703777 None] Deleted volume successfully. Jul 07 17:41:51 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-919ae48e-fc55-44d4-9d2a-2ca82d79a010 tempest-CreateVolumesFromImageTest-1508703777 None] Lock "cinder-0489535a-05e2-41c3-8f27-a7a649ed13c9-delete_volume" released by "delete_volume" :: held 2.763s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:51 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8bcd5465-481e-4142-abb6-6d2e3d599d59 tempest-CinderUnicodeTest-1153038688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-269b819f-8505-4e07-869e-794edc326641.a6491aad-5590-4fe4-ba7a-e2bce4c30771" returned: 0 in 0.811s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8bcd5465-481e-4142-abb6-6d2e3d599d59 tempest-CinderUnicodeTest-1153038688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-269b819f-8505-4e07-869e-794edc326641.a6491aad-5590-4fe4-ba7a-e2bce4c30771 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:51 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-269b819f-8505-4e07-869e-794edc326641.a6491aad-5590-4fe4-ba7a-e2bce4c30771 Jul 07 17:41:51 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:52 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c9653de3-2082-4553-9962-a939c9a97e9e tempest-CreateVolumesFromImageTest-1508703777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a77d2aaf-d510-42b1-9e0d-2ba870ef055b" returned: 0 in 0.847s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c9653de3-2082-4553-9962-a939c9a97e9e tempest-CreateVolumesFromImageTest-1508703777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a77d2aaf-d510-42b1-9e0d-2ba870ef055b {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:52 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a77d2aaf-d510-42b1-9e0d-2ba870ef055b Jul 07 17:41:52 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:52 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1d90636b-d41d-48a5-9a61-49a48f8ec93b tempest-VolumeDependencyTests-1572773163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e" returned: 0 in 0.672s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:52 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-1d90636b-d41d-48a5-9a61-49a48f8ec93b tempest-VolumeDependencyTests-1572773163 None] <== create_volume: return (1823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:41:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1d90636b-d41d-48a5-9a61-49a48f8ec93b tempest-VolumeDependencyTests-1572773163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.827s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e1893f65-f163-4ac4-95d2-2b19eb592178 tempest-SnapshotDependencyTests-1095643674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.149s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:52 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-1d90636b-d41d-48a5-9a61-49a48f8ec93b tempest-VolumeDependencyTests-1572773163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f804482f-bfcd-4ac8-bce7-5fe6bd5ce146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:52 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-1d90636b-d41d-48a5-9a61-49a48f8ec93b tempest-VolumeDependencyTests-1572773163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bbd188c-3cb4-4595-9a7f-fdb464aa65c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:52 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-e1893f65-f163-4ac4-95d2-2b19eb592178 tempest-SnapshotDependencyTests-1095643674 None] Creating offline snapshot 4c46e872-cf28-43af-b323-6e832a227270 of volume 33df7410-2a6d-4cf1-be85-23d8893807be {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:41:52 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-1d90636b-d41d-48a5-9a61-49a48f8ec93b tempest-VolumeDependencyTests-1572773163 None] Volume volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e (fb3094b4-dc7f-4146-8b43-b5dd08571e1e): created successfully Jul 07 17:41:52 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-1d90636b-d41d-48a5-9a61-49a48f8ec93b tempest-VolumeDependencyTests-1572773163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bbd188c-3cb4-4595-9a7f-fdb464aa65c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:52 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-1d90636b-d41d-48a5-9a61-49a48f8ec93b tempest-VolumeDependencyTests-1572773163 None] Flow 'volume_create_manager' (3335e1ba-24f2-4447-9826-c8c99bb49986) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:52 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1021a6-c5c9-427a-ac3c-b0992c085287]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e1893f65-f163-4ac4-95d2-2b19eb592178 tempest-SnapshotDependencyTests-1095643674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:52 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-1d90636b-d41d-48a5-9a61-49a48f8ec93b tempest-VolumeDependencyTests-1572773163 None] Created volume successfully. Jul 07 17:41:52 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be Jul 07 17:41:52 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:52 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8bcd5465-481e-4142-abb6-6d2e3d599d59 tempest-CinderUnicodeTest-1153038688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-269b819f-8505-4e07-869e-794edc326641.a6491aad-5590-4fe4-ba7a-e2bce4c30771" returned: 0 in 0.676s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:52 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-8bcd5465-481e-4142-abb6-6d2e3d599d59 tempest-CinderUnicodeTest-1153038688 None] Lock "cinder-quobyte-a6491aad-5590-4fe4-ba7a-e2bce4c30771" released by "_delete_snapshot" :: held 3.466s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:52 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-8bcd5465-481e-4142-abb6-6d2e3d599d59 tempest-CinderUnicodeTest-1153038688 None] Lock "cinder-quobyte-269b819f-8505-4e07-869e-794edc326641" released by "delete_snapshot" :: held 3.496s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-42a3982b-dbaa-4fdc-a873-2d58ac256b58 tempest-VolumeDependencyTests-1572773163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:52 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-8bcd5465-481e-4142-abb6-6d2e3d599d59 tempest-CinderUnicodeTest-1153038688 None] Created reservations ['909de315-0f58-4ade-95a0-2134375d3f5e', '4c7baefd-be68-455a-997b-b33057ffccf3', 'd724f874-bfd1-4d8c-8863-35bf13600858', '40f16ff9-064f-427b-a79a-2adc8eddafa9'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:41:52 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-8bcd5465-481e-4142-abb6-6d2e3d599d59 tempest-CinderUnicodeTest-1153038688 None] Delete snapshot completed successfully. Jul 07 17:41:52 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-8bcd5465-481e-4142-abb6-6d2e3d599d59 tempest-CinderUnicodeTest-1153038688 None] Lock "cinder-a6491aad-5590-4fe4-ba7a-e2bce4c30771-delete_snapshot" released by "delete_snapshot" :: held 3.660s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:52 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c9653de3-2082-4553-9962-a939c9a97e9e tempest-CreateVolumesFromImageTest-1508703777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-a77d2aaf-d510-42b1-9e0d-2ba870ef055b" returned: 0 in 0.747s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:52 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c9653de3-2082-4553-9962-a939c9a97e9e tempest-CreateVolumesFromImageTest-1508703777 None] Lock "cinder-quobyte-a77d2aaf-d510-42b1-9e0d-2ba870ef055b" released by "delete_volume" :: held 1.642s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:52 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-c9653de3-2082-4553-9962-a939c9a97e9e tempest-CreateVolumesFromImageTest-1508703777 None] Created reservations ['de0ce05d-8a01-4668-9813-134335a4f34a', 'd154fd67-4aa3-4194-9a24-ee07de668650', 'b50d04a3-1309-4a5f-a7bb-b7d4dd77a34a', '93fe83e2-385e-483a-9eed-667fc366d4ca'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:41:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c9653de3-2082-4553-9962-a939c9a97e9e tempest-CreateVolumesFromImageTest-1508703777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c9653de3-2082-4553-9962-a939c9a97e9e tempest-CreateVolumesFromImageTest-1508703777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:52 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c9653de3-2082-4553-9962-a939c9a97e9e tempest-CreateVolumesFromImageTest-1508703777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:52 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c9653de3-2082-4553-9962-a939c9a97e9e tempest-CreateVolumesFromImageTest-1508703777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c9653de3-2082-4553-9962-a939c9a97e9e tempest-CreateVolumesFromImageTest-1508703777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c9653de3-2082-4553-9962-a939c9a97e9e tempest-CreateVolumesFromImageTest-1508703777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:53 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:41:53 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:53 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e1893f65-f163-4ac4-95d2-2b19eb592178 tempest-SnapshotDependencyTests-1095643674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be" returned: 0 in 0.840s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e1893f65-f163-4ac4-95d2-2b19eb592178 tempest-SnapshotDependencyTests-1095643674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be.4c46e872-cf28-43af-b323-6e832a227270 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:53 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be.4c46e872-cf28-43af-b323-6e832a227270 1G Jul 07 17:41:53 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:53 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-09f2b89d-d5ec-4758-bcc7-28b279668bd6 tempest-CinderUnicodeTest-1153038688 None] Acquiring lock "cinder-269b819f-8505-4e07-869e-794edc326641-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:53 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-09f2b89d-d5ec-4758-bcc7-28b279668bd6 tempest-CinderUnicodeTest-1153038688 None] Lock "cinder-269b819f-8505-4e07-869e-794edc326641-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:53 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-09f2b89d-d5ec-4758-bcc7-28b279668bd6 tempest-CinderUnicodeTest-1153038688 None] Acquiring lock "cinder-quobyte-269b819f-8505-4e07-869e-794edc326641" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:53 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-09f2b89d-d5ec-4758-bcc7-28b279668bd6 tempest-CinderUnicodeTest-1153038688 None] Lock "cinder-quobyte-269b819f-8505-4e07-869e-794edc326641" acquired by "delete_volume" :: waited 0.028s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:53 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f69c2a7-3cdb-4548-8a9a-12089d6c6b59]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-09f2b89d-d5ec-4758-bcc7-28b279668bd6 tempest-CinderUnicodeTest-1153038688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-269b819f-8505-4e07-869e-794edc326641 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:53 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c9653de3-2082-4553-9962-a939c9a97e9e tempest-CreateVolumesFromImageTest-1508703777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.758s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:53 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-c9653de3-2082-4553-9962-a939c9a97e9e tempest-CreateVolumesFromImageTest-1508703777 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:41:53 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-c9653de3-2082-4553-9962-a939c9a97e9e tempest-CreateVolumesFromImageTest-1508703777 None] Deleted volume successfully. Jul 07 17:41:53 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c9653de3-2082-4553-9962-a939c9a97e9e tempest-CreateVolumesFromImageTest-1508703777 None] Lock "cinder-a77d2aaf-d510-42b1-9e0d-2ba870ef055b-delete_volume" released by "delete_volume" :: held 2.640s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:53 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-269b819f-8505-4e07-869e-794edc326641 Jul 07 17:41:53 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:54 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e1893f65-f163-4ac4-95d2-2b19eb592178 tempest-SnapshotDependencyTests-1095643674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be.4c46e872-cf28-43af-b323-6e832a227270 1G" returned: 0 in 0.929s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e1893f65-f163-4ac4-95d2-2b19eb592178 tempest-SnapshotDependencyTests-1095643674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33df7410-2a6d-4cf1-be85-23d8893807be -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be.4c46e872-cf28-43af-b323-6e832a227270 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:54 devstack sudo[106078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33df7410-2a6d-4cf1-be85-23d8893807be -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be.4c46e872-cf28-43af-b323-6e832a227270 Jul 07 17:41:54 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:54 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-09f2b89d-d5ec-4758-bcc7-28b279668bd6 tempest-CinderUnicodeTest-1153038688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-269b819f-8505-4e07-869e-794edc326641" returned: 0 in 0.875s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-09f2b89d-d5ec-4758-bcc7-28b279668bd6 tempest-CinderUnicodeTest-1153038688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-269b819f-8505-4e07-869e-794edc326641 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:54 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-269b819f-8505-4e07-869e-794edc326641 Jul 07 17:41:54 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:54 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e1893f65-f163-4ac4-95d2-2b19eb592178 tempest-SnapshotDependencyTests-1095643674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33df7410-2a6d-4cf1-be85-23d8893807be -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be.4c46e872-cf28-43af-b323-6e832a227270" returned: 0 in 0.786s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:54 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-e1893f65-f163-4ac4-95d2-2b19eb592178 tempest-SnapshotDependencyTests-1095643674 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be.4c46e872-cf28-43af-b323-6e832a227270 is being set with open permissions: ugo+rw Jul 07 17:41:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e1893f65-f163-4ac4-95d2-2b19eb592178 tempest-SnapshotDependencyTests-1095643674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be.4c46e872-cf28-43af-b323-6e832a227270 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:54 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be.4c46e872-cf28-43af-b323-6e832a227270 Jul 07 17:41:54 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:55 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-09f2b89d-d5ec-4758-bcc7-28b279668bd6 tempest-CinderUnicodeTest-1153038688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-269b819f-8505-4e07-869e-794edc326641" returned: 0 in 0.749s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:55 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-09f2b89d-d5ec-4758-bcc7-28b279668bd6 tempest-CinderUnicodeTest-1153038688 None] Lock "cinder-quobyte-269b819f-8505-4e07-869e-794edc326641" released by "delete_volume" :: held 1.713s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:55 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-09f2b89d-d5ec-4758-bcc7-28b279668bd6 tempest-CinderUnicodeTest-1153038688 None] Created reservations ['39ba4e3c-8f74-4dcc-87de-3b15e692bb4f', '61641f52-5e9a-4e84-88db-16ea6516344e', '7c578054-361c-4d1a-bb83-cb7d1338c4ff', '9f0d999d-2d67-40fa-a5b9-b8f6248006d1'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:41:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-09f2b89d-d5ec-4758-bcc7-28b279668bd6 tempest-CinderUnicodeTest-1153038688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-09f2b89d-d5ec-4758-bcc7-28b279668bd6 tempest-CinderUnicodeTest-1153038688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:55 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-09f2b89d-d5ec-4758-bcc7-28b279668bd6 tempest-CinderUnicodeTest-1153038688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:55 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:55 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-09f2b89d-d5ec-4758-bcc7-28b279668bd6 tempest-CinderUnicodeTest-1153038688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-09f2b89d-d5ec-4758-bcc7-28b279668bd6 tempest-CinderUnicodeTest-1153038688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-09f2b89d-d5ec-4758-bcc7-28b279668bd6 tempest-CinderUnicodeTest-1153038688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e1893f65-f163-4ac4-95d2-2b19eb592178 tempest-SnapshotDependencyTests-1095643674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be.4c46e872-cf28-43af-b323-6e832a227270" returned: 0 in 0.726s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:55 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:41:55 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e1893f65-f163-4ac4-95d2-2b19eb592178 tempest-SnapshotDependencyTests-1095643674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:55 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be.info Jul 07 17:41:55 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:55 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0738d142-1945-473d-891c-9e0a282665ee tempest-CinderUnicodeTest-1153038688 None] Acquiring lock "cinder-9c06e66f-ea13-446a-bf5c-a437ab7c70c5-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:55 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0738d142-1945-473d-891c-9e0a282665ee tempest-CinderUnicodeTest-1153038688 None] Lock "cinder-9c06e66f-ea13-446a-bf5c-a437ab7c70c5-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:55 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0738d142-1945-473d-891c-9e0a282665ee tempest-CinderUnicodeTest-1153038688 None] Acquiring lock "cinder-quobyte-9c06e66f-ea13-446a-bf5c-a437ab7c70c5" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:55 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0738d142-1945-473d-891c-9e0a282665ee tempest-CinderUnicodeTest-1153038688 None] Lock "cinder-quobyte-9c06e66f-ea13-446a-bf5c-a437ab7c70c5" acquired by "delete_volume" :: waited 0.019s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:55 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a17d234-a0cb-4fe2-93e4-f7b2943ba833]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0738d142-1945-473d-891c-9e0a282665ee tempest-CinderUnicodeTest-1153038688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-9c06e66f-ea13-446a-bf5c-a437ab7c70c5 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:55 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-9c06e66f-ea13-446a-bf5c-a437ab7c70c5 Jul 07 17:41:56 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:56 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-09f2b89d-d5ec-4758-bcc7-28b279668bd6 tempest-CinderUnicodeTest-1153038688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.737s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:56 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-09f2b89d-d5ec-4758-bcc7-28b279668bd6 tempest-CinderUnicodeTest-1153038688 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:41:56 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-09f2b89d-d5ec-4758-bcc7-28b279668bd6 tempest-CinderUnicodeTest-1153038688 None] Deleted volume successfully. Jul 07 17:41:56 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-09f2b89d-d5ec-4758-bcc7-28b279668bd6 tempest-CinderUnicodeTest-1153038688 None] Lock "cinder-269b819f-8505-4e07-869e-794edc326641-delete_volume" released by "delete_volume" :: held 2.834s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:56 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e1893f65-f163-4ac4-95d2-2b19eb592178 tempest-SnapshotDependencyTests-1095643674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be.info" returned: 0 in 0.870s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:56 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-e1893f65-f163-4ac4-95d2-2b19eb592178 tempest-SnapshotDependencyTests-1095643674 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be.info is being set with open permissions: ugo+rw Jul 07 17:41:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e1893f65-f163-4ac4-95d2-2b19eb592178 tempest-SnapshotDependencyTests-1095643674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:56 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be.info Jul 07 17:41:56 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:56 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0738d142-1945-473d-891c-9e0a282665ee tempest-CinderUnicodeTest-1153038688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-9c06e66f-ea13-446a-bf5c-a437ab7c70c5" returned: 0 in 0.849s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0738d142-1945-473d-891c-9e0a282665ee tempest-CinderUnicodeTest-1153038688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-9c06e66f-ea13-446a-bf5c-a437ab7c70c5 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:56 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-9c06e66f-ea13-446a-bf5c-a437ab7c70c5 Jul 07 17:41:56 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:57 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-e1893f65-f163-4ac4-95d2-2b19eb592178 tempest-SnapshotDependencyTests-1095643674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be.info" returned: 0 in 0.730s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-e1893f65-f163-4ac4-95d2-2b19eb592178 tempest-SnapshotDependencyTests-1095643674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.040s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-42a3982b-dbaa-4fdc-a873-2d58ac256b58 tempest-VolumeDependencyTests-1572773163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.521s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:57 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-42a3982b-dbaa-4fdc-a873-2d58ac256b58 tempest-VolumeDependencyTests-1572773163 None] Creating offline snapshot c233a37f-e5f0-44c0-b319-e889f8749594 of volume fb3094b4-dc7f-4146-8b43-b5dd08571e1e {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:41:57 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe78b87-e0be-43bd-96a7-e51c333961bd]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-42a3982b-dbaa-4fdc-a873-2d58ac256b58 tempest-VolumeDependencyTests-1572773163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:57 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-e1893f65-f163-4ac4-95d2-2b19eb592178 tempest-SnapshotDependencyTests-1095643674 None] Create snapshot completed successfully Jul 07 17:41:57 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e Jul 07 17:41:57 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:57 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0738d142-1945-473d-891c-9e0a282665ee tempest-CinderUnicodeTest-1153038688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-9c06e66f-ea13-446a-bf5c-a437ab7c70c5" returned: 0 in 0.755s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:57 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0738d142-1945-473d-891c-9e0a282665ee tempest-CinderUnicodeTest-1153038688 None] Lock "cinder-quobyte-9c06e66f-ea13-446a-bf5c-a437ab7c70c5" released by "delete_volume" :: held 1.658s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:57 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-0738d142-1945-473d-891c-9e0a282665ee tempest-CinderUnicodeTest-1153038688 None] Created reservations ['27e1ce3c-bc0b-45ac-beab-b7ddb95daaaf', '96f8bdc6-439d-48cb-b088-efeebec0c48a', '6d9a9678-d7e7-46da-b77b-a834d7c1c14a', 'eb191d9e-5c09-4538-8b4d-1ecbb0b43228'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:41:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0738d142-1945-473d-891c-9e0a282665ee tempest-CinderUnicodeTest-1153038688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0738d142-1945-473d-891c-9e0a282665ee tempest-CinderUnicodeTest-1153038688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:57 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-0738d142-1945-473d-891c-9e0a282665ee tempest-CinderUnicodeTest-1153038688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:57 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-0738d142-1945-473d-891c-9e0a282665ee tempest-CinderUnicodeTest-1153038688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0738d142-1945-473d-891c-9e0a282665ee tempest-CinderUnicodeTest-1153038688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0738d142-1945-473d-891c-9e0a282665ee tempest-CinderUnicodeTest-1153038688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:57 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:41:57 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:58 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-42a3982b-dbaa-4fdc-a873-2d58ac256b58 tempest-VolumeDependencyTests-1572773163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e" returned: 0 in 0.820s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-42a3982b-dbaa-4fdc-a873-2d58ac256b58 tempest-VolumeDependencyTests-1572773163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e.c233a37f-e5f0-44c0-b319-e889f8749594 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:58 devstack sudo[106118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e.c233a37f-e5f0-44c0-b319-e889f8749594 1G Jul 07 17:41:58 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:58 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0738d142-1945-473d-891c-9e0a282665ee tempest-CinderUnicodeTest-1153038688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.751s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:58 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-0738d142-1945-473d-891c-9e0a282665ee tempest-CinderUnicodeTest-1153038688 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:41:58 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-0738d142-1945-473d-891c-9e0a282665ee tempest-CinderUnicodeTest-1153038688 None] Deleted volume successfully. Jul 07 17:41:58 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0738d142-1945-473d-891c-9e0a282665ee tempest-CinderUnicodeTest-1153038688 None] Lock "cinder-9c06e66f-ea13-446a-bf5c-a437ab7c70c5-delete_volume" released by "delete_volume" :: held 2.698s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:59 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-42a3982b-dbaa-4fdc-a873-2d58ac256b58 tempest-VolumeDependencyTests-1572773163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e.c233a37f-e5f0-44c0-b319-e889f8749594 1G" returned: 0 in 1.048s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-42a3982b-dbaa-4fdc-a873-2d58ac256b58 tempest-VolumeDependencyTests-1572773163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e.c233a37f-e5f0-44c0-b319-e889f8749594 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:59 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e.c233a37f-e5f0-44c0-b319-e889f8749594 Jul 07 17:41:59 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:59 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:41:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Flow 'volume_create_manager' (7812525d-f047-4980-86aa-d1606a2170b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5218b8b4-aa5f-4fa6-9bcf-5f3458429477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5218b8b4-aa5f-4fa6-9bcf-5f3458429477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=882006cc-d67c-4526-b251-032bcbc15eec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c90cab656eb44e78e898d294b8704c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4c46e872-cf28-43af-b323-6e832a227270,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:59Z,use_quota=True,user_id='9bfd1f6d5d41463c8a28a8cfcdbcaec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18b6ec21-19bb-42b7-b887-3bef97f0f9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18b6ec21-19bb-42b7-b887-3bef97f0f9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08adf9e8-5de6-4255-8920-fbc26bcd115a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08adf9e8-5de6-4255-8920-fbc26bcd115a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '882006cc-d67c-4526-b251-032bcbc15eec', 'volume_name': 'volume-882006cc-d67c-4526-b251-032bcbc15eec', 'volume_size': 1, 'snapshot_id': '4c46e872-cf28-43af-b323-6e832a227270'}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26501717-f670-4b0c-9f17-d5be375a1d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26501717-f670-4b0c-9f17-d5be375a1d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b57cf7fc-1470-4230-91c6-e55306016638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:59 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Volume 882006cc-d67c-4526-b251-032bcbc15eec: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-882006cc-d67c-4526-b251-032bcbc15eec', 'volume_size': 1, 'snapshot_id': '4c46e872-cf28-43af-b323-6e832a227270'} Jul 07 17:41:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:59 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:41:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Flow 'volume_create_manager' (bb0ab704-446e-44a4-b5b0-f8e841c258bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dc1a748-8cb8-460b-ad6d-4cdb0e17f9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dc1a748-8cb8-460b-ad6d-4cdb0e17f9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a08a8b3-6729-4d47-aac4-5d9a4cf0c875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7cca335d2b842b98d25037cb8a0e02e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:42:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:42:00Z,use_quota=True,user_id='e0cd660a56384f1f9c23a86b5058d860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (018876e1-d840-4772-b807-59e281b38d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (018876e1-d840-4772-b807-59e281b38d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:59 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18cf7581-6c38-4a7c-8023-6f321d0c15ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:59 devstack cinder-volume[87233]: DEBUG cinder.image.glance [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Creating Keystone auth plugin from conf {{(pid=87233) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 17:42:00 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-42a3982b-dbaa-4fdc-a873-2d58ac256b58 tempest-VolumeDependencyTests-1572773163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e.c233a37f-e5f0-44c0-b319-e889f8749594" returned: 0 in 0.838s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:00 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-42a3982b-dbaa-4fdc-a873-2d58ac256b58 tempest-VolumeDependencyTests-1572773163 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e.c233a37f-e5f0-44c0-b319-e889f8749594 is being set with open permissions: ugo+rw Jul 07 17:42:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-42a3982b-dbaa-4fdc-a873-2d58ac256b58 tempest-VolumeDependencyTests-1572773163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e.c233a37f-e5f0-44c0-b319-e889f8749594 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:00 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e.c233a37f-e5f0-44c0-b319-e889f8749594 Jul 07 17:42:00 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:00 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18cf7581-6c38-4a7c-8023-6f321d0c15ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4a08a8b3-6729-4d47-aac4-5d9a4cf0c875', 'volume_name': 'volume-4a08a8b3-6729-4d47-aac4-5d9a4cf0c875', 'volume_size': 1, 'image_id': '390ae2fd-cb80-424b-8357-66c59fae0d60', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/390ae2fd-cb80-424b-8357-66c59fae0d60', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd9d2248917d497cd6e3f1afac8cde89f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a7cca335d2b842b98d25037cb8a0e02e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b2ea827f143b3d3ae5c0b09df25f1af274f3395bac09eb517c13eee64ea72549a17f5c91f41d87d69c14b5c789e4cbea025e015ea3965d1fe3de93053b47b8dc', 'id': '390ae2fd-cb80-424b-8357-66c59fae0d60', 'created_at': datetime.datetime(2026, 7, 7, 15, 41, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 41, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/390ae2fd-cb80-424b-8357-66c59fae0d60/file', 'properties': {}}, 'image_service': }' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:00 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed5c825a-e7a1-495e-8013-3002a3ad1c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:00 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed5c825a-e7a1-495e-8013-3002a3ad1c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:00 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3572eb68-ed8a-47d3-a8b4-d47c7412cd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:00 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Volume 4a08a8b3-6729-4d47-aac4-5d9a4cf0c875: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4a08a8b3-6729-4d47-aac4-5d9a4cf0c875', 'volume_size': 1, 'image_id': '390ae2fd-cb80-424b-8357-66c59fae0d60', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/390ae2fd-cb80-424b-8357-66c59fae0d60', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd9d2248917d497cd6e3f1afac8cde89f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a7cca335d2b842b98d25037cb8a0e02e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b2ea827f143b3d3ae5c0b09df25f1af274f3395bac09eb517c13eee64ea72549a17f5c91f41d87d69c14b5c789e4cbea025e015ea3965d1fe3de93053b47b8dc', 'id': '390ae2fd-cb80-424b-8357-66c59fae0d60', 'created_at': datetime.datetime(2026, 7, 7, 15, 41, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 41, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/390ae2fd-cb80-424b-8357-66c59fae0d60/file', 'properties': {}}, 'image_service': } Jul 07 17:42:00 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Trying to clone 4a08a8b3-6729-4d47-aac4-5d9a4cf0c875 from image 390ae2fd-cb80-424b-8357-66c59fae0d60 at location (None, [{'url': 'file:///opt/stack/data/glance/images/390ae2fd-cb80-424b-8357-66c59fae0d60', 'metadata': {}}]). {{(pid=87233) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 17:42:00 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_390ae2fd-cb80-424b-8357-66c59fae0d60_nzovclp6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87233) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 17:42:00 devstack cinder-volume[87233]: INFO cinder.image.image_utils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Image download 0.00 MB at 0.00 MB/s Jul 07 17:42:00 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75133fa-daf6-4aa8-b447-39b50ef2b504]: (4, 'raw') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_390ae2fd-cb80-424b-8357-66c59fae0d60_nzovclp6devstack@QuobyteHD {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:00 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_390ae2fd-cb80-424b-8357-66c59fae0d60_nzovclp6devstack@QuobyteHD Jul 07 17:42:00 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:00 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-42a3982b-dbaa-4fdc-a873-2d58ac256b58 tempest-VolumeDependencyTests-1572773163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e.c233a37f-e5f0-44c0-b319-e889f8749594" returned: 0 in 0.695s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-42a3982b-dbaa-4fdc-a873-2d58ac256b58 tempest-VolumeDependencyTests-1572773163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:00 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e.info Jul 07 17:42:00 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:01 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_390ae2fd-cb80-424b-8357-66c59fae0d60_nzovclp6devstack@QuobyteHD" returned: 0 in 0.777s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_390ae2fd-cb80-424b-8357-66c59fae0d60_nzovclp6devstack@QuobyteHD {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:01 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_390ae2fd-cb80-424b-8357-66c59fae0d60_nzovclp6devstack@QuobyteHD Jul 07 17:42:01 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:01 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-42a3982b-dbaa-4fdc-a873-2d58ac256b58 tempest-VolumeDependencyTests-1572773163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e.info" returned: 0 in 0.758s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:01 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-42a3982b-dbaa-4fdc-a873-2d58ac256b58 tempest-VolumeDependencyTests-1572773163 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e.info is being set with open permissions: ugo+rw Jul 07 17:42:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-42a3982b-dbaa-4fdc-a873-2d58ac256b58 tempest-VolumeDependencyTests-1572773163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:01 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e.info Jul 07 17:42:01 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:01 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_390ae2fd-cb80-424b-8357-66c59fae0d60_nzovclp6devstack@QuobyteHD" returned: 1 in 0.799s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_390ae2fd-cb80-424b-8357-66c59fae0d60_nzovclp6devstack@QuobyteHD' failed. Not Retrying. {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:42:01 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Temporary image 390ae2fd-cb80-424b-8357-66c59fae0d60 is fetched for user e0cd660a56384f1f9c23a86b5058d860. {{(pid=87233) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 17:42:01 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc473abb-4963-4f3f-8a63-9b6d5751c7e4]: (4, 'raw') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_390ae2fd-cb80-424b-8357-66c59fae0d60_nzovclp6devstack@QuobyteHD {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:02 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_390ae2fd-cb80-424b-8357-66c59fae0d60_nzovclp6devstack@QuobyteHD Jul 07 17:42:02 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:02 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-42a3982b-dbaa-4fdc-a873-2d58ac256b58 tempest-VolumeDependencyTests-1572773163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e.info" returned: 0 in 0.691s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-42a3982b-dbaa-4fdc-a873-2d58ac256b58 tempest-VolumeDependencyTests-1572773163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.986s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.860s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:02 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Acquiring lock "cinder-quobyte-4c46e872-cf28-43af-b323-6e832a227270-882006cc-d67c-4526-b251-032bcbc15eec" by "_create_volume_from_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:02 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Lock "cinder-quobyte-4c46e872-cf28-43af-b323-6e832a227270-882006cc-d67c-4526-b251-032bcbc15eec" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:02 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Creating volume 882006cc-d67c-4526-b251-032bcbc15eec from snapshot 4c46e872-cf28-43af-b323-6e832a227270 {{(pid=87233) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 17:42:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:02 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:02 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:02 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:42:02 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Acquiring lock "cinder-quobyte-882006cc-d67c-4526-b251-032bcbc15eec" by "_copy_volume_from_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:02 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-42a3982b-dbaa-4fdc-a873-2d58ac256b58 tempest-VolumeDependencyTests-1572773163 None] Create snapshot completed successfully Jul 07 17:42:02 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Lock "cinder-quobyte-882006cc-d67c-4526-b251-032bcbc15eec" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:02 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] snapshot: 4c46e872-cf28-43af-b323-6e832a227270, volume: 882006cc-d67c-4526-b251-032bcbc15eec, {{(pid=87233) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 17:42:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:02 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:02 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:02 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af1340a-98b5-46d8-ac9c-4d579b156a95]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be.4c46e872-cf28-43af-b323-6e832a227270 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:02 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be.4c46e872-cf28-43af-b323-6e832a227270 Jul 07 17:42:02 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:02 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_390ae2fd-cb80-424b-8357-66c59fae0d60_nzovclp6devstack@QuobyteHD" returned: 0 in 0.749s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_390ae2fd-cb80-424b-8357-66c59fae0d60_nzovclp6devstack@QuobyteHD {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:02 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_390ae2fd-cb80-424b-8357-66c59fae0d60_nzovclp6devstack@QuobyteHD Jul 07 17:42:02 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:03 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be.4c46e872-cf28-43af-b323-6e832a227270" returned: 0 in 0.894s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:03 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33df7410-2a6d-4cf1-be85-23d8893807be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:42:03 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] will copy from snapshot at /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be {{(pid=87233) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 17:42:03 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Creating direct copy from snapshot {{(pid=87233) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 17:42:03 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d66524-d0ab-4aa5-b438-61c9845bbdbe]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:03 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be Jul 07 17:42:03 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:03 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_390ae2fd-cb80-424b-8357-66c59fae0d60_nzovclp6devstack@QuobyteHD" returned: 1 in 0.848s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_390ae2fd-cb80-424b-8357-66c59fae0d60_nzovclp6devstack@QuobyteHD' failed. Not Retrying. {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:42:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:03 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:42:03 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Flow 'volume_create_manager' (a1dec819-f636-4284-a7f0-e5708be85b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:42:03 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83ce2a92-cf6f-48ee-9ccb-6f467575c0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:03 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83ce2a92-cf6f-48ee-9ccb-6f467575c0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-460763810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab1ff9f4-bb9e-489d-b96a-9f1b43ccd463,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cb5b3d7549940e5b1736134bbc2f2d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:42:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c233a37f-e5f0-44c0-b319-e889f8749594,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:42:04Z,use_quota=True,user_id='796dd6ecf9884c659fb8432e0d99a4be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e3c0519-2e49-4433-b39a-0f1251378526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e3c0519-2e49-4433-b39a-0f1251378526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa5a88cb-6c5f-49b1-b80d-7b920f4f5895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa5a88cb-6c5f-49b1-b80d-7b920f4f5895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ab1ff9f4-bb9e-489d-b96a-9f1b43ccd463', 'volume_name': 'volume-ab1ff9f4-bb9e-489d-b96a-9f1b43ccd463', 'volume_size': 1, 'snapshot_id': 'c233a37f-e5f0-44c0-b319-e889f8749594'}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83c684f7-3839-441d-97c8-30681551eaa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83c684f7-3839-441d-97c8-30681551eaa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:04 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4b4ae2d-fecf-46e6-8f0f-7b1d375b592f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:04 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Volume ab1ff9f4-bb9e-489d-b96a-9f1b43ccd463: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ab1ff9f4-bb9e-489d-b96a-9f1b43ccd463', 'volume_size': 1, 'snapshot_id': 'c233a37f-e5f0-44c0-b319-e889f8749594'} Jul 07 17:42:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:04 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be" returned: 0 in 0.976s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:04 devstack cinder-volume[87233]: DEBUG cinder.utils [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Path /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-882006cc-d67c-4526-b251-032bcbc15eec not found in is_blk_device check {{(pid=87233) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 17:42:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-882006cc-d67c-4526-b251-032bcbc15eec {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:04 devstack sudo[106170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-882006cc-d67c-4526-b251-032bcbc15eec Jul 07 17:42:04 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:09 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7d3f22b-bcb9-4274-8247-bc8b5ec3a5e1 tempest-ProjectMemberTests-232601277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:42:09 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d7d3f22b-bcb9-4274-8247-bc8b5ec3a5e1 tempest-ProjectMemberTests-232601277 None] Flow 'volume_create_manager' (66454648-bc5f-4c3e-a190-be1f5ca378b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:42:09 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d7d3f22b-bcb9-4274-8247-bc8b5ec3a5e1 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27465b32-cc64-4e1d-9f52-ec374ca2033c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:09 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d7d3f22b-bcb9-4274-8247-bc8b5ec3a5e1 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27465b32-cc64-4e1d-9f52-ec374ca2033c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1544007410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8da59c9-a0fc-4a67-9750-85dc0c77a39e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='126630bddcf5433fb704f04aac171bde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:42:09Z,use_quota=True,user_id='f03110d4128243fca6ab7f6b4b51123a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:09 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d7d3f22b-bcb9-4274-8247-bc8b5ec3a5e1 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aca659b-0016-4d6d-860c-ce01ce99e498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:09 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d7d3f22b-bcb9-4274-8247-bc8b5ec3a5e1 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aca659b-0016-4d6d-860c-ce01ce99e498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:09 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d7d3f22b-bcb9-4274-8247-bc8b5ec3a5e1 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2a8b362-1ac5-4b6e-9d39-359318538b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:09 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d7d3f22b-bcb9-4274-8247-bc8b5ec3a5e1 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2a8b362-1ac5-4b6e-9d39-359318538b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8da59c9-a0fc-4a67-9750-85dc0c77a39e', 'volume_name': 'volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:09 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d7d3f22b-bcb9-4274-8247-bc8b5ec3a5e1 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c33896a-19d6-4057-b4ef-1cb739c77ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:09 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d7d3f22b-bcb9-4274-8247-bc8b5ec3a5e1 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c33896a-19d6-4057-b4ef-1cb739c77ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:09 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d7d3f22b-bcb9-4274-8247-bc8b5ec3a5e1 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11bd4cde-fb43-41e5-9a65-fb80a7aab762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:09 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-d7d3f22b-bcb9-4274-8247-bc8b5ec3a5e1 tempest-ProjectMemberTests-232601277 None] Volume f8da59c9-a0fc-4a67-9750-85dc0c77a39e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e', 'volume_size': 1} Jul 07 17:42:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d7d3f22b-bcb9-4274-8247-bc8b5ec3a5e1 tempest-ProjectMemberTests-232601277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:09 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-882006cc-d67c-4526-b251-032bcbc15eec" returned: 0 in 5.292s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:09 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[12fea4c6-eee9-4027-947a-44dd0aec14bc]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:09 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be Jul 07 17:42:09 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:10 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be" returned: 0 in 0.882s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:10 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Image conversion details: src /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be, size 1024.00 MB, duration 5.29 sec, destination /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-882006cc-d67c-4526-b251-032bcbc15eec {{(pid=87233) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:42:10 devstack cinder-volume[87233]: INFO cinder.image.image_utils [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Converted 1024.00 MB image at 193.46 MB/s Jul 07 17:42:10 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-882006cc-d67c-4526-b251-032bcbc15eec is being set with open permissions: ugo+rw Jul 07 17:42:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-882006cc-d67c-4526-b251-032bcbc15eec {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:10 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-882006cc-d67c-4526-b251-032bcbc15eec Jul 07 17:42:10 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:11 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-882006cc-d67c-4526-b251-032bcbc15eec" returned: 0 in 0.622s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:11 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Lock "cinder-quobyte-882006cc-d67c-4526-b251-032bcbc15eec" released by "_copy_volume_from_snapshot" :: held 8.788s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:11 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Lock "cinder-quobyte-4c46e872-cf28-43af-b323-6e832a227270-882006cc-d67c-4526-b251-032bcbc15eec" released by "_create_volume_from_snapshot" :: held 8.826s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.850s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.493s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:11 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a08a8b3-6729-4d47-aac4-5d9a4cf0c875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7cca335d2b842b98d25037cb8a0e02e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:42:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:42:00Z,use_quota=True,user_id='e0cd660a56384f1f9c23a86b5058d860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:42:11 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Creating volume 4a08a8b3-6729-4d47-aac4-5d9a4cf0c875 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:42:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:11 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:11 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:11 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:42:11 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:42:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4a08a8b3-6729-4d47-aac4-5d9a4cf0c875 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:11 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4a08a8b3-6729-4d47-aac4-5d9a4cf0c875 1073741824 Jul 07 17:42:11 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:11 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b57cf7fc-1470-4230-91c6-e55306016638) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-882006cc-d67c-4526-b251-032bcbc15eec', 'volume_size': 1, 'snapshot_id': '4c46e872-cf28-43af-b323-6e832a227270'}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:11 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05e9c322-6e6d-447b-bfa3-28682c1ae5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:11 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Volume volume-882006cc-d67c-4526-b251-032bcbc15eec (882006cc-d67c-4526-b251-032bcbc15eec): created successfully Jul 07 17:42:11 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05e9c322-6e6d-447b-bfa3-28682c1ae5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:11 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Flow 'volume_create_manager' (7812525d-f047-4980-86aa-d1606a2170b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:42:11 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-770b1703-35d2-4df3-bcf6-edd8ab809a92 tempest-SnapshotDependencyTests-1095643674 None] Created volume successfully. Jul 07 17:42:11 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4a08a8b3-6729-4d47-aac4-5d9a4cf0c875 1073741824" returned: 0 in 0.783s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4a08a8b3-6729-4d47-aac4-5d9a4cf0c875 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:11 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4a08a8b3-6729-4d47-aac4-5d9a4cf0c875 Jul 07 17:42:11 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:12 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0ebd2fd0-c6c8-4b39-9bde-80d61f2d7630 tempest-SnapshotDependencyTests-1095643674 None] Acquiring lock "cinder-4c46e872-cf28-43af-b323-6e832a227270-delete_snapshot" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:12 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0ebd2fd0-c6c8-4b39-9bde-80d61f2d7630 tempest-SnapshotDependencyTests-1095643674 None] Lock "cinder-4c46e872-cf28-43af-b323-6e832a227270-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:12 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0ebd2fd0-c6c8-4b39-9bde-80d61f2d7630 tempest-SnapshotDependencyTests-1095643674 None] Acquiring lock "cinder-quobyte-33df7410-2a6d-4cf1-be85-23d8893807be" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:12 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0ebd2fd0-c6c8-4b39-9bde-80d61f2d7630 tempest-SnapshotDependencyTests-1095643674 None] Lock "cinder-quobyte-33df7410-2a6d-4cf1-be85-23d8893807be" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:12 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0ebd2fd0-c6c8-4b39-9bde-80d61f2d7630 tempest-SnapshotDependencyTests-1095643674 None] Acquiring lock "cinder-quobyte-4c46e872-cf28-43af-b323-6e832a227270" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:12 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0ebd2fd0-c6c8-4b39-9bde-80d61f2d7630 tempest-SnapshotDependencyTests-1095643674 None] Lock "cinder-quobyte-4c46e872-cf28-43af-b323-6e832a227270" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:12 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-0ebd2fd0-c6c8-4b39-9bde-80d61f2d7630 tempest-SnapshotDependencyTests-1095643674 None] Deleting offline snapshot 4c46e872-cf28-43af-b323-6e832a227270 of volume 33df7410-2a6d-4cf1-be85-23d8893807be {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:42:12 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-0ebd2fd0-c6c8-4b39-9bde-80d61f2d7630 tempest-SnapshotDependencyTests-1095643674 None] snapshot_file for this snap is: volume-33df7410-2a6d-4cf1-be85-23d8893807be.4c46e872-cf28-43af-b323-6e832a227270 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:42:12 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e0ad71-51d4-4a7d-bc76-b5c435efd12b]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0ebd2fd0-c6c8-4b39-9bde-80d61f2d7630 tempest-SnapshotDependencyTests-1095643674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be.4c46e872-cf28-43af-b323-6e832a227270 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:12 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be.4c46e872-cf28-43af-b323-6e832a227270 Jul 07 17:42:12 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:12 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4a08a8b3-6729-4d47-aac4-5d9a4cf0c875" returned: 0 in 0.617s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:12 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] <== create_volume: return (1433ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:42:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.437s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 8.483s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:12 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Acquiring lock "cinder-quobyte-c233a37f-e5f0-44c0-b319-e889f8749594-ab1ff9f4-bb9e-489d-b96a-9f1b43ccd463" by "_create_volume_from_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:12 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Lock "cinder-quobyte-c233a37f-e5f0-44c0-b319-e889f8749594-ab1ff9f4-bb9e-489d-b96a-9f1b43ccd463" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:12 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Creating volume ab1ff9f4-bb9e-489d-b96a-9f1b43ccd463 from snapshot c233a37f-e5f0-44c0-b319-e889f8749594 {{(pid=87233) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 17:42:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:12 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:12 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:12 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:42:12 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Acquiring lock "cinder-quobyte-ab1ff9f4-bb9e-489d-b96a-9f1b43ccd463" by "_copy_volume_from_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:12 devstack cinder-volume[87233]: DEBUG cinder.volume.volume_utils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Attempting download of 390ae2fd-cb80-424b-8357-66c59fae0d60 ((None, [{'url': 'file:///opt/stack/data/glance/images/390ae2fd-cb80-424b-8357-66c59fae0d60', 'metadata': {}}])) to volume 4a08a8b3-6729-4d47-aac4-5d9a4cf0c875. {{(pid=87233) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 17:42:12 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Lock "cinder-quobyte-ab1ff9f4-bb9e-489d-b96a-9f1b43ccd463" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:12 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] snapshot: c233a37f-e5f0-44c0-b319-e889f8749594, volume: ab1ff9f4-bb9e-489d-b96a-9f1b43ccd463, {{(pid=87233) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 17:42:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:12 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:12 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:12 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae3b2a4-0a72-4fdf-888a-c6f7df06dcc6]: (4, 'raw') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_390ae2fd-cb80-424b-8357-66c59fae0d60_jhyad4os {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:12 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f9c2fd-8191-4f42-9916-5af5d3a8b78e]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e.c233a37f-e5f0-44c0-b319-e889f8749594 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:12 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_390ae2fd-cb80-424b-8357-66c59fae0d60_jhyad4os Jul 07 17:42:12 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:12 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e.c233a37f-e5f0-44c0-b319-e889f8749594 Jul 07 17:42:12 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:13 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0ebd2fd0-c6c8-4b39-9bde-80d61f2d7630 tempest-SnapshotDependencyTests-1095643674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be.4c46e872-cf28-43af-b323-6e832a227270" returned: 0 in 0.783s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:13 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-0ebd2fd0-c6c8-4b39-9bde-80d61f2d7630 tempest-SnapshotDependencyTests-1095643674 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33df7410-2a6d-4cf1-be85-23d8893807be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:42:13 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21be08a-c621-4072-beb2-7fd79a51e1b0]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0ebd2fd0-c6c8-4b39-9bde-80d61f2d7630 tempest-SnapshotDependencyTests-1095643674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:13 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be Jul 07 17:42:13 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:13 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_390ae2fd-cb80-424b-8357-66c59fae0d60_jhyad4os" returned: 0 in 0.729s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_390ae2fd-cb80-424b-8357-66c59fae0d60_jhyad4os {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:13 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e.c233a37f-e5f0-44c0-b319-e889f8749594" returned: 0 in 0.770s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:13 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:42:13 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] will copy from snapshot at /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e {{(pid=87233) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 17:42:13 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Creating direct copy from snapshot {{(pid=87233) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 17:42:13 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b93d80c-ab6d-4988-a74e-185cc64c0cb8]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:13 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_390ae2fd-cb80-424b-8357-66c59fae0d60_jhyad4os Jul 07 17:42:13 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:13 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e Jul 07 17:42:13 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:13 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0ebd2fd0-c6c8-4b39-9bde-80d61f2d7630 tempest-SnapshotDependencyTests-1095643674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be" returned: 0 in 0.809s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0ebd2fd0-c6c8-4b39-9bde-80d61f2d7630 tempest-SnapshotDependencyTests-1095643674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be.4c46e872-cf28-43af-b323-6e832a227270 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:13 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be.4c46e872-cf28-43af-b323-6e832a227270 Jul 07 17:42:13 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:14 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_390ae2fd-cb80-424b-8357-66c59fae0d60_jhyad4os" returned: 1 in 0.750s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_390ae2fd-cb80-424b-8357-66c59fae0d60_jhyad4os' failed. Not Retrying. {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:42:14 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c28c9c-501e-4520-a6b9-5b2279d894a1]: (4, 'raw') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_390ae2fd-cb80-424b-8357-66c59fae0d60_nzovclp6devstack@QuobyteHD {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:14 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_390ae2fd-cb80-424b-8357-66c59fae0d60_nzovclp6devstack@QuobyteHD Jul 07 17:42:14 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:14 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e" returned: 0 in 0.797s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:14 devstack cinder-volume[87233]: DEBUG cinder.utils [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Path /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ab1ff9f4-bb9e-489d-b96a-9f1b43ccd463 not found in is_blk_device check {{(pid=87233) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 17:42:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ab1ff9f4-bb9e-489d-b96a-9f1b43ccd463 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:14 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ab1ff9f4-bb9e-489d-b96a-9f1b43ccd463 Jul 07 17:42:14 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:14 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0ebd2fd0-c6c8-4b39-9bde-80d61f2d7630 tempest-SnapshotDependencyTests-1095643674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be.4c46e872-cf28-43af-b323-6e832a227270" returned: 0 in 0.808s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0ebd2fd0-c6c8-4b39-9bde-80d61f2d7630 tempest-SnapshotDependencyTests-1095643674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be.4c46e872-cf28-43af-b323-6e832a227270 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:14 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be.4c46e872-cf28-43af-b323-6e832a227270 Jul 07 17:42:14 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:14 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_390ae2fd-cb80-424b-8357-66c59fae0d60_nzovclp6devstack@QuobyteHD" returned: 0 in 0.778s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_390ae2fd-cb80-424b-8357-66c59fae0d60_nzovclp6devstack@QuobyteHD {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:15 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_390ae2fd-cb80-424b-8357-66c59fae0d60_nzovclp6devstack@QuobyteHD Jul 07 17:42:15 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:16 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:16 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0ebd2fd0-c6c8-4b39-9bde-80d61f2d7630 tempest-SnapshotDependencyTests-1095643674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be.4c46e872-cf28-43af-b323-6e832a227270" returned: 0 in 1.593s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_390ae2fd-cb80-424b-8357-66c59fae0d60_nzovclp6devstack@QuobyteHD" returned: 1 in 1.316s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_390ae2fd-cb80-424b-8357-66c59fae0d60_nzovclp6devstack@QuobyteHD' failed. Not Retrying. {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:42:16 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] 390ae2fd-cb80-424b-8357-66c59fae0d60 was raw, converting to raw {{(pid=87233) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 17:42:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_390ae2fd-cb80-424b-8357-66c59fae0d60_nzovclp6devstack@QuobyteHD /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4a08a8b3-6729-4d47-aac4-5d9a4cf0c875 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:16 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_390ae2fd-cb80-424b-8357-66c59fae0d60_nzovclp6devstack@QuobyteHD /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4a08a8b3-6729-4d47-aac4-5d9a4cf0c875 Jul 07 17:42:16 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:16 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0ebd2fd0-c6c8-4b39-9bde-80d61f2d7630 tempest-SnapshotDependencyTests-1095643674 None] Lock "cinder-quobyte-4c46e872-cf28-43af-b323-6e832a227270" released by "_delete_snapshot" :: held 4.208s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:16 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0ebd2fd0-c6c8-4b39-9bde-80d61f2d7630 tempest-SnapshotDependencyTests-1095643674 None] Lock "cinder-quobyte-33df7410-2a6d-4cf1-be85-23d8893807be" released by "delete_snapshot" :: held 4.245s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:16 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-0ebd2fd0-c6c8-4b39-9bde-80d61f2d7630 tempest-SnapshotDependencyTests-1095643674 None] Created reservations ['27cb0d0b-d919-4a31-b434-74e07d95dc28', 'a84c2b46-d884-49d5-8569-dfe22ed97d83', 'd18ecc1c-923c-4eb1-8c71-73173db65ba2', '249d7d30-c36d-4ef6-a464-fb5afa217f17'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:42:16 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-0ebd2fd0-c6c8-4b39-9bde-80d61f2d7630 tempest-SnapshotDependencyTests-1095643674 None] Delete snapshot completed successfully. Jul 07 17:42:16 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0ebd2fd0-c6c8-4b39-9bde-80d61f2d7630 tempest-SnapshotDependencyTests-1095643674 None] Lock "cinder-4c46e872-cf28-43af-b323-6e832a227270-delete_snapshot" released by "delete_snapshot" :: held 4.508s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:17 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a3c1af9e-5edf-4dba-bf68-016001ca34a1 tempest-SnapshotDependencyTests-1095643674 None] Acquiring lock "cinder-33df7410-2a6d-4cf1-be85-23d8893807be-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:17 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a3c1af9e-5edf-4dba-bf68-016001ca34a1 tempest-SnapshotDependencyTests-1095643674 None] Lock "cinder-33df7410-2a6d-4cf1-be85-23d8893807be-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:17 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a3c1af9e-5edf-4dba-bf68-016001ca34a1 tempest-SnapshotDependencyTests-1095643674 None] Acquiring lock "cinder-quobyte-33df7410-2a6d-4cf1-be85-23d8893807be" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:17 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a3c1af9e-5edf-4dba-bf68-016001ca34a1 tempest-SnapshotDependencyTests-1095643674 None] Lock "cinder-quobyte-33df7410-2a6d-4cf1-be85-23d8893807be" acquired by "delete_volume" :: waited 0.032s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:17 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_390ae2fd-cb80-424b-8357-66c59fae0d60_nzovclp6devstack@QuobyteHD /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4a08a8b3-6729-4d47-aac4-5d9a4cf0c875" returned: 0 in 1.553s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:17 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_390ae2fd-cb80-424b-8357-66c59fae0d60_nzovclp6devstack@QuobyteHD, size 0.00 MB, duration 1.55 sec, destination /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4a08a8b3-6729-4d47-aac4-5d9a4cf0c875 {{(pid=87233) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:42:17 devstack cinder-volume[87233]: INFO cinder.image.image_utils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 17:42:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4a08a8b3-6729-4d47-aac4-5d9a4cf0c875 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:17 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[187dfe3d-5133-41d8-acde-907654c1075c]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a3c1af9e-5edf-4dba-bf68-016001ca34a1 tempest-SnapshotDependencyTests-1095643674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:17 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4a08a8b3-6729-4d47-aac4-5d9a4cf0c875 1G Jul 07 17:42:17 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:18 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be Jul 07 17:42:18 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:19 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ab1ff9f4-bb9e-489d-b96a-9f1b43ccd463" returned: 0 in 5.436s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:19 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:19 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[39965044-06d2-4738-8626-ce51d8289eec]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a3c1af9e-5edf-4dba-bf68-016001ca34a1 tempest-SnapshotDependencyTests-1095643674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be" returned: 0 in 1.870s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a3c1af9e-5edf-4dba-bf68-016001ca34a1 tempest-SnapshotDependencyTests-1095643674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:19 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be Jul 07 17:42:19 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:19 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4a08a8b3-6729-4d47-aac4-5d9a4cf0c875 1G" returned: 0 in 1.989s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:19 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e Jul 07 17:42:19 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:19 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8b9416-8e88-48d8-8371-b908db28867a]: (4, 'raw') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4a08a8b3-6729-4d47-aac4-5d9a4cf0c875 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:19 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4a08a8b3-6729-4d47-aac4-5d9a4cf0c875 Jul 07 17:42:19 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:20 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a3c1af9e-5edf-4dba-bf68-016001ca34a1 tempest-SnapshotDependencyTests-1095643674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-33df7410-2a6d-4cf1-be85-23d8893807be" returned: 0 in 0.665s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:20 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a3c1af9e-5edf-4dba-bf68-016001ca34a1 tempest-SnapshotDependencyTests-1095643674 None] Lock "cinder-quobyte-33df7410-2a6d-4cf1-be85-23d8893807be" released by "delete_volume" :: held 2.665s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:20 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-a3c1af9e-5edf-4dba-bf68-016001ca34a1 tempest-SnapshotDependencyTests-1095643674 None] Created reservations ['76fb4c6c-8934-4429-8af5-62a1e1f17f1a', 'f902b54c-e023-42f1-94a4-69f3c7d93021', '828cbd22-6c8a-4d16-8eeb-ec56753d94de', '2eda7c84-e3ee-44a6-a235-af5491a67fd3'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:42:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a3c1af9e-5edf-4dba-bf68-016001ca34a1 tempest-SnapshotDependencyTests-1095643674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a3c1af9e-5edf-4dba-bf68-016001ca34a1 tempest-SnapshotDependencyTests-1095643674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:20 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-a3c1af9e-5edf-4dba-bf68-016001ca34a1 tempest-SnapshotDependencyTests-1095643674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:20 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-a3c1af9e-5edf-4dba-bf68-016001ca34a1 tempest-SnapshotDependencyTests-1095643674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a3c1af9e-5edf-4dba-bf68-016001ca34a1 tempest-SnapshotDependencyTests-1095643674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a3c1af9e-5edf-4dba-bf68-016001ca34a1 tempest-SnapshotDependencyTests-1095643674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:20 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:42:20 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:20 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4a08a8b3-6729-4d47-aac4-5d9a4cf0c875" returned: 0 in 0.912s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4a08a8b3-6729-4d47-aac4-5d9a4cf0c875 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:20 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e" returned: 0 in 1.136s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:20 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Image conversion details: src /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e, size 1024.00 MB, duration 5.44 sec, destination /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ab1ff9f4-bb9e-489d-b96a-9f1b43ccd463 {{(pid=87233) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:42:20 devstack cinder-volume[87233]: INFO cinder.image.image_utils [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Converted 1024.00 MB image at 188.32 MB/s Jul 07 17:42:20 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ab1ff9f4-bb9e-489d-b96a-9f1b43ccd463 is being set with open permissions: ugo+rw Jul 07 17:42:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ab1ff9f4-bb9e-489d-b96a-9f1b43ccd463 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:20 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ab1ff9f4-bb9e-489d-b96a-9f1b43ccd463 Jul 07 17:42:20 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:20 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4a08a8b3-6729-4d47-aac4-5d9a4cf0c875 Jul 07 17:42:20 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:21 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c3831dea-838b-4a82-bcc2-f82502231637 tempest-SnapshotDependencyTests-1095643674 None] Acquiring lock "cinder-882006cc-d67c-4526-b251-032bcbc15eec-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:21 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c3831dea-838b-4a82-bcc2-f82502231637 tempest-SnapshotDependencyTests-1095643674 None] Lock "cinder-882006cc-d67c-4526-b251-032bcbc15eec-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:21 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c3831dea-838b-4a82-bcc2-f82502231637 tempest-SnapshotDependencyTests-1095643674 None] Acquiring lock "cinder-quobyte-882006cc-d67c-4526-b251-032bcbc15eec" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:21 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c3831dea-838b-4a82-bcc2-f82502231637 tempest-SnapshotDependencyTests-1095643674 None] Lock "cinder-quobyte-882006cc-d67c-4526-b251-032bcbc15eec" acquired by "delete_volume" :: waited 0.030s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:21 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9e7194-48ab-46b3-8de6-1338d296f6ca]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c3831dea-838b-4a82-bcc2-f82502231637 tempest-SnapshotDependencyTests-1095643674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-882006cc-d67c-4526-b251-032bcbc15eec {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:21 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:21 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-882006cc-d67c-4526-b251-032bcbc15eec Jul 07 17:42:21 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a3c1af9e-5edf-4dba-bf68-016001ca34a1 tempest-SnapshotDependencyTests-1095643674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.835s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:21 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-a3c1af9e-5edf-4dba-bf68-016001ca34a1 tempest-SnapshotDependencyTests-1095643674 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:42:21 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-a3c1af9e-5edf-4dba-bf68-016001ca34a1 tempest-SnapshotDependencyTests-1095643674 None] Deleted volume successfully. Jul 07 17:42:21 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a3c1af9e-5edf-4dba-bf68-016001ca34a1 tempest-SnapshotDependencyTests-1095643674 None] Lock "cinder-33df7410-2a6d-4cf1-be85-23d8893807be-delete_volume" released by "delete_volume" :: held 3.861s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:21 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4a08a8b3-6729-4d47-aac4-5d9a4cf0c875" returned: 1 in 0.916s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4a08a8b3-6729-4d47-aac4-5d9a4cf0c875' failed. Not Retrying. {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:42:21 devstack cinder-volume[87233]: DEBUG cinder.volume.volume_utils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Downloaded image 390ae2fd-cb80-424b-8357-66c59fae0d60 ((None, [{'url': 'file:///opt/stack/data/glance/images/390ae2fd-cb80-424b-8357-66c59fae0d60', 'metadata': {}}])) to volume 4a08a8b3-6729-4d47-aac4-5d9a4cf0c875 successfully. {{(pid=87233) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 17:42:21 devstack cinder-volume[87233]: DEBUG cinder.image.image_utils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Temporary image 390ae2fd-cb80-424b-8357-66c59fae0d60 for user e0cd660a56384f1f9c23a86b5058d860 is deleted. {{(pid=87233) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 17:42:21 devstack cinder-volume[87233]: DEBUG cinder.volume.volume_utils [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Marking volume 4a08a8b3-6729-4d47-aac4-5d9a4cf0c875 as bootable. {{(pid=87233) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 17:42:21 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Copying metadata from image 390ae2fd-cb80-424b-8357-66c59fae0d60 to 4a08a8b3-6729-4d47-aac4-5d9a4cf0c875. {{(pid=87233) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 17:42:21 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Creating volume glance metadata for volume 4a08a8b3-6729-4d47-aac4-5d9a4cf0c875 backed by image 390ae2fd-cb80-424b-8357-66c59fae0d60 with: {'image_id': '390ae2fd-cb80-424b-8357-66c59fae0d60', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'd9d2248917d497cd6e3f1afac8cde89f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87233) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 17:42:21 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ab1ff9f4-bb9e-489d-b96a-9f1b43ccd463" returned: 0 in 0.879s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:21 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Lock "cinder-quobyte-ab1ff9f4-bb9e-489d-b96a-9f1b43ccd463" released by "_copy_volume_from_snapshot" :: held 9.173s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:21 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Lock "cinder-quobyte-c233a37f-e5f0-44c0-b319-e889f8749594-ab1ff9f4-bb9e-489d-b96a-9f1b43ccd463" released by "_create_volume_from_snapshot" :: held 9.223s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.252s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d7d3f22b-bcb9-4274-8247-bc8b5ec3a5e1 tempest-ProjectMemberTests-232601277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.238s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:21 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d7d3f22b-bcb9-4274-8247-bc8b5ec3a5e1 tempest-ProjectMemberTests-232601277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1544007410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8da59c9-a0fc-4a67-9750-85dc0c77a39e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='126630bddcf5433fb704f04aac171bde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:42:09Z,use_quota=True,user_id='f03110d4128243fca6ab7f6b4b51123a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:42:21 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-d7d3f22b-bcb9-4274-8247-bc8b5ec3a5e1 tempest-ProjectMemberTests-232601277 None] Creating volume f8da59c9-a0fc-4a67-9750-85dc0c77a39e {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:42:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d7d3f22b-bcb9-4274-8247-bc8b5ec3a5e1 tempest-ProjectMemberTests-232601277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d7d3f22b-bcb9-4274-8247-bc8b5ec3a5e1 tempest-ProjectMemberTests-232601277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:21 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d7d3f22b-bcb9-4274-8247-bc8b5ec3a5e1 tempest-ProjectMemberTests-232601277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:21 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d7d3f22b-bcb9-4274-8247-bc8b5ec3a5e1 tempest-ProjectMemberTests-232601277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d7d3f22b-bcb9-4274-8247-bc8b5ec3a5e1 tempest-ProjectMemberTests-232601277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:21 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d7d3f22b-bcb9-4274-8247-bc8b5ec3a5e1 tempest-ProjectMemberTests-232601277 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:42:21 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-d7d3f22b-bcb9-4274-8247-bc8b5ec3a5e1 tempest-ProjectMemberTests-232601277 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:42:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d7d3f22b-bcb9-4274-8247-bc8b5ec3a5e1 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:21 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e 1073741824 Jul 07 17:42:21 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:21 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4b4ae2d-fecf-46e6-8f0f-7b1d375b592f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab1ff9f4-bb9e-489d-b96a-9f1b43ccd463', 'volume_size': 1, 'snapshot_id': 'c233a37f-e5f0-44c0-b319-e889f8749594'}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:21 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2422e98-897a-46f7-9883-b8ae7a89cd25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:21 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Volume volume-ab1ff9f4-bb9e-489d-b96a-9f1b43ccd463 (ab1ff9f4-bb9e-489d-b96a-9f1b43ccd463): created successfully Jul 07 17:42:21 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2422e98-897a-46f7-9883-b8ae7a89cd25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:21 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Flow 'volume_create_manager' (a1dec819-f636-4284-a7f0-e5708be85b45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:42:21 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-36aeb0d7-c81c-4bef-88aa-7636f56991cd tempest-VolumeDependencyTests-1572773163 None] Created volume successfully. Jul 07 17:42:21 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3572eb68-ed8a-47d3-a8b4-d47c7412cd27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a08a8b3-6729-4d47-aac4-5d9a4cf0c875', 'volume_size': 1, 'image_id': '390ae2fd-cb80-424b-8357-66c59fae0d60', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/390ae2fd-cb80-424b-8357-66c59fae0d60', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd9d2248917d497cd6e3f1afac8cde89f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a7cca335d2b842b98d25037cb8a0e02e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b2ea827f143b3d3ae5c0b09df25f1af274f3395bac09eb517c13eee64ea72549a17f5c91f41d87d69c14b5c789e4cbea025e015ea3965d1fe3de93053b47b8dc', 'id': '390ae2fd-cb80-424b-8357-66c59fae0d60', 'created_at': datetime.datetime(2026, 7, 7, 15, 41, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 41, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/390ae2fd-cb80-424b-8357-66c59fae0d60/file', 'properties': {}}, 'image_service': }' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:21 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afd576d3-ea10-40f6-bb5f-14a95111d954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:21 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Volume volume-4a08a8b3-6729-4d47-aac4-5d9a4cf0c875 (4a08a8b3-6729-4d47-aac4-5d9a4cf0c875): created successfully Jul 07 17:42:21 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afd576d3-ea10-40f6-bb5f-14a95111d954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:21 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Flow 'volume_create_manager' (bb0ab704-446e-44a4-b5b0-f8e841c258bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:42:21 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-88480780-c0bd-4127-b62d-5eb9afa564f6 tempest-VolumeImageDependencyTests-769457399 None] Created volume successfully. Jul 07 17:42:22 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c3831dea-838b-4a82-bcc2-f82502231637 tempest-SnapshotDependencyTests-1095643674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-882006cc-d67c-4526-b251-032bcbc15eec" returned: 0 in 0.824s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c3831dea-838b-4a82-bcc2-f82502231637 tempest-SnapshotDependencyTests-1095643674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-882006cc-d67c-4526-b251-032bcbc15eec {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:22 devstack sudo[106342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-882006cc-d67c-4526-b251-032bcbc15eec Jul 07 17:42:22 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:22 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d7d3f22b-bcb9-4274-8247-bc8b5ec3a5e1 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e 1073741824" returned: 0 in 0.862s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d7d3f22b-bcb9-4274-8247-bc8b5ec3a5e1 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:22 devstack sudo[106353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e Jul 07 17:42:22 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:22 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c3831dea-838b-4a82-bcc2-f82502231637 tempest-SnapshotDependencyTests-1095643674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-882006cc-d67c-4526-b251-032bcbc15eec" returned: 0 in 0.653s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:22 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c3831dea-838b-4a82-bcc2-f82502231637 tempest-SnapshotDependencyTests-1095643674 None] Lock "cinder-quobyte-882006cc-d67c-4526-b251-032bcbc15eec" released by "delete_volume" :: held 1.545s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:22 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6f15ddac-82b1-48e0-a9ac-501f6147be05 tempest-VolumeDependencyTests-1572773163 None] Acquiring lock "cinder-c233a37f-e5f0-44c0-b319-e889f8749594-delete_snapshot" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:22 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-c3831dea-838b-4a82-bcc2-f82502231637 tempest-SnapshotDependencyTests-1095643674 None] Created reservations ['9c8819fe-beed-400a-96c4-08ff6471b035', '8afa3583-580a-4090-9a56-fbc48c3c75a7', '45998fca-1411-4224-a368-c134e5aa372f', '6523a8e6-5b0b-4dbe-a886-de7da683eb0e'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:42:22 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6f15ddac-82b1-48e0-a9ac-501f6147be05 tempest-VolumeDependencyTests-1572773163 None] Lock "cinder-c233a37f-e5f0-44c0-b319-e889f8749594-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:22 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6f15ddac-82b1-48e0-a9ac-501f6147be05 tempest-VolumeDependencyTests-1572773163 None] Acquiring lock "cinder-quobyte-fb3094b4-dc7f-4146-8b43-b5dd08571e1e" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:22 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6f15ddac-82b1-48e0-a9ac-501f6147be05 tempest-VolumeDependencyTests-1572773163 None] Lock "cinder-quobyte-fb3094b4-dc7f-4146-8b43-b5dd08571e1e" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:22 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6f15ddac-82b1-48e0-a9ac-501f6147be05 tempest-VolumeDependencyTests-1572773163 None] Acquiring lock "cinder-quobyte-c233a37f-e5f0-44c0-b319-e889f8749594" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:22 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6f15ddac-82b1-48e0-a9ac-501f6147be05 tempest-VolumeDependencyTests-1572773163 None] Lock "cinder-quobyte-c233a37f-e5f0-44c0-b319-e889f8749594" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:23 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-6f15ddac-82b1-48e0-a9ac-501f6147be05 tempest-VolumeDependencyTests-1572773163 None] Deleting offline snapshot c233a37f-e5f0-44c0-b319-e889f8749594 of volume fb3094b4-dc7f-4146-8b43-b5dd08571e1e {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:42:23 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-6f15ddac-82b1-48e0-a9ac-501f6147be05 tempest-VolumeDependencyTests-1572773163 None] snapshot_file for this snap is: volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e.c233a37f-e5f0-44c0-b319-e889f8749594 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:42:23 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-12d56c9c-a491-47aa-9f06-a1b1f566ec53 tempest-VolumeImageDependencyTests-769457399 None] Acquiring lock "cinder-4a08a8b3-6729-4d47-aac4-5d9a4cf0c875-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:23 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f6f037-abaf-4aa5-8f83-79a722dddb22]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6f15ddac-82b1-48e0-a9ac-501f6147be05 tempest-VolumeDependencyTests-1572773163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e.c233a37f-e5f0-44c0-b319-e889f8749594 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:23 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-12d56c9c-a491-47aa-9f06-a1b1f566ec53 tempest-VolumeImageDependencyTests-769457399 None] Lock "cinder-4a08a8b3-6729-4d47-aac4-5d9a4cf0c875-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c3831dea-838b-4a82-bcc2-f82502231637 tempest-SnapshotDependencyTests-1095643674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c3831dea-838b-4a82-bcc2-f82502231637 tempest-SnapshotDependencyTests-1095643674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:23 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c3831dea-838b-4a82-bcc2-f82502231637 tempest-SnapshotDependencyTests-1095643674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:23 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c3831dea-838b-4a82-bcc2-f82502231637 tempest-SnapshotDependencyTests-1095643674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c3831dea-838b-4a82-bcc2-f82502231637 tempest-SnapshotDependencyTests-1095643674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c3831dea-838b-4a82-bcc2-f82502231637 tempest-SnapshotDependencyTests-1095643674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:23 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-12d56c9c-a491-47aa-9f06-a1b1f566ec53 tempest-VolumeImageDependencyTests-769457399 None] Acquiring lock "cinder-quobyte-4a08a8b3-6729-4d47-aac4-5d9a4cf0c875" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:23 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:42:23 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:23 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-12d56c9c-a491-47aa-9f06-a1b1f566ec53 tempest-VolumeImageDependencyTests-769457399 None] Lock "cinder-quobyte-4a08a8b3-6729-4d47-aac4-5d9a4cf0c875" acquired by "delete_volume" :: waited 0.020s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:23 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e.c233a37f-e5f0-44c0-b319-e889f8749594 Jul 07 17:42:23 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:23 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc7818d-9ecd-412f-b926-6d7fc77b9e3d]: (4, 'raw') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-12d56c9c-a491-47aa-9f06-a1b1f566ec53 tempest-VolumeImageDependencyTests-769457399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4a08a8b3-6729-4d47-aac4-5d9a4cf0c875 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:23 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4a08a8b3-6729-4d47-aac4-5d9a4cf0c875 Jul 07 17:42:23 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:23 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d7d3f22b-bcb9-4274-8247-bc8b5ec3a5e1 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e" returned: 0 in 0.841s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:23 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d7d3f22b-bcb9-4274-8247-bc8b5ec3a5e1 tempest-ProjectMemberTests-232601277 None] <== create_volume: return (1744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:42:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d7d3f22b-bcb9-4274-8247-bc8b5ec3a5e1 tempest-ProjectMemberTests-232601277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.746s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:23 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d7d3f22b-bcb9-4274-8247-bc8b5ec3a5e1 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11bd4cde-fb43-41e5-9a65-fb80a7aab762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:23 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d7d3f22b-bcb9-4274-8247-bc8b5ec3a5e1 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e60876a-a241-44bb-98c9-28ae88418972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:23 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-d7d3f22b-bcb9-4274-8247-bc8b5ec3a5e1 tempest-ProjectMemberTests-232601277 None] Volume volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e (f8da59c9-a0fc-4a67-9750-85dc0c77a39e): created successfully Jul 07 17:42:23 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d7d3f22b-bcb9-4274-8247-bc8b5ec3a5e1 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e60876a-a241-44bb-98c9-28ae88418972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:23 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d7d3f22b-bcb9-4274-8247-bc8b5ec3a5e1 tempest-ProjectMemberTests-232601277 None] Flow 'volume_create_manager' (66454648-bc5f-4c3e-a190-be1f5ca378b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:42:23 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-d7d3f22b-bcb9-4274-8247-bc8b5ec3a5e1 tempest-ProjectMemberTests-232601277 None] Created volume successfully. Jul 07 17:42:23 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6f15ddac-82b1-48e0-a9ac-501f6147be05 tempest-VolumeDependencyTests-1572773163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e.c233a37f-e5f0-44c0-b319-e889f8749594" returned: 0 in 0.921s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:23 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-6f15ddac-82b1-48e0-a9ac-501f6147be05 tempest-VolumeDependencyTests-1572773163 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:42:23 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c3831dea-838b-4a82-bcc2-f82502231637 tempest-SnapshotDependencyTests-1095643674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.863s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:23 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-c3831dea-838b-4a82-bcc2-f82502231637 tempest-SnapshotDependencyTests-1095643674 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:42:24 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-c3831dea-838b-4a82-bcc2-f82502231637 tempest-SnapshotDependencyTests-1095643674 None] Deleted volume successfully. Jul 07 17:42:24 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d0405d-4b17-4b95-a337-531f6f6b7786]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6f15ddac-82b1-48e0-a9ac-501f6147be05 tempest-VolumeDependencyTests-1572773163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:24 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c3831dea-838b-4a82-bcc2-f82502231637 tempest-SnapshotDependencyTests-1095643674 None] Lock "cinder-882006cc-d67c-4526-b251-032bcbc15eec-delete_volume" released by "delete_volume" :: held 2.866s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:24 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e Jul 07 17:42:24 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:24 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-12d56c9c-a491-47aa-9f06-a1b1f566ec53 tempest-VolumeImageDependencyTests-769457399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4a08a8b3-6729-4d47-aac4-5d9a4cf0c875" returned: 0 in 0.926s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-12d56c9c-a491-47aa-9f06-a1b1f566ec53 tempest-VolumeImageDependencyTests-769457399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4a08a8b3-6729-4d47-aac4-5d9a4cf0c875 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:24 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4a08a8b3-6729-4d47-aac4-5d9a4cf0c875 Jul 07 17:42:24 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:24 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6f15ddac-82b1-48e0-a9ac-501f6147be05 tempest-VolumeDependencyTests-1572773163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e" returned: 0 in 0.863s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6f15ddac-82b1-48e0-a9ac-501f6147be05 tempest-VolumeDependencyTests-1572773163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e.c233a37f-e5f0-44c0-b319-e889f8749594 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:24 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e.c233a37f-e5f0-44c0-b319-e889f8749594 Jul 07 17:42:24 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-333a0773-34fa-4c29-a248-ad221b4cf11a tempest-ProjectMemberTests-232601277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-333a0773-34fa-4c29-a248-ad221b4cf11a tempest-ProjectMemberTests-232601277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:25 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-12d56c9c-a491-47aa-9f06-a1b1f566ec53 tempest-VolumeImageDependencyTests-769457399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4a08a8b3-6729-4d47-aac4-5d9a4cf0c875" returned: 1 in 0.882s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-12d56c9c-a491-47aa-9f06-a1b1f566ec53 tempest-VolumeImageDependencyTests-769457399 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4a08a8b3-6729-4d47-aac4-5d9a4cf0c875' failed. Not Retrying. {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:42:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-12d56c9c-a491-47aa-9f06-a1b1f566ec53 tempest-VolumeImageDependencyTests-769457399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4a08a8b3-6729-4d47-aac4-5d9a4cf0c875 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:25 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-333a0773-34fa-4c29-a248-ad221b4cf11a tempest-ProjectMemberTests-232601277 None] Creating offline snapshot 688e6e02-ecb5-4d5d-a7ff-5e35f23c2fa5 of volume f8da59c9-a0fc-4a67-9750-85dc0c77a39e {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:42:25 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4a08a8b3-6729-4d47-aac4-5d9a4cf0c875 Jul 07 17:42:25 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:25 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1ecadd-aff4-4535-8e81-f119f6b66846]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-333a0773-34fa-4c29-a248-ad221b4cf11a tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:25 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e Jul 07 17:42:25 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:25 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-12d56c9c-a491-47aa-9f06-a1b1f566ec53 tempest-VolumeImageDependencyTests-769457399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4a08a8b3-6729-4d47-aac4-5d9a4cf0c875" returned: 0 in 0.773s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:25 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-12d56c9c-a491-47aa-9f06-a1b1f566ec53 tempest-VolumeImageDependencyTests-769457399 None] Lock "cinder-quobyte-4a08a8b3-6729-4d47-aac4-5d9a4cf0c875" released by "delete_volume" :: held 2.652s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:25 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6f15ddac-82b1-48e0-a9ac-501f6147be05 tempest-VolumeDependencyTests-1572773163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e.c233a37f-e5f0-44c0-b319-e889f8749594" returned: 0 in 0.963s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6f15ddac-82b1-48e0-a9ac-501f6147be05 tempest-VolumeDependencyTests-1572773163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e.c233a37f-e5f0-44c0-b319-e889f8749594 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:25 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e.c233a37f-e5f0-44c0-b319-e889f8749594 Jul 07 17:42:25 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:25 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-12d56c9c-a491-47aa-9f06-a1b1f566ec53 tempest-VolumeImageDependencyTests-769457399 None] Created reservations ['c3435b8a-c034-4293-9489-063733d49229', '443363d1-1791-4f8a-9ee2-d6a7f1c450a8', '2cb65e1c-d3d2-4d6b-8e3d-45aed1e38fcb', 'a4e61ab0-9806-4ee8-af7c-fabc8165bd65'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:42:25 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-333a0773-34fa-4c29-a248-ad221b4cf11a tempest-ProjectMemberTests-232601277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e" returned: 0 in 0.902s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-333a0773-34fa-4c29-a248-ad221b4cf11a tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e.688e6e02-ecb5-4d5d-a7ff-5e35f23c2fa5 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:26 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e.688e6e02-ecb5-4d5d-a7ff-5e35f23c2fa5 1G Jul 07 17:42:26 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-12d56c9c-a491-47aa-9f06-a1b1f566ec53 tempest-VolumeImageDependencyTests-769457399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-12d56c9c-a491-47aa-9f06-a1b1f566ec53 tempest-VolumeImageDependencyTests-769457399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:26 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-12d56c9c-a491-47aa-9f06-a1b1f566ec53 tempest-VolumeImageDependencyTests-769457399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:26 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-12d56c9c-a491-47aa-9f06-a1b1f566ec53 tempest-VolumeImageDependencyTests-769457399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-12d56c9c-a491-47aa-9f06-a1b1f566ec53 tempest-VolumeImageDependencyTests-769457399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-12d56c9c-a491-47aa-9f06-a1b1f566ec53 tempest-VolumeImageDependencyTests-769457399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:26 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:42:26 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:26 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6f15ddac-82b1-48e0-a9ac-501f6147be05 tempest-VolumeDependencyTests-1572773163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e.c233a37f-e5f0-44c0-b319-e889f8749594" returned: 0 in 0.928s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:26 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6f15ddac-82b1-48e0-a9ac-501f6147be05 tempest-VolumeDependencyTests-1572773163 None] Lock "cinder-quobyte-c233a37f-e5f0-44c0-b319-e889f8749594" released by "_delete_snapshot" :: held 3.843s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:26 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6f15ddac-82b1-48e0-a9ac-501f6147be05 tempest-VolumeDependencyTests-1572773163 None] Lock "cinder-quobyte-fb3094b4-dc7f-4146-8b43-b5dd08571e1e" released by "delete_snapshot" :: held 3.874s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:26 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-6f15ddac-82b1-48e0-a9ac-501f6147be05 tempest-VolumeDependencyTests-1572773163 None] Created reservations ['5dc39d17-48f8-47c8-b44a-02211778d372', '680f2f53-7ffe-4c32-ba0c-998cc4b68957', '372d7b40-2bcd-479a-ac86-2d84dc416745', 'ae9ae12e-8be1-4542-ba00-5c418ce162d8'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:42:27 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-6f15ddac-82b1-48e0-a9ac-501f6147be05 tempest-VolumeDependencyTests-1572773163 None] Delete snapshot completed successfully. Jul 07 17:42:27 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6f15ddac-82b1-48e0-a9ac-501f6147be05 tempest-VolumeDependencyTests-1572773163 None] Lock "cinder-c233a37f-e5f0-44c0-b319-e889f8749594-delete_snapshot" released by "delete_snapshot" :: held 4.087s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-12d56c9c-a491-47aa-9f06-a1b1f566ec53 tempest-VolumeImageDependencyTests-769457399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 1.087s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:27 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:27 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-12d56c9c-a491-47aa-9f06-a1b1f566ec53 tempest-VolumeImageDependencyTests-769457399 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:42:27 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-12d56c9c-a491-47aa-9f06-a1b1f566ec53 tempest-VolumeImageDependencyTests-769457399 None] Deleted volume successfully. Jul 07 17:42:27 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-12d56c9c-a491-47aa-9f06-a1b1f566ec53 tempest-VolumeImageDependencyTests-769457399 None] Lock "cinder-4a08a8b3-6729-4d47-aac4-5d9a4cf0c875-delete_volume" released by "delete_volume" :: held 4.084s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:27 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-333a0773-34fa-4c29-a248-ad221b4cf11a tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e.688e6e02-ecb5-4d5d-a7ff-5e35f23c2fa5 1G" returned: 0 in 1.214s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-333a0773-34fa-4c29-a248-ad221b4cf11a tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e.688e6e02-ecb5-4d5d-a7ff-5e35f23c2fa5 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:27 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e.688e6e02-ecb5-4d5d-a7ff-5e35f23c2fa5 Jul 07 17:42:27 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:27 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-eed97f00-c5f8-4f99-a721-03e71168f9fd tempest-VolumeDependencyTests-1572773163 None] Acquiring lock "cinder-fb3094b4-dc7f-4146-8b43-b5dd08571e1e-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:27 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-eed97f00-c5f8-4f99-a721-03e71168f9fd tempest-VolumeDependencyTests-1572773163 None] Lock "cinder-fb3094b4-dc7f-4146-8b43-b5dd08571e1e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:27 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-eed97f00-c5f8-4f99-a721-03e71168f9fd tempest-VolumeDependencyTests-1572773163 None] Acquiring lock "cinder-quobyte-fb3094b4-dc7f-4146-8b43-b5dd08571e1e" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:27 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-eed97f00-c5f8-4f99-a721-03e71168f9fd tempest-VolumeDependencyTests-1572773163 None] Lock "cinder-quobyte-fb3094b4-dc7f-4146-8b43-b5dd08571e1e" acquired by "delete_volume" :: waited 0.029s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:27 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[930b46af-3e4c-441c-8d1c-a151c6fd2be8]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-eed97f00-c5f8-4f99-a721-03e71168f9fd tempest-VolumeDependencyTests-1572773163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:27 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e Jul 07 17:42:27 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:28 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-333a0773-34fa-4c29-a248-ad221b4cf11a tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e.688e6e02-ecb5-4d5d-a7ff-5e35f23c2fa5" returned: 0 in 1.095s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:28 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-333a0773-34fa-4c29-a248-ad221b4cf11a tempest-ProjectMemberTests-232601277 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e.688e6e02-ecb5-4d5d-a7ff-5e35f23c2fa5 is being set with open permissions: ugo+rw Jul 07 17:42:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-333a0773-34fa-4c29-a248-ad221b4cf11a tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e.688e6e02-ecb5-4d5d-a7ff-5e35f23c2fa5 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:28 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e.688e6e02-ecb5-4d5d-a7ff-5e35f23c2fa5 Jul 07 17:42:28 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:28 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-eed97f00-c5f8-4f99-a721-03e71168f9fd tempest-VolumeDependencyTests-1572773163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e" returned: 0 in 1.077s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-eed97f00-c5f8-4f99-a721-03e71168f9fd tempest-VolumeDependencyTests-1572773163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:28 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e Jul 07 17:42:28 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:29 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-333a0773-34fa-4c29-a248-ad221b4cf11a tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e.688e6e02-ecb5-4d5d-a7ff-5e35f23c2fa5" returned: 0 in 0.812s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-333a0773-34fa-4c29-a248-ad221b4cf11a tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:29 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e.info Jul 07 17:42:29 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:29 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-eed97f00-c5f8-4f99-a721-03e71168f9fd tempest-VolumeDependencyTests-1572773163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-fb3094b4-dc7f-4146-8b43-b5dd08571e1e" returned: 0 in 0.790s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:29 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-eed97f00-c5f8-4f99-a721-03e71168f9fd tempest-VolumeDependencyTests-1572773163 None] Lock "cinder-quobyte-fb3094b4-dc7f-4146-8b43-b5dd08571e1e" released by "delete_volume" :: held 1.975s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:29 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-eed97f00-c5f8-4f99-a721-03e71168f9fd tempest-VolumeDependencyTests-1572773163 None] Created reservations ['1ba0dcef-171e-43bd-a89a-88626995ab6f', '78ab2c7d-5b79-49a9-b6ad-07d1e405da0e', 'c14d60c6-d437-49c1-8e81-27e44eeb49d6', 'c1360384-8faf-4239-b05c-eafc407a1f15'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:42:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-eed97f00-c5f8-4f99-a721-03e71168f9fd tempest-VolumeDependencyTests-1572773163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-eed97f00-c5f8-4f99-a721-03e71168f9fd tempest-VolumeDependencyTests-1572773163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:29 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-eed97f00-c5f8-4f99-a721-03e71168f9fd tempest-VolumeDependencyTests-1572773163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:29 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-eed97f00-c5f8-4f99-a721-03e71168f9fd tempest-VolumeDependencyTests-1572773163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-eed97f00-c5f8-4f99-a721-03e71168f9fd tempest-VolumeDependencyTests-1572773163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-eed97f00-c5f8-4f99-a721-03e71168f9fd tempest-VolumeDependencyTests-1572773163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:29 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:42:29 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:29 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0fb8aa5a-5115-4785-8902-143634c481c7 tempest-VolumeDependencyTests-1572773163 None] Acquiring lock "cinder-ab1ff9f4-bb9e-489d-b96a-9f1b43ccd463-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:29 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0fb8aa5a-5115-4785-8902-143634c481c7 tempest-VolumeDependencyTests-1572773163 None] Lock "cinder-ab1ff9f4-bb9e-489d-b96a-9f1b43ccd463-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:29 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0fb8aa5a-5115-4785-8902-143634c481c7 tempest-VolumeDependencyTests-1572773163 None] Acquiring lock "cinder-quobyte-ab1ff9f4-bb9e-489d-b96a-9f1b43ccd463" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:29 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0fb8aa5a-5115-4785-8902-143634c481c7 tempest-VolumeDependencyTests-1572773163 None] Lock "cinder-quobyte-ab1ff9f4-bb9e-489d-b96a-9f1b43ccd463" acquired by "delete_volume" :: waited 0.040s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:29 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[12562484-1aad-4a51-9be0-ec7d840f9848]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0fb8aa5a-5115-4785-8902-143634c481c7 tempest-VolumeDependencyTests-1572773163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ab1ff9f4-bb9e-489d-b96a-9f1b43ccd463 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:29 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ab1ff9f4-bb9e-489d-b96a-9f1b43ccd463 Jul 07 17:42:29 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:30 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-333a0773-34fa-4c29-a248-ad221b4cf11a tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e.info" returned: 0 in 0.997s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:30 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-333a0773-34fa-4c29-a248-ad221b4cf11a tempest-ProjectMemberTests-232601277 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e.info is being set with open permissions: ugo+rw Jul 07 17:42:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-333a0773-34fa-4c29-a248-ad221b4cf11a tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:30 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e.info Jul 07 17:42:30 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:30 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-eed97f00-c5f8-4f99-a721-03e71168f9fd tempest-VolumeDependencyTests-1572773163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 1.095s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:30 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-eed97f00-c5f8-4f99-a721-03e71168f9fd tempest-VolumeDependencyTests-1572773163 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:42:30 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-eed97f00-c5f8-4f99-a721-03e71168f9fd tempest-VolumeDependencyTests-1572773163 None] Deleted volume successfully. Jul 07 17:42:30 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-eed97f00-c5f8-4f99-a721-03e71168f9fd tempest-VolumeDependencyTests-1572773163 None] Lock "cinder-fb3094b4-dc7f-4146-8b43-b5dd08571e1e-delete_volume" released by "delete_volume" :: held 3.412s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:31 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0fb8aa5a-5115-4785-8902-143634c481c7 tempest-VolumeDependencyTests-1572773163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ab1ff9f4-bb9e-489d-b96a-9f1b43ccd463" returned: 0 in 1.234s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0fb8aa5a-5115-4785-8902-143634c481c7 tempest-VolumeDependencyTests-1572773163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ab1ff9f4-bb9e-489d-b96a-9f1b43ccd463 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:31 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-333a0773-34fa-4c29-a248-ad221b4cf11a tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e.info" returned: 0 in 0.909s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:31 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ab1ff9f4-bb9e-489d-b96a-9f1b43ccd463 Jul 07 17:42:31 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-333a0773-34fa-4c29-a248-ad221b4cf11a tempest-ProjectMemberTests-232601277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.106s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:31 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-333a0773-34fa-4c29-a248-ad221b4cf11a tempest-ProjectMemberTests-232601277 None] Create snapshot completed successfully Jul 07 17:42:31 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5930b3c2-a061-497e-92f2-c9f83c19bdd4 tempest-ProjectMemberTests-232601277 None] Acquiring lock "cinder-688e6e02-ecb5-4d5d-a7ff-5e35f23c2fa5-delete_snapshot" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:31 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5930b3c2-a061-497e-92f2-c9f83c19bdd4 tempest-ProjectMemberTests-232601277 None] Lock "cinder-688e6e02-ecb5-4d5d-a7ff-5e35f23c2fa5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:31 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5930b3c2-a061-497e-92f2-c9f83c19bdd4 tempest-ProjectMemberTests-232601277 None] Acquiring lock "cinder-quobyte-f8da59c9-a0fc-4a67-9750-85dc0c77a39e" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:31 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5930b3c2-a061-497e-92f2-c9f83c19bdd4 tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-f8da59c9-a0fc-4a67-9750-85dc0c77a39e" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:31 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5930b3c2-a061-497e-92f2-c9f83c19bdd4 tempest-ProjectMemberTests-232601277 None] Acquiring lock "cinder-quobyte-688e6e02-ecb5-4d5d-a7ff-5e35f23c2fa5" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:31 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5930b3c2-a061-497e-92f2-c9f83c19bdd4 tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-688e6e02-ecb5-4d5d-a7ff-5e35f23c2fa5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:31 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-5930b3c2-a061-497e-92f2-c9f83c19bdd4 tempest-ProjectMemberTests-232601277 None] Deleting offline snapshot 688e6e02-ecb5-4d5d-a7ff-5e35f23c2fa5 of volume f8da59c9-a0fc-4a67-9750-85dc0c77a39e {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:42:31 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-5930b3c2-a061-497e-92f2-c9f83c19bdd4 tempest-ProjectMemberTests-232601277 None] snapshot_file for this snap is: volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e.688e6e02-ecb5-4d5d-a7ff-5e35f23c2fa5 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:42:31 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[023e22ad-6770-4b9a-b324-b017b9bec3a1]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5930b3c2-a061-497e-92f2-c9f83c19bdd4 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e.688e6e02-ecb5-4d5d-a7ff-5e35f23c2fa5 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:31 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e.688e6e02-ecb5-4d5d-a7ff-5e35f23c2fa5 Jul 07 17:42:31 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:31 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0fb8aa5a-5115-4785-8902-143634c481c7 tempest-VolumeDependencyTests-1572773163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-ab1ff9f4-bb9e-489d-b96a-9f1b43ccd463" returned: 0 in 0.770s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:31 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0fb8aa5a-5115-4785-8902-143634c481c7 tempest-VolumeDependencyTests-1572773163 None] Lock "cinder-quobyte-ab1ff9f4-bb9e-489d-b96a-9f1b43ccd463" released by "delete_volume" :: held 2.073s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:31 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-0fb8aa5a-5115-4785-8902-143634c481c7 tempest-VolumeDependencyTests-1572773163 None] Created reservations ['0df8623d-acdf-41e7-bf0e-7e5d895fab4e', '8b02e30a-7215-4864-afa4-72c36152129d', '9f812295-738e-4529-a342-63f2300ddb2b', '5ec7037d-c481-4913-97b5-f1fef017eccd'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:42:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0fb8aa5a-5115-4785-8902-143634c481c7 tempest-VolumeDependencyTests-1572773163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0fb8aa5a-5115-4785-8902-143634c481c7 tempest-VolumeDependencyTests-1572773163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:31 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8aa5a-5115-4785-8902-143634c481c7 tempest-VolumeDependencyTests-1572773163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:32 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8aa5a-5115-4785-8902-143634c481c7 tempest-VolumeDependencyTests-1572773163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0fb8aa5a-5115-4785-8902-143634c481c7 tempest-VolumeDependencyTests-1572773163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0fb8aa5a-5115-4785-8902-143634c481c7 tempest-VolumeDependencyTests-1572773163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:32 devstack sudo[106451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:42:32 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:32 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5930b3c2-a061-497e-92f2-c9f83c19bdd4 tempest-ProjectMemberTests-232601277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e.688e6e02-ecb5-4d5d-a7ff-5e35f23c2fa5" returned: 0 in 0.978s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:32 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-5930b3c2-a061-497e-92f2-c9f83c19bdd4 tempest-ProjectMemberTests-232601277 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:42:32 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25239e6-514a-48e5-ba5f-049a35fdef64]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5930b3c2-a061-497e-92f2-c9f83c19bdd4 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:32 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e Jul 07 17:42:32 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:32 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0fb8aa5a-5115-4785-8902-143634c481c7 tempest-VolumeDependencyTests-1572773163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.769s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:32 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-0fb8aa5a-5115-4785-8902-143634c481c7 tempest-VolumeDependencyTests-1572773163 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:42:32 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-0fb8aa5a-5115-4785-8902-143634c481c7 tempest-VolumeDependencyTests-1572773163 None] Deleted volume successfully. Jul 07 17:42:32 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0fb8aa5a-5115-4785-8902-143634c481c7 tempest-VolumeDependencyTests-1572773163 None] Lock "cinder-ab1ff9f4-bb9e-489d-b96a-9f1b43ccd463-delete_volume" released by "delete_volume" :: held 3.133s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:33 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5930b3c2-a061-497e-92f2-c9f83c19bdd4 tempest-ProjectMemberTests-232601277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e" returned: 0 in 0.932s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5930b3c2-a061-497e-92f2-c9f83c19bdd4 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e.688e6e02-ecb5-4d5d-a7ff-5e35f23c2fa5 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:33 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e.688e6e02-ecb5-4d5d-a7ff-5e35f23c2fa5 Jul 07 17:42:33 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:34 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5930b3c2-a061-497e-92f2-c9f83c19bdd4 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e.688e6e02-ecb5-4d5d-a7ff-5e35f23c2fa5" returned: 0 in 0.872s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5930b3c2-a061-497e-92f2-c9f83c19bdd4 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e.688e6e02-ecb5-4d5d-a7ff-5e35f23c2fa5 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:34 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e.688e6e02-ecb5-4d5d-a7ff-5e35f23c2fa5 Jul 07 17:42:34 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:35 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5930b3c2-a061-497e-92f2-c9f83c19bdd4 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e.688e6e02-ecb5-4d5d-a7ff-5e35f23c2fa5" returned: 0 in 0.784s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:35 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5930b3c2-a061-497e-92f2-c9f83c19bdd4 tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-688e6e02-ecb5-4d5d-a7ff-5e35f23c2fa5" released by "_delete_snapshot" :: held 3.720s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:35 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5930b3c2-a061-497e-92f2-c9f83c19bdd4 tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-f8da59c9-a0fc-4a67-9750-85dc0c77a39e" released by "delete_snapshot" :: held 3.745s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:35 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-5930b3c2-a061-497e-92f2-c9f83c19bdd4 tempest-ProjectMemberTests-232601277 None] Created reservations ['30cb7911-9e68-46ef-a18d-c94d4325ef12', '03cedf6c-55b9-4c44-a390-26c6c41e7efc', 'a82c8f97-8a22-416f-99ca-7ec2c7563b43', 'e9e0daca-bf7c-4940-84d8-1abd68c7743b'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:42:35 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-5930b3c2-a061-497e-92f2-c9f83c19bdd4 tempest-ProjectMemberTests-232601277 None] Delete snapshot completed successfully. Jul 07 17:42:35 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5930b3c2-a061-497e-92f2-c9f83c19bdd4 tempest-ProjectMemberTests-232601277 None] Lock "cinder-688e6e02-ecb5-4d5d-a7ff-5e35f23c2fa5-delete_snapshot" released by "delete_snapshot" :: held 3.926s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:35 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d7f8873f-14ed-4a97-899a-5a8f9dc98e83 tempest-ProjectMemberTests-232601277 None] Acquiring lock "cinder-f8da59c9-a0fc-4a67-9750-85dc0c77a39e-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:35 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d7f8873f-14ed-4a97-899a-5a8f9dc98e83 tempest-ProjectMemberTests-232601277 None] Lock "cinder-f8da59c9-a0fc-4a67-9750-85dc0c77a39e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:35 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d7f8873f-14ed-4a97-899a-5a8f9dc98e83 tempest-ProjectMemberTests-232601277 None] Acquiring lock "cinder-quobyte-f8da59c9-a0fc-4a67-9750-85dc0c77a39e" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:35 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d7f8873f-14ed-4a97-899a-5a8f9dc98e83 tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-f8da59c9-a0fc-4a67-9750-85dc0c77a39e" acquired by "delete_volume" :: waited 0.016s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:35 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fef95d-713b-47f6-a077-f1f0723ddb0b]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d7f8873f-14ed-4a97-899a-5a8f9dc98e83 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:35 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e Jul 07 17:42:35 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:36 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d7f8873f-14ed-4a97-899a-5a8f9dc98e83 tempest-ProjectMemberTests-232601277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e" returned: 0 in 0.835s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d7f8873f-14ed-4a97-899a-5a8f9dc98e83 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:36 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e Jul 07 17:42:36 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:37 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d7f8873f-14ed-4a97-899a-5a8f9dc98e83 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-f8da59c9-a0fc-4a67-9750-85dc0c77a39e" returned: 0 in 0.723s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:37 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d7f8873f-14ed-4a97-899a-5a8f9dc98e83 tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-f8da59c9-a0fc-4a67-9750-85dc0c77a39e" released by "delete_volume" :: held 1.644s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:37 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-d7f8873f-14ed-4a97-899a-5a8f9dc98e83 tempest-ProjectMemberTests-232601277 None] Created reservations ['61cc2af5-6490-4c8f-97d1-f934ef536f38', 'eb86b004-44b7-4b91-b5d8-652b2a2fa732', '63612ed0-1783-46bd-a9d3-c682d7fbe58d', '452b8ee2-9d37-497d-85fc-ca1c3c5d7c2d'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:42:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d7f8873f-14ed-4a97-899a-5a8f9dc98e83 tempest-ProjectMemberTests-232601277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d7f8873f-14ed-4a97-899a-5a8f9dc98e83 tempest-ProjectMemberTests-232601277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:37 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d7f8873f-14ed-4a97-899a-5a8f9dc98e83 tempest-ProjectMemberTests-232601277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:37 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d7f8873f-14ed-4a97-899a-5a8f9dc98e83 tempest-ProjectMemberTests-232601277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d7f8873f-14ed-4a97-899a-5a8f9dc98e83 tempest-ProjectMemberTests-232601277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d7f8873f-14ed-4a97-899a-5a8f9dc98e83 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:37 devstack sudo[106481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:42:37 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-c54835e8-9a38-4cd0-8b3b-d3fac032a829 tempest-ProjectAdminTests-1392133340 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577667236328, 'free_capacity_gb': 1775.7577667236328, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87233) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 07 17:42:38 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d7f8873f-14ed-4a97-899a-5a8f9dc98e83 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.655s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:38 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-d7f8873f-14ed-4a97-899a-5a8f9dc98e83 tempest-ProjectMemberTests-232601277 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:42:38 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-d7f8873f-14ed-4a97-899a-5a8f9dc98e83 tempest-ProjectMemberTests-232601277 None] Deleted volume successfully. Jul 07 17:42:38 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d7f8873f-14ed-4a97-899a-5a8f9dc98e83 tempest-ProjectMemberTests-232601277 None] Lock "cinder-f8da59c9-a0fc-4a67-9750-85dc0c77a39e-delete_volume" released by "delete_volume" :: held 2.524s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:38 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce4eddf2-7e41-4fee-8c57-7f5aa736d1a0 tempest-ProjectMemberTests-232601277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:42:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ce4eddf2-7e41-4fee-8c57-7f5aa736d1a0 tempest-ProjectMemberTests-232601277 None] Flow 'volume_create_manager' (b68b0ec1-5cf4-4a00-b10b-e5ef26846da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:42:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ce4eddf2-7e41-4fee-8c57-7f5aa736d1a0 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c350d0c9-7085-4ae0-99b5-303b75063d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ce4eddf2-7e41-4fee-8c57-7f5aa736d1a0 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c350d0c9-7085-4ae0-99b5-303b75063d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-21786753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06789557-38b0-4324-b5b7-c4207395e691,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='126630bddcf5433fb704f04aac171bde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:42:38Z,use_quota=True,user_id='f03110d4128243fca6ab7f6b4b51123a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ce4eddf2-7e41-4fee-8c57-7f5aa736d1a0 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f6c60b-1d23-48f4-b8a8-2d16cbc931f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ce4eddf2-7e41-4fee-8c57-7f5aa736d1a0 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f6c60b-1d23-48f4-b8a8-2d16cbc931f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ce4eddf2-7e41-4fee-8c57-7f5aa736d1a0 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (800a4355-823f-4f2f-a55a-b222b7a82e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ce4eddf2-7e41-4fee-8c57-7f5aa736d1a0 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (800a4355-823f-4f2f-a55a-b222b7a82e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06789557-38b0-4324-b5b7-c4207395e691', 'volume_name': 'volume-06789557-38b0-4324-b5b7-c4207395e691', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ce4eddf2-7e41-4fee-8c57-7f5aa736d1a0 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (814dada8-be63-4d1b-ba93-897b2f39b2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ce4eddf2-7e41-4fee-8c57-7f5aa736d1a0 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (814dada8-be63-4d1b-ba93-897b2f39b2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:38 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ce4eddf2-7e41-4fee-8c57-7f5aa736d1a0 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14c5fbce-9e66-4b33-94f1-21426fe54ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:38 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-ce4eddf2-7e41-4fee-8c57-7f5aa736d1a0 tempest-ProjectMemberTests-232601277 None] Volume 06789557-38b0-4324-b5b7-c4207395e691: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06789557-38b0-4324-b5b7-c4207395e691', 'volume_size': 1} Jul 07 17:42:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ce4eddf2-7e41-4fee-8c57-7f5aa736d1a0 tempest-ProjectMemberTests-232601277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ce4eddf2-7e41-4fee-8c57-7f5aa736d1a0 tempest-ProjectMemberTests-232601277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:38 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ce4eddf2-7e41-4fee-8c57-7f5aa736d1a0 tempest-ProjectMemberTests-232601277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-21786753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06789557-38b0-4324-b5b7-c4207395e691,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='126630bddcf5433fb704f04aac171bde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:42:38Z,use_quota=True,user_id='f03110d4128243fca6ab7f6b4b51123a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:42:38 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-ce4eddf2-7e41-4fee-8c57-7f5aa736d1a0 tempest-ProjectMemberTests-232601277 None] Creating volume 06789557-38b0-4324-b5b7-c4207395e691 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:42:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ce4eddf2-7e41-4fee-8c57-7f5aa736d1a0 tempest-ProjectMemberTests-232601277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ce4eddf2-7e41-4fee-8c57-7f5aa736d1a0 tempest-ProjectMemberTests-232601277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:38 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ce4eddf2-7e41-4fee-8c57-7f5aa736d1a0 tempest-ProjectMemberTests-232601277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:38 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ce4eddf2-7e41-4fee-8c57-7f5aa736d1a0 tempest-ProjectMemberTests-232601277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ce4eddf2-7e41-4fee-8c57-7f5aa736d1a0 tempest-ProjectMemberTests-232601277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:38 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ce4eddf2-7e41-4fee-8c57-7f5aa736d1a0 tempest-ProjectMemberTests-232601277 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:42:38 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-ce4eddf2-7e41-4fee-8c57-7f5aa736d1a0 tempest-ProjectMemberTests-232601277 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:42:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ce4eddf2-7e41-4fee-8c57-7f5aa736d1a0 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-06789557-38b0-4324-b5b7-c4207395e691 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:38 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-06789557-38b0-4324-b5b7-c4207395e691 1073741824 Jul 07 17:42:38 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:39 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ce4eddf2-7e41-4fee-8c57-7f5aa736d1a0 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-06789557-38b0-4324-b5b7-c4207395e691 1073741824" returned: 0 in 0.966s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ce4eddf2-7e41-4fee-8c57-7f5aa736d1a0 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-06789557-38b0-4324-b5b7-c4207395e691 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:39 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-06789557-38b0-4324-b5b7-c4207395e691 Jul 07 17:42:39 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:40 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ce4eddf2-7e41-4fee-8c57-7f5aa736d1a0 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-06789557-38b0-4324-b5b7-c4207395e691" returned: 0 in 0.636s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:40 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ce4eddf2-7e41-4fee-8c57-7f5aa736d1a0 tempest-ProjectMemberTests-232601277 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:42:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ce4eddf2-7e41-4fee-8c57-7f5aa736d1a0 tempest-ProjectMemberTests-232601277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.667s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:40 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ce4eddf2-7e41-4fee-8c57-7f5aa736d1a0 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14c5fbce-9e66-4b33-94f1-21426fe54ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06789557-38b0-4324-b5b7-c4207395e691', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:40 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ce4eddf2-7e41-4fee-8c57-7f5aa736d1a0 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8ac337c-c8ba-408f-ad59-51ab329ea8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:40 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-ce4eddf2-7e41-4fee-8c57-7f5aa736d1a0 tempest-ProjectMemberTests-232601277 None] Volume volume-06789557-38b0-4324-b5b7-c4207395e691 (06789557-38b0-4324-b5b7-c4207395e691): created successfully Jul 07 17:42:40 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ce4eddf2-7e41-4fee-8c57-7f5aa736d1a0 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8ac337c-c8ba-408f-ad59-51ab329ea8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:40 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ce4eddf2-7e41-4fee-8c57-7f5aa736d1a0 tempest-ProjectMemberTests-232601277 None] Flow 'volume_create_manager' (b68b0ec1-5cf4-4a00-b10b-e5ef26846da2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:42:40 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-ce4eddf2-7e41-4fee-8c57-7f5aa736d1a0 tempest-ProjectMemberTests-232601277 None] Created volume successfully. Jul 07 17:42:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-cc932cc9-cf03-44d7-9328-ea8fba2c5ca6 tempest-ProjectMemberTests-232601277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-cc932cc9-cf03-44d7-9328-ea8fba2c5ca6 tempest-ProjectMemberTests-232601277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:40 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-cc932cc9-cf03-44d7-9328-ea8fba2c5ca6 tempest-ProjectMemberTests-232601277 None] Creating offline snapshot 33dad1d7-c866-4d7d-9eae-e920d4bab868 of volume 06789557-38b0-4324-b5b7-c4207395e691 {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:42:40 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df50ead-27d2-4b33-a5d9-e83148c1bf56]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-cc932cc9-cf03-44d7-9328-ea8fba2c5ca6 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-06789557-38b0-4324-b5b7-c4207395e691 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:40 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-06789557-38b0-4324-b5b7-c4207395e691 Jul 07 17:42:40 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:41 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-cc932cc9-cf03-44d7-9328-ea8fba2c5ca6 tempest-ProjectMemberTests-232601277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-06789557-38b0-4324-b5b7-c4207395e691" returned: 0 in 0.800s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-cc932cc9-cf03-44d7-9328-ea8fba2c5ca6 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-06789557-38b0-4324-b5b7-c4207395e691,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-06789557-38b0-4324-b5b7-c4207395e691.33dad1d7-c866-4d7d-9eae-e920d4bab868 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:41 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-06789557-38b0-4324-b5b7-c4207395e691,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-06789557-38b0-4324-b5b7-c4207395e691.33dad1d7-c866-4d7d-9eae-e920d4bab868 1G Jul 07 17:42:41 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:42 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-cc932cc9-cf03-44d7-9328-ea8fba2c5ca6 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-06789557-38b0-4324-b5b7-c4207395e691,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-06789557-38b0-4324-b5b7-c4207395e691.33dad1d7-c866-4d7d-9eae-e920d4bab868 1G" returned: 0 in 0.856s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-cc932cc9-cf03-44d7-9328-ea8fba2c5ca6 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06789557-38b0-4324-b5b7-c4207395e691 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-06789557-38b0-4324-b5b7-c4207395e691.33dad1d7-c866-4d7d-9eae-e920d4bab868 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:42 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06789557-38b0-4324-b5b7-c4207395e691 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-06789557-38b0-4324-b5b7-c4207395e691.33dad1d7-c866-4d7d-9eae-e920d4bab868 Jul 07 17:42:42 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:42 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:SELECT=121,cinder:INSERT=41,cinder:UPDATE=172,cinder:DELETE=16 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:42:42 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:SELECT=125,cinder:INSERT=46,cinder:UPDATE=143,cinder:DELETE=9 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:42:42 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-082a327d-dd21-44d3-af00-7eeaee75ea28 tempest-ProjectReaderTests-1784466903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:42:43 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-082a327d-dd21-44d3-af00-7eeaee75ea28 tempest-ProjectReaderTests-1784466903 None] Flow 'volume_create_manager' (22ee105e-556d-494e-8156-5c03858f17b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:42:43 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-082a327d-dd21-44d3-af00-7eeaee75ea28 tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0bb38ac-803f-4643-b150-38f1c95306cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:43 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-082a327d-dd21-44d3-af00-7eeaee75ea28 tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0bb38ac-803f-4643-b150-38f1c95306cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-617396458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6ce9899-15c3-426c-bb06-7fdffe0ad73e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f7af8480fe431192778df1c311e074',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:42:43Z,use_quota=True,user_id='98144cb6a2c64593a39ce3220c506359',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:43 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-082a327d-dd21-44d3-af00-7eeaee75ea28 tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8564c4b8-a5ad-4b61-8b8c-ca0e62472a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:43 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-082a327d-dd21-44d3-af00-7eeaee75ea28 tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8564c4b8-a5ad-4b61-8b8c-ca0e62472a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:43 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-082a327d-dd21-44d3-af00-7eeaee75ea28 tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31e86914-474d-4c95-b12d-a6e7f6c564b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:43 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-082a327d-dd21-44d3-af00-7eeaee75ea28 tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31e86914-474d-4c95-b12d-a6e7f6c564b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6ce9899-15c3-426c-bb06-7fdffe0ad73e', 'volume_name': 'volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:43 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-082a327d-dd21-44d3-af00-7eeaee75ea28 tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a17c76e3-bb72-4b23-8ed4-7494852821a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:43 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-082a327d-dd21-44d3-af00-7eeaee75ea28 tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a17c76e3-bb72-4b23-8ed4-7494852821a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:43 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-082a327d-dd21-44d3-af00-7eeaee75ea28 tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7a3efd5-5d3f-4840-bd5c-3d200189b740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:43 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-082a327d-dd21-44d3-af00-7eeaee75ea28 tempest-ProjectReaderTests-1784466903 None] Volume c6ce9899-15c3-426c-bb06-7fdffe0ad73e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e', 'volume_size': 1} Jul 07 17:42:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-082a327d-dd21-44d3-af00-7eeaee75ea28 tempest-ProjectReaderTests-1784466903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:43 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-cc932cc9-cf03-44d7-9328-ea8fba2c5ca6 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06789557-38b0-4324-b5b7-c4207395e691 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-06789557-38b0-4324-b5b7-c4207395e691.33dad1d7-c866-4d7d-9eae-e920d4bab868" returned: 0 in 0.811s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:43 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-cc932cc9-cf03-44d7-9328-ea8fba2c5ca6 tempest-ProjectMemberTests-232601277 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-06789557-38b0-4324-b5b7-c4207395e691.33dad1d7-c866-4d7d-9eae-e920d4bab868 is being set with open permissions: ugo+rw Jul 07 17:42:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-cc932cc9-cf03-44d7-9328-ea8fba2c5ca6 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-06789557-38b0-4324-b5b7-c4207395e691.33dad1d7-c866-4d7d-9eae-e920d4bab868 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:43 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-06789557-38b0-4324-b5b7-c4207395e691.33dad1d7-c866-4d7d-9eae-e920d4bab868 Jul 07 17:42:43 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:43 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:42:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:43 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:42:43 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:43 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-cc932cc9-cf03-44d7-9328-ea8fba2c5ca6 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-06789557-38b0-4324-b5b7-c4207395e691.33dad1d7-c866-4d7d-9eae-e920d4bab868" returned: 0 in 0.715s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-cc932cc9-cf03-44d7-9328-ea8fba2c5ca6 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-06789557-38b0-4324-b5b7-c4207395e691.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:43 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-06789557-38b0-4324-b5b7-c4207395e691.info Jul 07 17:42:43 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:44 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.708s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:44 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:42:44 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:42:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread count: 28 {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:42:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread info: [<_MainThread(MainThread, started 126077716062336)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:42:44 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-cc932cc9-cf03-44d7-9328-ea8fba2c5ca6 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-06789557-38b0-4324-b5b7-c4207395e691.info" returned: 0 in 0.674s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:44 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-cc932cc9-cf03-44d7-9328-ea8fba2c5ca6 tempest-ProjectMemberTests-232601277 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-06789557-38b0-4324-b5b7-c4207395e691.info is being set with open permissions: ugo+rw Jul 07 17:42:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-cc932cc9-cf03-44d7-9328-ea8fba2c5ca6 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-06789557-38b0-4324-b5b7-c4207395e691.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:44 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-06789557-38b0-4324-b5b7-c4207395e691.info Jul 07 17:42:44 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:45 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-cc932cc9-cf03-44d7-9328-ea8fba2c5ca6 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-06789557-38b0-4324-b5b7-c4207395e691.info" returned: 0 in 0.668s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-cc932cc9-cf03-44d7-9328-ea8fba2c5ca6 tempest-ProjectMemberTests-232601277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.641s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-082a327d-dd21-44d3-af00-7eeaee75ea28 tempest-ProjectReaderTests-1784466903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.219s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:45 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-082a327d-dd21-44d3-af00-7eeaee75ea28 tempest-ProjectReaderTests-1784466903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-617396458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6ce9899-15c3-426c-bb06-7fdffe0ad73e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f7af8480fe431192778df1c311e074',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:42:43Z,use_quota=True,user_id='98144cb6a2c64593a39ce3220c506359',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:42:45 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-082a327d-dd21-44d3-af00-7eeaee75ea28 tempest-ProjectReaderTests-1784466903 None] Creating volume c6ce9899-15c3-426c-bb06-7fdffe0ad73e {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:42:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-082a327d-dd21-44d3-af00-7eeaee75ea28 tempest-ProjectReaderTests-1784466903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-082a327d-dd21-44d3-af00-7eeaee75ea28 tempest-ProjectReaderTests-1784466903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:45 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-082a327d-dd21-44d3-af00-7eeaee75ea28 tempest-ProjectReaderTests-1784466903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:45 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-082a327d-dd21-44d3-af00-7eeaee75ea28 tempest-ProjectReaderTests-1784466903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-082a327d-dd21-44d3-af00-7eeaee75ea28 tempest-ProjectReaderTests-1784466903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:45 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-082a327d-dd21-44d3-af00-7eeaee75ea28 tempest-ProjectReaderTests-1784466903 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:42:45 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-082a327d-dd21-44d3-af00-7eeaee75ea28 tempest-ProjectReaderTests-1784466903 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:42:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-082a327d-dd21-44d3-af00-7eeaee75ea28 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:45 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e 1073741824 Jul 07 17:42:45 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:45 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-cc932cc9-cf03-44d7-9328-ea8fba2c5ca6 tempest-ProjectMemberTests-232601277 None] Create snapshot completed successfully Jul 07 17:42:45 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0ab6b09b-cb89-48f0-86e2-ecbaecc81017 tempest-ProjectMemberTests-232601277 None] Acquiring lock "cinder-33dad1d7-c866-4d7d-9eae-e920d4bab868-delete_snapshot" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:45 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0ab6b09b-cb89-48f0-86e2-ecbaecc81017 tempest-ProjectMemberTests-232601277 None] Lock "cinder-33dad1d7-c866-4d7d-9eae-e920d4bab868-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:45 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0ab6b09b-cb89-48f0-86e2-ecbaecc81017 tempest-ProjectMemberTests-232601277 None] Acquiring lock "cinder-quobyte-06789557-38b0-4324-b5b7-c4207395e691" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:45 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0ab6b09b-cb89-48f0-86e2-ecbaecc81017 tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-06789557-38b0-4324-b5b7-c4207395e691" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:45 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0ab6b09b-cb89-48f0-86e2-ecbaecc81017 tempest-ProjectMemberTests-232601277 None] Acquiring lock "cinder-quobyte-33dad1d7-c866-4d7d-9eae-e920d4bab868" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:45 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0ab6b09b-cb89-48f0-86e2-ecbaecc81017 tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-33dad1d7-c866-4d7d-9eae-e920d4bab868" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:45 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-0ab6b09b-cb89-48f0-86e2-ecbaecc81017 tempest-ProjectMemberTests-232601277 None] Deleting offline snapshot 33dad1d7-c866-4d7d-9eae-e920d4bab868 of volume 06789557-38b0-4324-b5b7-c4207395e691 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:42:45 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-0ab6b09b-cb89-48f0-86e2-ecbaecc81017 tempest-ProjectMemberTests-232601277 None] snapshot_file for this snap is: volume-06789557-38b0-4324-b5b7-c4207395e691.33dad1d7-c866-4d7d-9eae-e920d4bab868 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:42:45 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d5b683-8e8f-46a3-b4f5-eedd510aa995]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0ab6b09b-cb89-48f0-86e2-ecbaecc81017 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-06789557-38b0-4324-b5b7-c4207395e691.33dad1d7-c866-4d7d-9eae-e920d4bab868 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:46 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-06789557-38b0-4324-b5b7-c4207395e691.33dad1d7-c866-4d7d-9eae-e920d4bab868 Jul 07 17:42:46 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:46 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-082a327d-dd21-44d3-af00-7eeaee75ea28 tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e 1073741824" returned: 0 in 1.015s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-082a327d-dd21-44d3-af00-7eeaee75ea28 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:46 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e Jul 07 17:42:46 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:46 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0ab6b09b-cb89-48f0-86e2-ecbaecc81017 tempest-ProjectMemberTests-232601277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-06789557-38b0-4324-b5b7-c4207395e691.33dad1d7-c866-4d7d-9eae-e920d4bab868" returned: 0 in 0.821s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:46 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-0ab6b09b-cb89-48f0-86e2-ecbaecc81017 tempest-ProjectMemberTests-232601277 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06789557-38b0-4324-b5b7-c4207395e691(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:42:46 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9cdb504-3579-44d7-86ad-7286305efc3b]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0ab6b09b-cb89-48f0-86e2-ecbaecc81017 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-06789557-38b0-4324-b5b7-c4207395e691 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:46 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-06789557-38b0-4324-b5b7-c4207395e691 Jul 07 17:42:46 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:47 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-082a327d-dd21-44d3-af00-7eeaee75ea28 tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e" returned: 0 in 0.668s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:47 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-082a327d-dd21-44d3-af00-7eeaee75ea28 tempest-ProjectReaderTests-1784466903 None] <== create_volume: return (1731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:42:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-082a327d-dd21-44d3-af00-7eeaee75ea28 tempest-ProjectReaderTests-1784466903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.736s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:47 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-082a327d-dd21-44d3-af00-7eeaee75ea28 tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7a3efd5-5d3f-4840-bd5c-3d200189b740) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:47 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-082a327d-dd21-44d3-af00-7eeaee75ea28 tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8057b7e6-76a9-4d62-b2c4-5671170fb9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:47 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-082a327d-dd21-44d3-af00-7eeaee75ea28 tempest-ProjectReaderTests-1784466903 None] Volume volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e (c6ce9899-15c3-426c-bb06-7fdffe0ad73e): created successfully Jul 07 17:42:47 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-082a327d-dd21-44d3-af00-7eeaee75ea28 tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8057b7e6-76a9-4d62-b2c4-5671170fb9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:47 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-082a327d-dd21-44d3-af00-7eeaee75ea28 tempest-ProjectReaderTests-1784466903 None] Flow 'volume_create_manager' (22ee105e-556d-494e-8156-5c03858f17b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:42:47 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-082a327d-dd21-44d3-af00-7eeaee75ea28 tempest-ProjectReaderTests-1784466903 None] Created volume successfully. Jul 07 17:42:47 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0ab6b09b-cb89-48f0-86e2-ecbaecc81017 tempest-ProjectMemberTests-232601277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-06789557-38b0-4324-b5b7-c4207395e691" returned: 0 in 0.775s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0ab6b09b-cb89-48f0-86e2-ecbaecc81017 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-06789557-38b0-4324-b5b7-c4207395e691.33dad1d7-c866-4d7d-9eae-e920d4bab868 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:47 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-06789557-38b0-4324-b5b7-c4207395e691.33dad1d7-c866-4d7d-9eae-e920d4bab868 Jul 07 17:42:47 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:48 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0ab6b09b-cb89-48f0-86e2-ecbaecc81017 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-06789557-38b0-4324-b5b7-c4207395e691.33dad1d7-c866-4d7d-9eae-e920d4bab868" returned: 0 in 0.893s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0ab6b09b-cb89-48f0-86e2-ecbaecc81017 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-06789557-38b0-4324-b5b7-c4207395e691.33dad1d7-c866-4d7d-9eae-e920d4bab868 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:48 devstack sudo[106546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-06789557-38b0-4324-b5b7-c4207395e691.33dad1d7-c866-4d7d-9eae-e920d4bab868 Jul 07 17:42:48 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-39179805-0595-4c69-af39-1b86c17a84b6 tempest-ProjectReaderTests-1784466903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-39179805-0595-4c69-af39-1b86c17a84b6 tempest-ProjectReaderTests-1784466903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:48 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-39179805-0595-4c69-af39-1b86c17a84b6 tempest-ProjectReaderTests-1784466903 None] Creating offline snapshot 9263142d-6f52-4e25-9e01-a7829f610b1f of volume c6ce9899-15c3-426c-bb06-7fdffe0ad73e {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:42:48 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5622d39-e6db-41e6-baf2-7d54603d7dd7]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-39179805-0595-4c69-af39-1b86c17a84b6 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:48 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e Jul 07 17:42:48 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:49 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0ab6b09b-cb89-48f0-86e2-ecbaecc81017 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-06789557-38b0-4324-b5b7-c4207395e691.33dad1d7-c866-4d7d-9eae-e920d4bab868" returned: 0 in 0.702s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:49 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0ab6b09b-cb89-48f0-86e2-ecbaecc81017 tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-33dad1d7-c866-4d7d-9eae-e920d4bab868" released by "_delete_snapshot" :: held 3.303s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:49 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0ab6b09b-cb89-48f0-86e2-ecbaecc81017 tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-06789557-38b0-4324-b5b7-c4207395e691" released by "delete_snapshot" :: held 3.328s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:49 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-0ab6b09b-cb89-48f0-86e2-ecbaecc81017 tempest-ProjectMemberTests-232601277 None] Created reservations ['81e81862-2e20-4876-9505-154aeb641251', 'bd6d5a53-7ada-4981-bb5e-aa2132b8660b', 'c0e8f17d-f78e-439f-89c9-c25bf52091f1', 'aa232cf6-9d86-47a7-abce-dff84a3ea423'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:42:49 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-0ab6b09b-cb89-48f0-86e2-ecbaecc81017 tempest-ProjectMemberTests-232601277 None] Delete snapshot completed successfully. Jul 07 17:42:49 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0ab6b09b-cb89-48f0-86e2-ecbaecc81017 tempest-ProjectMemberTests-232601277 None] Lock "cinder-33dad1d7-c866-4d7d-9eae-e920d4bab868-delete_snapshot" released by "delete_snapshot" :: held 3.509s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:49 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-39179805-0595-4c69-af39-1b86c17a84b6 tempest-ProjectReaderTests-1784466903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e" returned: 0 in 0.847s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-39179805-0595-4c69-af39-1b86c17a84b6 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e.9263142d-6f52-4e25-9e01-a7829f610b1f 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:49 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e.9263142d-6f52-4e25-9e01-a7829f610b1f 1G Jul 07 17:42:49 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:50 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ff605200-cb83-4406-a6b6-42862c8b19e4 tempest-ProjectMemberTests-232601277 None] Acquiring lock "cinder-06789557-38b0-4324-b5b7-c4207395e691-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:50 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ff605200-cb83-4406-a6b6-42862c8b19e4 tempest-ProjectMemberTests-232601277 None] Lock "cinder-06789557-38b0-4324-b5b7-c4207395e691-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:50 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ff605200-cb83-4406-a6b6-42862c8b19e4 tempest-ProjectMemberTests-232601277 None] Acquiring lock "cinder-quobyte-06789557-38b0-4324-b5b7-c4207395e691" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:50 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ff605200-cb83-4406-a6b6-42862c8b19e4 tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-06789557-38b0-4324-b5b7-c4207395e691" acquired by "delete_volume" :: waited 0.026s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:50 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e87871b-18f2-463b-8e78-ac575eae885c]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ff605200-cb83-4406-a6b6-42862c8b19e4 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-06789557-38b0-4324-b5b7-c4207395e691 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:50 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-39179805-0595-4c69-af39-1b86c17a84b6 tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e.9263142d-6f52-4e25-9e01-a7829f610b1f 1G" returned: 0 in 1.086s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-39179805-0595-4c69-af39-1b86c17a84b6 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e.9263142d-6f52-4e25-9e01-a7829f610b1f {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:50 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-06789557-38b0-4324-b5b7-c4207395e691 Jul 07 17:42:50 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:50 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e.9263142d-6f52-4e25-9e01-a7829f610b1f Jul 07 17:42:50 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:51 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ff605200-cb83-4406-a6b6-42862c8b19e4 tempest-ProjectMemberTests-232601277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-06789557-38b0-4324-b5b7-c4207395e691" returned: 0 in 0.798s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ff605200-cb83-4406-a6b6-42862c8b19e4 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-06789557-38b0-4324-b5b7-c4207395e691 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:51 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:51 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-06789557-38b0-4324-b5b7-c4207395e691 Jul 07 17:42:51 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-39179805-0595-4c69-af39-1b86c17a84b6 tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e.9263142d-6f52-4e25-9e01-a7829f610b1f" returned: 0 in 0.698s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:51 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-39179805-0595-4c69-af39-1b86c17a84b6 tempest-ProjectReaderTests-1784466903 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e.9263142d-6f52-4e25-9e01-a7829f610b1f is being set with open permissions: ugo+rw Jul 07 17:42:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-39179805-0595-4c69-af39-1b86c17a84b6 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e.9263142d-6f52-4e25-9e01-a7829f610b1f {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:51 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e.9263142d-6f52-4e25-9e01-a7829f610b1f Jul 07 17:42:51 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:51 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ff605200-cb83-4406-a6b6-42862c8b19e4 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-06789557-38b0-4324-b5b7-c4207395e691" returned: 0 in 0.746s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:51 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-39179805-0595-4c69-af39-1b86c17a84b6 tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e.9263142d-6f52-4e25-9e01-a7829f610b1f" returned: 0 in 0.737s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:52 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ff605200-cb83-4406-a6b6-42862c8b19e4 tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-06789557-38b0-4324-b5b7-c4207395e691" released by "delete_volume" :: held 1.627s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-39179805-0595-4c69-af39-1b86c17a84b6 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:52 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e.info Jul 07 17:42:52 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:52 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-ff605200-cb83-4406-a6b6-42862c8b19e4 tempest-ProjectMemberTests-232601277 None] Created reservations ['81a76dc8-8cc0-46e0-af67-54ff5339d410', 'aab2c17d-25db-45a3-a792-6754a3fc5604', '82832e70-ef89-46d7-bb9e-c67f92dc89f4', '3d65ff23-2b95-455c-bd0d-97d72e9aa32e'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:42:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ff605200-cb83-4406-a6b6-42862c8b19e4 tempest-ProjectMemberTests-232601277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ff605200-cb83-4406-a6b6-42862c8b19e4 tempest-ProjectMemberTests-232601277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:52 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ff605200-cb83-4406-a6b6-42862c8b19e4 tempest-ProjectMemberTests-232601277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:52 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ff605200-cb83-4406-a6b6-42862c8b19e4 tempest-ProjectMemberTests-232601277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ff605200-cb83-4406-a6b6-42862c8b19e4 tempest-ProjectMemberTests-232601277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ff605200-cb83-4406-a6b6-42862c8b19e4 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:52 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:42:52 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:52 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-39179805-0595-4c69-af39-1b86c17a84b6 tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e.info" returned: 0 in 0.737s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:52 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-39179805-0595-4c69-af39-1b86c17a84b6 tempest-ProjectReaderTests-1784466903 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e.info is being set with open permissions: ugo+rw Jul 07 17:42:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-39179805-0595-4c69-af39-1b86c17a84b6 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:52 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e.info Jul 07 17:42:52 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:53 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ff605200-cb83-4406-a6b6-42862c8b19e4 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.891s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:53 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-ff605200-cb83-4406-a6b6-42862c8b19e4 tempest-ProjectMemberTests-232601277 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:42:53 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-ff605200-cb83-4406-a6b6-42862c8b19e4 tempest-ProjectMemberTests-232601277 None] Deleted volume successfully. Jul 07 17:42:53 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-39c48e7c-bde2-49f0-901e-f54064187112 tempest-ProjectMemberTests-232601277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:42:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-39c48e7c-bde2-49f0-901e-f54064187112 tempest-ProjectMemberTests-232601277 None] Flow 'volume_create_manager' (f9fd0dcf-126d-4ebc-84c5-21a37bad60fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:42:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-39c48e7c-bde2-49f0-901e-f54064187112 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fabefe62-c986-4009-b765-ad31e348143c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:53 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ff605200-cb83-4406-a6b6-42862c8b19e4 tempest-ProjectMemberTests-232601277 None] Lock "cinder-06789557-38b0-4324-b5b7-c4207395e691-delete_volume" released by "delete_volume" :: held 2.885s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-39c48e7c-bde2-49f0-901e-f54064187112 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fabefe62-c986-4009-b765-ad31e348143c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1001949570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=625552ba-e001-43e7-8a17-e14fc621fc26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='126630bddcf5433fb704f04aac171bde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:42:53Z,use_quota=True,user_id='f03110d4128243fca6ab7f6b4b51123a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-39c48e7c-bde2-49f0-901e-f54064187112 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1af2dc56-ff19-4fd1-b430-df4332d113c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-39c48e7c-bde2-49f0-901e-f54064187112 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1af2dc56-ff19-4fd1-b430-df4332d113c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-39c48e7c-bde2-49f0-901e-f54064187112 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2196f29-cdbe-46d1-b94f-27f8bdd181f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-39c48e7c-bde2-49f0-901e-f54064187112 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2196f29-cdbe-46d1-b94f-27f8bdd181f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '625552ba-e001-43e7-8a17-e14fc621fc26', 'volume_name': 'volume-625552ba-e001-43e7-8a17-e14fc621fc26', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-39c48e7c-bde2-49f0-901e-f54064187112 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cc9489d-28a6-40bd-836e-a1495e6b16d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-39c48e7c-bde2-49f0-901e-f54064187112 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cc9489d-28a6-40bd-836e-a1495e6b16d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-39c48e7c-bde2-49f0-901e-f54064187112 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eb6dc6b-2912-48be-9f73-81c192b68981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:53 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-39c48e7c-bde2-49f0-901e-f54064187112 tempest-ProjectMemberTests-232601277 None] Volume 625552ba-e001-43e7-8a17-e14fc621fc26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-625552ba-e001-43e7-8a17-e14fc621fc26', 'volume_size': 1} Jul 07 17:42:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-39c48e7c-bde2-49f0-901e-f54064187112 tempest-ProjectMemberTests-232601277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:53 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-39179805-0595-4c69-af39-1b86c17a84b6 tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e.info" returned: 0 in 0.747s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-39179805-0595-4c69-af39-1b86c17a84b6 tempest-ProjectReaderTests-1784466903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.956s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-39c48e7c-bde2-49f0-901e-f54064187112 tempest-ProjectMemberTests-232601277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.324s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:53 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-39c48e7c-bde2-49f0-901e-f54064187112 tempest-ProjectMemberTests-232601277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1001949570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=625552ba-e001-43e7-8a17-e14fc621fc26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='126630bddcf5433fb704f04aac171bde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:42:53Z,use_quota=True,user_id='f03110d4128243fca6ab7f6b4b51123a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:42:53 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-39c48e7c-bde2-49f0-901e-f54064187112 tempest-ProjectMemberTests-232601277 None] Creating volume 625552ba-e001-43e7-8a17-e14fc621fc26 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:42:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-39c48e7c-bde2-49f0-901e-f54064187112 tempest-ProjectMemberTests-232601277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-39c48e7c-bde2-49f0-901e-f54064187112 tempest-ProjectMemberTests-232601277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:53 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-39c48e7c-bde2-49f0-901e-f54064187112 tempest-ProjectMemberTests-232601277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:53 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-39c48e7c-bde2-49f0-901e-f54064187112 tempest-ProjectMemberTests-232601277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-39c48e7c-bde2-49f0-901e-f54064187112 tempest-ProjectMemberTests-232601277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:53 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-39c48e7c-bde2-49f0-901e-f54064187112 tempest-ProjectMemberTests-232601277 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:42:53 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-39c48e7c-bde2-49f0-901e-f54064187112 tempest-ProjectMemberTests-232601277 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:42:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-39c48e7c-bde2-49f0-901e-f54064187112 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-625552ba-e001-43e7-8a17-e14fc621fc26 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:53 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-625552ba-e001-43e7-8a17-e14fc621fc26 1073741824 Jul 07 17:42:53 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:53 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-39179805-0595-4c69-af39-1b86c17a84b6 tempest-ProjectReaderTests-1784466903 None] Create snapshot completed successfully Jul 07 17:42:54 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-57665ff9-8dcf-4151-b3d6-4d2dd20f8604 tempest-ProjectReaderTests-1784466903 None] Acquiring lock "cinder-9263142d-6f52-4e25-9e01-a7829f610b1f-delete_snapshot" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:54 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-57665ff9-8dcf-4151-b3d6-4d2dd20f8604 tempest-ProjectReaderTests-1784466903 None] Lock "cinder-9263142d-6f52-4e25-9e01-a7829f610b1f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:54 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-57665ff9-8dcf-4151-b3d6-4d2dd20f8604 tempest-ProjectReaderTests-1784466903 None] Acquiring lock "cinder-quobyte-c6ce9899-15c3-426c-bb06-7fdffe0ad73e" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:54 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-57665ff9-8dcf-4151-b3d6-4d2dd20f8604 tempest-ProjectReaderTests-1784466903 None] Lock "cinder-quobyte-c6ce9899-15c3-426c-bb06-7fdffe0ad73e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:54 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-57665ff9-8dcf-4151-b3d6-4d2dd20f8604 tempest-ProjectReaderTests-1784466903 None] Acquiring lock "cinder-quobyte-9263142d-6f52-4e25-9e01-a7829f610b1f" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:54 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-57665ff9-8dcf-4151-b3d6-4d2dd20f8604 tempest-ProjectReaderTests-1784466903 None] Lock "cinder-quobyte-9263142d-6f52-4e25-9e01-a7829f610b1f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:54 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-57665ff9-8dcf-4151-b3d6-4d2dd20f8604 tempest-ProjectReaderTests-1784466903 None] Deleting offline snapshot 9263142d-6f52-4e25-9e01-a7829f610b1f of volume c6ce9899-15c3-426c-bb06-7fdffe0ad73e {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:42:54 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-57665ff9-8dcf-4151-b3d6-4d2dd20f8604 tempest-ProjectReaderTests-1784466903 None] snapshot_file for this snap is: volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e.9263142d-6f52-4e25-9e01-a7829f610b1f {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:42:54 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3150c493-8a35-4ee7-97e3-949c5fa7c7c7]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-57665ff9-8dcf-4151-b3d6-4d2dd20f8604 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e.9263142d-6f52-4e25-9e01-a7829f610b1f {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:54 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e.9263142d-6f52-4e25-9e01-a7829f610b1f Jul 07 17:42:54 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:54 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-39c48e7c-bde2-49f0-901e-f54064187112 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-625552ba-e001-43e7-8a17-e14fc621fc26 1073741824" returned: 0 in 0.863s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-39c48e7c-bde2-49f0-901e-f54064187112 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-625552ba-e001-43e7-8a17-e14fc621fc26 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:54 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-625552ba-e001-43e7-8a17-e14fc621fc26 Jul 07 17:42:54 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:54 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-57665ff9-8dcf-4151-b3d6-4d2dd20f8604 tempest-ProjectReaderTests-1784466903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e.9263142d-6f52-4e25-9e01-a7829f610b1f" returned: 0 in 0.772s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:54 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-57665ff9-8dcf-4151-b3d6-4d2dd20f8604 tempest-ProjectReaderTests-1784466903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:42:54 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5102a6a0-1c49-467a-a97d-a62aad2e02c1]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-57665ff9-8dcf-4151-b3d6-4d2dd20f8604 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:55 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-39c48e7c-bde2-49f0-901e-f54064187112 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-625552ba-e001-43e7-8a17-e14fc621fc26" returned: 0 in 0.630s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:55 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-39c48e7c-bde2-49f0-901e-f54064187112 tempest-ProjectMemberTests-232601277 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:42:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-39c48e7c-bde2-49f0-901e-f54064187112 tempest-ProjectMemberTests-232601277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:55 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e Jul 07 17:42:55 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:55 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-39c48e7c-bde2-49f0-901e-f54064187112 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eb6dc6b-2912-48be-9f73-81c192b68981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-625552ba-e001-43e7-8a17-e14fc621fc26', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:55 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-39c48e7c-bde2-49f0-901e-f54064187112 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb90509d-1056-4984-a59f-52730eede97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:55 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-39c48e7c-bde2-49f0-901e-f54064187112 tempest-ProjectMemberTests-232601277 None] Volume volume-625552ba-e001-43e7-8a17-e14fc621fc26 (625552ba-e001-43e7-8a17-e14fc621fc26): created successfully Jul 07 17:42:55 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-39c48e7c-bde2-49f0-901e-f54064187112 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb90509d-1056-4984-a59f-52730eede97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:55 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-39c48e7c-bde2-49f0-901e-f54064187112 tempest-ProjectMemberTests-232601277 None] Flow 'volume_create_manager' (f9fd0dcf-126d-4ebc-84c5-21a37bad60fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:42:55 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-39c48e7c-bde2-49f0-901e-f54064187112 tempest-ProjectMemberTests-232601277 None] Created volume successfully. Jul 07 17:42:55 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-57665ff9-8dcf-4151-b3d6-4d2dd20f8604 tempest-ProjectReaderTests-1784466903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e" returned: 0 in 0.742s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-57665ff9-8dcf-4151-b3d6-4d2dd20f8604 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e.9263142d-6f52-4e25-9e01-a7829f610b1f {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:55 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e.9263142d-6f52-4e25-9e01-a7829f610b1f Jul 07 17:42:55 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-967932b6-5aa1-4971-98ef-1caa31fb8aa4 tempest-ProjectMemberTests-232601277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-967932b6-5aa1-4971-98ef-1caa31fb8aa4 tempest-ProjectMemberTests-232601277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:56 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-967932b6-5aa1-4971-98ef-1caa31fb8aa4 tempest-ProjectMemberTests-232601277 None] Creating offline snapshot 80068369-6354-4f00-b2fd-b9b09555f2c0 of volume 625552ba-e001-43e7-8a17-e14fc621fc26 {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:42:56 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce69bcc-cf21-4e8e-ae67-0f90766efad7]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-967932b6-5aa1-4971-98ef-1caa31fb8aa4 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-625552ba-e001-43e7-8a17-e14fc621fc26 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:56 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-57665ff9-8dcf-4151-b3d6-4d2dd20f8604 tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e.9263142d-6f52-4e25-9e01-a7829f610b1f" returned: 0 in 0.736s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-57665ff9-8dcf-4151-b3d6-4d2dd20f8604 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e.9263142d-6f52-4e25-9e01-a7829f610b1f {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:56 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e.9263142d-6f52-4e25-9e01-a7829f610b1f Jul 07 17:42:56 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:56 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-625552ba-e001-43e7-8a17-e14fc621fc26 Jul 07 17:42:56 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:57 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-57665ff9-8dcf-4151-b3d6-4d2dd20f8604 tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e.9263142d-6f52-4e25-9e01-a7829f610b1f" returned: 0 in 0.622s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:57 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-57665ff9-8dcf-4151-b3d6-4d2dd20f8604 tempest-ProjectReaderTests-1784466903 None] Lock "cinder-quobyte-9263142d-6f52-4e25-9e01-a7829f610b1f" released by "_delete_snapshot" :: held 2.964s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:57 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-57665ff9-8dcf-4151-b3d6-4d2dd20f8604 tempest-ProjectReaderTests-1784466903 None] Lock "cinder-quobyte-c6ce9899-15c3-426c-bb06-7fdffe0ad73e" released by "delete_snapshot" :: held 2.987s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:57 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-57665ff9-8dcf-4151-b3d6-4d2dd20f8604 tempest-ProjectReaderTests-1784466903 None] Created reservations ['c8687dd3-53e0-4fff-bca0-7a669614e5dc', '66dbd1d6-9ec3-4044-a356-3d9b6e12a474', '1df1cb76-ca9b-4da5-b3cb-4e22a20bccf0', '3606bd6f-48ff-421f-8a52-7da292fb15ef'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:42:57 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-57665ff9-8dcf-4151-b3d6-4d2dd20f8604 tempest-ProjectReaderTests-1784466903 None] Delete snapshot completed successfully. Jul 07 17:42:57 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-57665ff9-8dcf-4151-b3d6-4d2dd20f8604 tempest-ProjectReaderTests-1784466903 None] Lock "cinder-9263142d-6f52-4e25-9e01-a7829f610b1f-delete_snapshot" released by "delete_snapshot" :: held 3.184s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:57 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-967932b6-5aa1-4971-98ef-1caa31fb8aa4 tempest-ProjectMemberTests-232601277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-625552ba-e001-43e7-8a17-e14fc621fc26" returned: 0 in 0.866s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-967932b6-5aa1-4971-98ef-1caa31fb8aa4 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-625552ba-e001-43e7-8a17-e14fc621fc26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-625552ba-e001-43e7-8a17-e14fc621fc26.80068369-6354-4f00-b2fd-b9b09555f2c0 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:57 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-2ba4efd0-af4e-4bfe-9d15-012f9fa4ab96 tempest-ProjectReaderTests-1784466903 None] Acquiring lock "cinder-c6ce9899-15c3-426c-bb06-7fdffe0ad73e-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:57 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-625552ba-e001-43e7-8a17-e14fc621fc26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-625552ba-e001-43e7-8a17-e14fc621fc26.80068369-6354-4f00-b2fd-b9b09555f2c0 1G Jul 07 17:42:57 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:57 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-2ba4efd0-af4e-4bfe-9d15-012f9fa4ab96 tempest-ProjectReaderTests-1784466903 None] Lock "cinder-c6ce9899-15c3-426c-bb06-7fdffe0ad73e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:57 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-2ba4efd0-af4e-4bfe-9d15-012f9fa4ab96 tempest-ProjectReaderTests-1784466903 None] Acquiring lock "cinder-quobyte-c6ce9899-15c3-426c-bb06-7fdffe0ad73e" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:57 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-2ba4efd0-af4e-4bfe-9d15-012f9fa4ab96 tempest-ProjectReaderTests-1784466903 None] Lock "cinder-quobyte-c6ce9899-15c3-426c-bb06-7fdffe0ad73e" acquired by "delete_volume" :: waited 0.023s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:57 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[74922720-1cf5-41c3-b611-9e34e12213c7]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2ba4efd0-af4e-4bfe-9d15-012f9fa4ab96 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:57 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e Jul 07 17:42:57 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:58 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-967932b6-5aa1-4971-98ef-1caa31fb8aa4 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-625552ba-e001-43e7-8a17-e14fc621fc26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-625552ba-e001-43e7-8a17-e14fc621fc26.80068369-6354-4f00-b2fd-b9b09555f2c0 1G" returned: 0 in 0.844s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-967932b6-5aa1-4971-98ef-1caa31fb8aa4 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-625552ba-e001-43e7-8a17-e14fc621fc26 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-625552ba-e001-43e7-8a17-e14fc621fc26.80068369-6354-4f00-b2fd-b9b09555f2c0 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:58 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-625552ba-e001-43e7-8a17-e14fc621fc26 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-625552ba-e001-43e7-8a17-e14fc621fc26.80068369-6354-4f00-b2fd-b9b09555f2c0 Jul 07 17:42:58 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:58 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2ba4efd0-af4e-4bfe-9d15-012f9fa4ab96 tempest-ProjectReaderTests-1784466903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e" returned: 0 in 0.808s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2ba4efd0-af4e-4bfe-9d15-012f9fa4ab96 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:58 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e Jul 07 17:42:58 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:58 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-967932b6-5aa1-4971-98ef-1caa31fb8aa4 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-625552ba-e001-43e7-8a17-e14fc621fc26 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-625552ba-e001-43e7-8a17-e14fc621fc26.80068369-6354-4f00-b2fd-b9b09555f2c0" returned: 0 in 0.695s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:58 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-967932b6-5aa1-4971-98ef-1caa31fb8aa4 tempest-ProjectMemberTests-232601277 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-625552ba-e001-43e7-8a17-e14fc621fc26.80068369-6354-4f00-b2fd-b9b09555f2c0 is being set with open permissions: ugo+rw Jul 07 17:42:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-967932b6-5aa1-4971-98ef-1caa31fb8aa4 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-625552ba-e001-43e7-8a17-e14fc621fc26.80068369-6354-4f00-b2fd-b9b09555f2c0 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:58 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-625552ba-e001-43e7-8a17-e14fc621fc26.80068369-6354-4f00-b2fd-b9b09555f2c0 Jul 07 17:42:58 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:58 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2ba4efd0-af4e-4bfe-9d15-012f9fa4ab96 tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c6ce9899-15c3-426c-bb06-7fdffe0ad73e" returned: 0 in 0.676s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:58 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-2ba4efd0-af4e-4bfe-9d15-012f9fa4ab96 tempest-ProjectReaderTests-1784466903 None] Lock "cinder-quobyte-c6ce9899-15c3-426c-bb06-7fdffe0ad73e" released by "delete_volume" :: held 1.541s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:59 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-2ba4efd0-af4e-4bfe-9d15-012f9fa4ab96 tempest-ProjectReaderTests-1784466903 None] Created reservations ['38e88269-fe71-4048-a738-4776f1c5a99d', 'fdbdf56d-fc0a-460d-a619-978b567bf72e', '9d68d4d8-78ab-4d26-9d70-1a4e76d00d02', 'eb06adf0-e694-4672-9400-23cd3d5f73fc'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:42:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-2ba4efd0-af4e-4bfe-9d15-012f9fa4ab96 tempest-ProjectReaderTests-1784466903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-2ba4efd0-af4e-4bfe-9d15-012f9fa4ab96 tempest-ProjectReaderTests-1784466903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:59 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-2ba4efd0-af4e-4bfe-9d15-012f9fa4ab96 tempest-ProjectReaderTests-1784466903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:59 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-2ba4efd0-af4e-4bfe-9d15-012f9fa4ab96 tempest-ProjectReaderTests-1784466903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-2ba4efd0-af4e-4bfe-9d15-012f9fa4ab96 tempest-ProjectReaderTests-1784466903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2ba4efd0-af4e-4bfe-9d15-012f9fa4ab96 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:59 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:42:59 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:59 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-967932b6-5aa1-4971-98ef-1caa31fb8aa4 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-625552ba-e001-43e7-8a17-e14fc621fc26.80068369-6354-4f00-b2fd-b9b09555f2c0" returned: 0 in 0.645s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-967932b6-5aa1-4971-98ef-1caa31fb8aa4 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-625552ba-e001-43e7-8a17-e14fc621fc26.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:59 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-625552ba-e001-43e7-8a17-e14fc621fc26.info Jul 07 17:42:59 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:59 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-2ba4efd0-af4e-4bfe-9d15-012f9fa4ab96 tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.668s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:59 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-2ba4efd0-af4e-4bfe-9d15-012f9fa4ab96 tempest-ProjectReaderTests-1784466903 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:42:59 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-2ba4efd0-af4e-4bfe-9d15-012f9fa4ab96 tempest-ProjectReaderTests-1784466903 None] Deleted volume successfully. Jul 07 17:42:59 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-2ba4efd0-af4e-4bfe-9d15-012f9fa4ab96 tempest-ProjectReaderTests-1784466903 None] Lock "cinder-c6ce9899-15c3-426c-bb06-7fdffe0ad73e-delete_volume" released by "delete_volume" :: held 2.437s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:00 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-de109c6b-4064-48a5-aa11-d830b8ed12c7 tempest-ProjectReaderTests-1784466903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:43:00 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-de109c6b-4064-48a5-aa11-d830b8ed12c7 tempest-ProjectReaderTests-1784466903 None] Flow 'volume_create_manager' (3038f593-011b-4ec0-90b5-cc62777f5b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:00 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-de109c6b-4064-48a5-aa11-d830b8ed12c7 tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c292ecda-cc3e-4b77-9224-e318e616c4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:00 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-de109c6b-4064-48a5-aa11-d830b8ed12c7 tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c292ecda-cc3e-4b77-9224-e318e616c4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-950897515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc2fd750-a256-4719-bf90-04f8787aeeaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f7af8480fe431192778df1c311e074',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:00Z,use_quota=True,user_id='98144cb6a2c64593a39ce3220c506359',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:00 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-de109c6b-4064-48a5-aa11-d830b8ed12c7 tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beac33ef-37a7-415e-ac68-437dffe70b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:00 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-de109c6b-4064-48a5-aa11-d830b8ed12c7 tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beac33ef-37a7-415e-ac68-437dffe70b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:00 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-de109c6b-4064-48a5-aa11-d830b8ed12c7 tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8488724-9bcd-4f78-8828-ecce8b72ab03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:00 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-de109c6b-4064-48a5-aa11-d830b8ed12c7 tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8488724-9bcd-4f78-8828-ecce8b72ab03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc2fd750-a256-4719-bf90-04f8787aeeaf', 'volume_name': 'volume-bc2fd750-a256-4719-bf90-04f8787aeeaf', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:00 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-de109c6b-4064-48a5-aa11-d830b8ed12c7 tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fea42c7-0f14-4b0d-8978-63cf865f4125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:00 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-de109c6b-4064-48a5-aa11-d830b8ed12c7 tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fea42c7-0f14-4b0d-8978-63cf865f4125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:00 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-de109c6b-4064-48a5-aa11-d830b8ed12c7 tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2e92ce5-9409-4593-9a76-9bad11682fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:00 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-de109c6b-4064-48a5-aa11-d830b8ed12c7 tempest-ProjectReaderTests-1784466903 None] Volume bc2fd750-a256-4719-bf90-04f8787aeeaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc2fd750-a256-4719-bf90-04f8787aeeaf', 'volume_size': 1} Jul 07 17:43:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-de109c6b-4064-48a5-aa11-d830b8ed12c7 tempest-ProjectReaderTests-1784466903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:00 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-967932b6-5aa1-4971-98ef-1caa31fb8aa4 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-625552ba-e001-43e7-8a17-e14fc621fc26.info" returned: 0 in 0.655s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:00 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-967932b6-5aa1-4971-98ef-1caa31fb8aa4 tempest-ProjectMemberTests-232601277 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-625552ba-e001-43e7-8a17-e14fc621fc26.info is being set with open permissions: ugo+rw Jul 07 17:43:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-967932b6-5aa1-4971-98ef-1caa31fb8aa4 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-625552ba-e001-43e7-8a17-e14fc621fc26.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:00 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-625552ba-e001-43e7-8a17-e14fc621fc26.info Jul 07 17:43:00 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:00 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-967932b6-5aa1-4971-98ef-1caa31fb8aa4 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-625552ba-e001-43e7-8a17-e14fc621fc26.info" returned: 0 in 0.618s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-967932b6-5aa1-4971-98ef-1caa31fb8aa4 tempest-ProjectMemberTests-232601277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.417s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-de109c6b-4064-48a5-aa11-d830b8ed12c7 tempest-ProjectReaderTests-1784466903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.650s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:00 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-de109c6b-4064-48a5-aa11-d830b8ed12c7 tempest-ProjectReaderTests-1784466903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-950897515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc2fd750-a256-4719-bf90-04f8787aeeaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f7af8480fe431192778df1c311e074',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:00Z,use_quota=True,user_id='98144cb6a2c64593a39ce3220c506359',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:43:00 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-de109c6b-4064-48a5-aa11-d830b8ed12c7 tempest-ProjectReaderTests-1784466903 None] Creating volume bc2fd750-a256-4719-bf90-04f8787aeeaf {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:43:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-de109c6b-4064-48a5-aa11-d830b8ed12c7 tempest-ProjectReaderTests-1784466903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-de109c6b-4064-48a5-aa11-d830b8ed12c7 tempest-ProjectReaderTests-1784466903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:00 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-de109c6b-4064-48a5-aa11-d830b8ed12c7 tempest-ProjectReaderTests-1784466903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:00 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-de109c6b-4064-48a5-aa11-d830b8ed12c7 tempest-ProjectReaderTests-1784466903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-de109c6b-4064-48a5-aa11-d830b8ed12c7 tempest-ProjectReaderTests-1784466903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:00 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-de109c6b-4064-48a5-aa11-d830b8ed12c7 tempest-ProjectReaderTests-1784466903 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:43:00 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-de109c6b-4064-48a5-aa11-d830b8ed12c7 tempest-ProjectReaderTests-1784466903 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:43:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-de109c6b-4064-48a5-aa11-d830b8ed12c7 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bc2fd750-a256-4719-bf90-04f8787aeeaf 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:00 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bc2fd750-a256-4719-bf90-04f8787aeeaf 1073741824 Jul 07 17:43:00 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:00 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-967932b6-5aa1-4971-98ef-1caa31fb8aa4 tempest-ProjectMemberTests-232601277 None] Create snapshot completed successfully Jul 07 17:43:01 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-de109c6b-4064-48a5-aa11-d830b8ed12c7 tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bc2fd750-a256-4719-bf90-04f8787aeeaf 1073741824" returned: 0 in 0.811s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:01 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-af7688f4-8b03-4e3f-a3b6-320fc306e60c tempest-ProjectMemberTests-232601277 None] Acquiring lock "cinder-80068369-6354-4f00-b2fd-b9b09555f2c0-delete_snapshot" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:01 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-af7688f4-8b03-4e3f-a3b6-320fc306e60c tempest-ProjectMemberTests-232601277 None] Lock "cinder-80068369-6354-4f00-b2fd-b9b09555f2c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:01 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-af7688f4-8b03-4e3f-a3b6-320fc306e60c tempest-ProjectMemberTests-232601277 None] Acquiring lock "cinder-quobyte-625552ba-e001-43e7-8a17-e14fc621fc26" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-de109c6b-4064-48a5-aa11-d830b8ed12c7 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bc2fd750-a256-4719-bf90-04f8787aeeaf {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:01 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-af7688f4-8b03-4e3f-a3b6-320fc306e60c tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-625552ba-e001-43e7-8a17-e14fc621fc26" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:01 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-af7688f4-8b03-4e3f-a3b6-320fc306e60c tempest-ProjectMemberTests-232601277 None] Acquiring lock "cinder-quobyte-80068369-6354-4f00-b2fd-b9b09555f2c0" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:01 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bc2fd750-a256-4719-bf90-04f8787aeeaf Jul 07 17:43:01 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:01 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-af7688f4-8b03-4e3f-a3b6-320fc306e60c tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-80068369-6354-4f00-b2fd-b9b09555f2c0" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:01 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-af7688f4-8b03-4e3f-a3b6-320fc306e60c tempest-ProjectMemberTests-232601277 None] Deleting offline snapshot 80068369-6354-4f00-b2fd-b9b09555f2c0 of volume 625552ba-e001-43e7-8a17-e14fc621fc26 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:43:01 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-af7688f4-8b03-4e3f-a3b6-320fc306e60c tempest-ProjectMemberTests-232601277 None] snapshot_file for this snap is: volume-625552ba-e001-43e7-8a17-e14fc621fc26.80068369-6354-4f00-b2fd-b9b09555f2c0 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:43:01 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2c8feb-0859-489a-872a-06e479fe36d2]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-af7688f4-8b03-4e3f-a3b6-320fc306e60c tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-625552ba-e001-43e7-8a17-e14fc621fc26.80068369-6354-4f00-b2fd-b9b09555f2c0 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:01 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-625552ba-e001-43e7-8a17-e14fc621fc26.80068369-6354-4f00-b2fd-b9b09555f2c0 Jul 07 17:43:01 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:02 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-de109c6b-4064-48a5-aa11-d830b8ed12c7 tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bc2fd750-a256-4719-bf90-04f8787aeeaf" returned: 0 in 0.629s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:02 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-de109c6b-4064-48a5-aa11-d830b8ed12c7 tempest-ProjectReaderTests-1784466903 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:43:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-de109c6b-4064-48a5-aa11-d830b8ed12c7 tempest-ProjectReaderTests-1784466903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.506s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:02 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-de109c6b-4064-48a5-aa11-d830b8ed12c7 tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2e92ce5-9409-4593-9a76-9bad11682fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc2fd750-a256-4719-bf90-04f8787aeeaf', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:02 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-de109c6b-4064-48a5-aa11-d830b8ed12c7 tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47a0f971-336e-499b-82a9-fd88fbc55867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:02 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-de109c6b-4064-48a5-aa11-d830b8ed12c7 tempest-ProjectReaderTests-1784466903 None] Volume volume-bc2fd750-a256-4719-bf90-04f8787aeeaf (bc2fd750-a256-4719-bf90-04f8787aeeaf): created successfully Jul 07 17:43:02 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-de109c6b-4064-48a5-aa11-d830b8ed12c7 tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47a0f971-336e-499b-82a9-fd88fbc55867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:02 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-de109c6b-4064-48a5-aa11-d830b8ed12c7 tempest-ProjectReaderTests-1784466903 None] Flow 'volume_create_manager' (3038f593-011b-4ec0-90b5-cc62777f5b74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:02 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-de109c6b-4064-48a5-aa11-d830b8ed12c7 tempest-ProjectReaderTests-1784466903 None] Created volume successfully. Jul 07 17:43:02 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-af7688f4-8b03-4e3f-a3b6-320fc306e60c tempest-ProjectMemberTests-232601277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-625552ba-e001-43e7-8a17-e14fc621fc26.80068369-6354-4f00-b2fd-b9b09555f2c0" returned: 0 in 0.768s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:02 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-af7688f4-8b03-4e3f-a3b6-320fc306e60c tempest-ProjectMemberTests-232601277 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-625552ba-e001-43e7-8a17-e14fc621fc26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:43:02 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a35666-d0dc-41db-847b-f47a8ac71e8d]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-af7688f4-8b03-4e3f-a3b6-320fc306e60c tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-625552ba-e001-43e7-8a17-e14fc621fc26 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:02 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-625552ba-e001-43e7-8a17-e14fc621fc26 Jul 07 17:43:02 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:03 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-af7688f4-8b03-4e3f-a3b6-320fc306e60c tempest-ProjectMemberTests-232601277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-625552ba-e001-43e7-8a17-e14fc621fc26" returned: 0 in 0.802s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-af7688f4-8b03-4e3f-a3b6-320fc306e60c tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-625552ba-e001-43e7-8a17-e14fc621fc26.80068369-6354-4f00-b2fd-b9b09555f2c0 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:03 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-625552ba-e001-43e7-8a17-e14fc621fc26.80068369-6354-4f00-b2fd-b9b09555f2c0 Jul 07 17:43:03 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-13e77f16-4d07-4fab-9dab-b34e8f8f6365 tempest-ProjectReaderTests-1784466903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-13e77f16-4d07-4fab-9dab-b34e8f8f6365 tempest-ProjectReaderTests-1784466903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:03 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-13e77f16-4d07-4fab-9dab-b34e8f8f6365 tempest-ProjectReaderTests-1784466903 None] Creating offline snapshot 77c8f458-bd46-4b8d-b2b3-96a2de548aeb of volume bc2fd750-a256-4719-bf90-04f8787aeeaf {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:43:03 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b825f767-242d-484e-9bee-7949b5c7a766]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-13e77f16-4d07-4fab-9dab-b34e8f8f6365 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bc2fd750-a256-4719-bf90-04f8787aeeaf {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:03 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bc2fd750-a256-4719-bf90-04f8787aeeaf Jul 07 17:43:03 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:04 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-af7688f4-8b03-4e3f-a3b6-320fc306e60c tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-625552ba-e001-43e7-8a17-e14fc621fc26.80068369-6354-4f00-b2fd-b9b09555f2c0" returned: 0 in 0.785s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-af7688f4-8b03-4e3f-a3b6-320fc306e60c tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-625552ba-e001-43e7-8a17-e14fc621fc26.80068369-6354-4f00-b2fd-b9b09555f2c0 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:04 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-625552ba-e001-43e7-8a17-e14fc621fc26.80068369-6354-4f00-b2fd-b9b09555f2c0 Jul 07 17:43:04 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:04 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-13e77f16-4d07-4fab-9dab-b34e8f8f6365 tempest-ProjectReaderTests-1784466903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bc2fd750-a256-4719-bf90-04f8787aeeaf" returned: 0 in 0.869s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-13e77f16-4d07-4fab-9dab-b34e8f8f6365 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bc2fd750-a256-4719-bf90-04f8787aeeaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bc2fd750-a256-4719-bf90-04f8787aeeaf.77c8f458-bd46-4b8d-b2b3-96a2de548aeb 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:04 devstack sudo[106680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bc2fd750-a256-4719-bf90-04f8787aeeaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bc2fd750-a256-4719-bf90-04f8787aeeaf.77c8f458-bd46-4b8d-b2b3-96a2de548aeb 1G Jul 07 17:43:04 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:04 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-af7688f4-8b03-4e3f-a3b6-320fc306e60c tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-625552ba-e001-43e7-8a17-e14fc621fc26.80068369-6354-4f00-b2fd-b9b09555f2c0" returned: 0 in 0.692s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:04 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-af7688f4-8b03-4e3f-a3b6-320fc306e60c tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-80068369-6354-4f00-b2fd-b9b09555f2c0" released by "_delete_snapshot" :: held 3.145s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:04 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-af7688f4-8b03-4e3f-a3b6-320fc306e60c tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-625552ba-e001-43e7-8a17-e14fc621fc26" released by "delete_snapshot" :: held 3.171s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:04 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-af7688f4-8b03-4e3f-a3b6-320fc306e60c tempest-ProjectMemberTests-232601277 None] Created reservations ['9c85f173-ec15-4662-b632-da6217ca4a9e', '987ddaac-51af-4067-9ce4-23e37edefd8e', 'da0c2a70-8b36-4d24-8f1e-56cf2d35b5d2', '0c824f30-9980-4149-a08f-b7459fa2d2d4'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:43:05 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-af7688f4-8b03-4e3f-a3b6-320fc306e60c tempest-ProjectMemberTests-232601277 None] Delete snapshot completed successfully. Jul 07 17:43:05 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-af7688f4-8b03-4e3f-a3b6-320fc306e60c tempest-ProjectMemberTests-232601277 None] Lock "cinder-80068369-6354-4f00-b2fd-b9b09555f2c0-delete_snapshot" released by "delete_snapshot" :: held 3.348s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:05 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-13e77f16-4d07-4fab-9dab-b34e8f8f6365 tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bc2fd750-a256-4719-bf90-04f8787aeeaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bc2fd750-a256-4719-bf90-04f8787aeeaf.77c8f458-bd46-4b8d-b2b3-96a2de548aeb 1G" returned: 0 in 0.821s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-13e77f16-4d07-4fab-9dab-b34e8f8f6365 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc2fd750-a256-4719-bf90-04f8787aeeaf -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bc2fd750-a256-4719-bf90-04f8787aeeaf.77c8f458-bd46-4b8d-b2b3-96a2de548aeb {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:05 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc2fd750-a256-4719-bf90-04f8787aeeaf -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bc2fd750-a256-4719-bf90-04f8787aeeaf.77c8f458-bd46-4b8d-b2b3-96a2de548aeb Jul 07 17:43:05 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:05 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-13e77f16-4d07-4fab-9dab-b34e8f8f6365 tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc2fd750-a256-4719-bf90-04f8787aeeaf -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bc2fd750-a256-4719-bf90-04f8787aeeaf.77c8f458-bd46-4b8d-b2b3-96a2de548aeb" returned: 0 in 0.672s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:05 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-13e77f16-4d07-4fab-9dab-b34e8f8f6365 tempest-ProjectReaderTests-1784466903 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bc2fd750-a256-4719-bf90-04f8787aeeaf.77c8f458-bd46-4b8d-b2b3-96a2de548aeb is being set with open permissions: ugo+rw Jul 07 17:43:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-13e77f16-4d07-4fab-9dab-b34e8f8f6365 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bc2fd750-a256-4719-bf90-04f8787aeeaf.77c8f458-bd46-4b8d-b2b3-96a2de548aeb {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:05 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bc2fd750-a256-4719-bf90-04f8787aeeaf.77c8f458-bd46-4b8d-b2b3-96a2de548aeb Jul 07 17:43:05 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-8c3aee6f-59a8-4363-af94-c4bbf87bf60e tempest-ProjectMemberTests-232601277 None] Acquiring lock "cinder-625552ba-e001-43e7-8a17-e14fc621fc26-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:05 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:05 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-8c3aee6f-59a8-4363-af94-c4bbf87bf60e tempest-ProjectMemberTests-232601277 None] Lock "cinder-625552ba-e001-43e7-8a17-e14fc621fc26-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:05 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-8c3aee6f-59a8-4363-af94-c4bbf87bf60e tempest-ProjectMemberTests-232601277 None] Acquiring lock "cinder-quobyte-625552ba-e001-43e7-8a17-e14fc621fc26" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:05 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-8c3aee6f-59a8-4363-af94-c4bbf87bf60e tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-625552ba-e001-43e7-8a17-e14fc621fc26" acquired by "delete_volume" :: waited 0.017s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:06 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c389de98-3023-4483-8bbb-f5310f6065bd]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8c3aee6f-59a8-4363-af94-c4bbf87bf60e tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-625552ba-e001-43e7-8a17-e14fc621fc26 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:06 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-625552ba-e001-43e7-8a17-e14fc621fc26 Jul 07 17:43:06 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:06 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-13e77f16-4d07-4fab-9dab-b34e8f8f6365 tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bc2fd750-a256-4719-bf90-04f8787aeeaf.77c8f458-bd46-4b8d-b2b3-96a2de548aeb" returned: 0 in 0.647s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-13e77f16-4d07-4fab-9dab-b34e8f8f6365 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bc2fd750-a256-4719-bf90-04f8787aeeaf.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:06 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bc2fd750-a256-4719-bf90-04f8787aeeaf.info Jul 07 17:43:06 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:06 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8c3aee6f-59a8-4363-af94-c4bbf87bf60e tempest-ProjectMemberTests-232601277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-625552ba-e001-43e7-8a17-e14fc621fc26" returned: 0 in 0.771s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8c3aee6f-59a8-4363-af94-c4bbf87bf60e tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-625552ba-e001-43e7-8a17-e14fc621fc26 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:06 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-625552ba-e001-43e7-8a17-e14fc621fc26 Jul 07 17:43:06 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:07 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-13e77f16-4d07-4fab-9dab-b34e8f8f6365 tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bc2fd750-a256-4719-bf90-04f8787aeeaf.info" returned: 0 in 0.664s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:07 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-13e77f16-4d07-4fab-9dab-b34e8f8f6365 tempest-ProjectReaderTests-1784466903 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bc2fd750-a256-4719-bf90-04f8787aeeaf.info is being set with open permissions: ugo+rw Jul 07 17:43:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-13e77f16-4d07-4fab-9dab-b34e8f8f6365 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bc2fd750-a256-4719-bf90-04f8787aeeaf.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:07 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bc2fd750-a256-4719-bf90-04f8787aeeaf.info Jul 07 17:43:07 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:07 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8c3aee6f-59a8-4363-af94-c4bbf87bf60e tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-625552ba-e001-43e7-8a17-e14fc621fc26" returned: 0 in 0.661s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:07 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-8c3aee6f-59a8-4363-af94-c4bbf87bf60e tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-625552ba-e001-43e7-8a17-e14fc621fc26" released by "delete_volume" :: held 1.495s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:07 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-8c3aee6f-59a8-4363-af94-c4bbf87bf60e tempest-ProjectMemberTests-232601277 None] Created reservations ['e3127751-ff09-41ba-a28b-a0766dd87a70', '8000efa1-e794-4ec7-9775-82b0248e5b99', '9d2d54a7-388d-4398-8ab2-5662e474e982', '599b7a53-2971-47f0-aaef-5087b1117d18'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:43:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-8c3aee6f-59a8-4363-af94-c4bbf87bf60e tempest-ProjectMemberTests-232601277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-8c3aee6f-59a8-4363-af94-c4bbf87bf60e tempest-ProjectMemberTests-232601277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:07 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-8c3aee6f-59a8-4363-af94-c4bbf87bf60e tempest-ProjectMemberTests-232601277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:07 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-8c3aee6f-59a8-4363-af94-c4bbf87bf60e tempest-ProjectMemberTests-232601277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-8c3aee6f-59a8-4363-af94-c4bbf87bf60e tempest-ProjectMemberTests-232601277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8c3aee6f-59a8-4363-af94-c4bbf87bf60e tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:07 devstack sudo[106707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:43:07 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:07 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-13e77f16-4d07-4fab-9dab-b34e8f8f6365 tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bc2fd750-a256-4719-bf90-04f8787aeeaf.info" returned: 0 in 0.646s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-13e77f16-4d07-4fab-9dab-b34e8f8f6365 tempest-ProjectReaderTests-1784466903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.411s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:07 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-13e77f16-4d07-4fab-9dab-b34e8f8f6365 tempest-ProjectReaderTests-1784466903 None] Create snapshot completed successfully Jul 07 17:43:08 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8c3aee6f-59a8-4363-af94-c4bbf87bf60e tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.640s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:08 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-8c3aee6f-59a8-4363-af94-c4bbf87bf60e tempest-ProjectMemberTests-232601277 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:43:08 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-8c3aee6f-59a8-4363-af94-c4bbf87bf60e tempest-ProjectMemberTests-232601277 None] Deleted volume successfully. Jul 07 17:43:08 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-8c3aee6f-59a8-4363-af94-c4bbf87bf60e tempest-ProjectMemberTests-232601277 None] Lock "cinder-625552ba-e001-43e7-8a17-e14fc621fc26-delete_volume" released by "delete_volume" :: held 2.356s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:08 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-453bfc35-a73f-4bfb-8d90-6e7bf7843137 tempest-ProjectMemberTests-232601277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:43:08 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-453bfc35-a73f-4bfb-8d90-6e7bf7843137 tempest-ProjectMemberTests-232601277 None] Flow 'volume_create_manager' (dfc535c7-fca3-4bbc-9985-5f909f390f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:08 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-453bfc35-a73f-4bfb-8d90-6e7bf7843137 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf0a1d2a-d52d-4753-8f08-dff73236b36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:08 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-453bfc35-a73f-4bfb-8d90-6e7bf7843137 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf0a1d2a-d52d-4753-8f08-dff73236b36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-401037625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=342e9f36-0976-4af0-ae43-3bc66b5e82eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='126630bddcf5433fb704f04aac171bde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:09Z,use_quota=True,user_id='f03110d4128243fca6ab7f6b4b51123a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:08 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-453bfc35-a73f-4bfb-8d90-6e7bf7843137 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75463074-024a-444b-bead-88805462a3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:08 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-453bfc35-a73f-4bfb-8d90-6e7bf7843137 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75463074-024a-444b-bead-88805462a3a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:08 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-453bfc35-a73f-4bfb-8d90-6e7bf7843137 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad65c5ea-22f1-473e-a647-01eac7e07a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:08 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-453bfc35-a73f-4bfb-8d90-6e7bf7843137 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad65c5ea-22f1-473e-a647-01eac7e07a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '342e9f36-0976-4af0-ae43-3bc66b5e82eb', 'volume_name': 'volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:08 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-453bfc35-a73f-4bfb-8d90-6e7bf7843137 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d35f7f0e-3d4e-4a01-b297-061037894e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:08 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-453bfc35-a73f-4bfb-8d90-6e7bf7843137 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d35f7f0e-3d4e-4a01-b297-061037894e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:08 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-453bfc35-a73f-4bfb-8d90-6e7bf7843137 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1108c57c-35b9-4ea7-9dd7-acbc83f88a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:08 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-453bfc35-a73f-4bfb-8d90-6e7bf7843137 tempest-ProjectMemberTests-232601277 None] Volume 342e9f36-0976-4af0-ae43-3bc66b5e82eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb', 'volume_size': 1} Jul 07 17:43:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-453bfc35-a73f-4bfb-8d90-6e7bf7843137 tempest-ProjectMemberTests-232601277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-453bfc35-a73f-4bfb-8d90-6e7bf7843137 tempest-ProjectMemberTests-232601277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:08 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-453bfc35-a73f-4bfb-8d90-6e7bf7843137 tempest-ProjectMemberTests-232601277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-401037625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=342e9f36-0976-4af0-ae43-3bc66b5e82eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='126630bddcf5433fb704f04aac171bde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:09Z,use_quota=True,user_id='f03110d4128243fca6ab7f6b4b51123a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:43:08 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-453bfc35-a73f-4bfb-8d90-6e7bf7843137 tempest-ProjectMemberTests-232601277 None] Creating volume 342e9f36-0976-4af0-ae43-3bc66b5e82eb {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:43:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-453bfc35-a73f-4bfb-8d90-6e7bf7843137 tempest-ProjectMemberTests-232601277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-453bfc35-a73f-4bfb-8d90-6e7bf7843137 tempest-ProjectMemberTests-232601277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:08 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-453bfc35-a73f-4bfb-8d90-6e7bf7843137 tempest-ProjectMemberTests-232601277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:08 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-453bfc35-a73f-4bfb-8d90-6e7bf7843137 tempest-ProjectMemberTests-232601277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-453bfc35-a73f-4bfb-8d90-6e7bf7843137 tempest-ProjectMemberTests-232601277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:08 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-453bfc35-a73f-4bfb-8d90-6e7bf7843137 tempest-ProjectMemberTests-232601277 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:43:08 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-453bfc35-a73f-4bfb-8d90-6e7bf7843137 tempest-ProjectMemberTests-232601277 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:43:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-453bfc35-a73f-4bfb-8d90-6e7bf7843137 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:08 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb 1073741824 Jul 07 17:43:08 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:08 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-758a1018-0fc5-44be-8274-c438d865ce0a tempest-ProjectReaderTests-1784466903 None] Acquiring lock "cinder-77c8f458-bd46-4b8d-b2b3-96a2de548aeb-delete_snapshot" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:08 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-758a1018-0fc5-44be-8274-c438d865ce0a tempest-ProjectReaderTests-1784466903 None] Lock "cinder-77c8f458-bd46-4b8d-b2b3-96a2de548aeb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:08 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-758a1018-0fc5-44be-8274-c438d865ce0a tempest-ProjectReaderTests-1784466903 None] Acquiring lock "cinder-quobyte-bc2fd750-a256-4719-bf90-04f8787aeeaf" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:08 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-758a1018-0fc5-44be-8274-c438d865ce0a tempest-ProjectReaderTests-1784466903 None] Lock "cinder-quobyte-bc2fd750-a256-4719-bf90-04f8787aeeaf" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:08 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-758a1018-0fc5-44be-8274-c438d865ce0a tempest-ProjectReaderTests-1784466903 None] Acquiring lock "cinder-quobyte-77c8f458-bd46-4b8d-b2b3-96a2de548aeb" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:08 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-758a1018-0fc5-44be-8274-c438d865ce0a tempest-ProjectReaderTests-1784466903 None] Lock "cinder-quobyte-77c8f458-bd46-4b8d-b2b3-96a2de548aeb" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:08 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-758a1018-0fc5-44be-8274-c438d865ce0a tempest-ProjectReaderTests-1784466903 None] Deleting offline snapshot 77c8f458-bd46-4b8d-b2b3-96a2de548aeb of volume bc2fd750-a256-4719-bf90-04f8787aeeaf {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:43:08 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-758a1018-0fc5-44be-8274-c438d865ce0a tempest-ProjectReaderTests-1784466903 None] snapshot_file for this snap is: volume-bc2fd750-a256-4719-bf90-04f8787aeeaf.77c8f458-bd46-4b8d-b2b3-96a2de548aeb {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:43:08 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e3d8c0-8332-46bd-be81-71221944ea0f]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-758a1018-0fc5-44be-8274-c438d865ce0a tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bc2fd750-a256-4719-bf90-04f8787aeeaf.77c8f458-bd46-4b8d-b2b3-96a2de548aeb {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:08 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bc2fd750-a256-4719-bf90-04f8787aeeaf.77c8f458-bd46-4b8d-b2b3-96a2de548aeb Jul 07 17:43:08 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:09 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-453bfc35-a73f-4bfb-8d90-6e7bf7843137 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb 1073741824" returned: 0 in 0.791s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-453bfc35-a73f-4bfb-8d90-6e7bf7843137 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:09 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb Jul 07 17:43:09 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:09 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-758a1018-0fc5-44be-8274-c438d865ce0a tempest-ProjectReaderTests-1784466903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bc2fd750-a256-4719-bf90-04f8787aeeaf.77c8f458-bd46-4b8d-b2b3-96a2de548aeb" returned: 0 in 0.822s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:09 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-758a1018-0fc5-44be-8274-c438d865ce0a tempest-ProjectReaderTests-1784466903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc2fd750-a256-4719-bf90-04f8787aeeaf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:43:09 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c74a36-e97b-41d8-9a2b-37e1bba56916]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-758a1018-0fc5-44be-8274-c438d865ce0a tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bc2fd750-a256-4719-bf90-04f8787aeeaf {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:09 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bc2fd750-a256-4719-bf90-04f8787aeeaf Jul 07 17:43:09 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:10 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-453bfc35-a73f-4bfb-8d90-6e7bf7843137 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb" returned: 0 in 0.615s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:10 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-453bfc35-a73f-4bfb-8d90-6e7bf7843137 tempest-ProjectMemberTests-232601277 None] <== create_volume: return (1456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:43:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-453bfc35-a73f-4bfb-8d90-6e7bf7843137 tempest-ProjectMemberTests-232601277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.459s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-453bfc35-a73f-4bfb-8d90-6e7bf7843137 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1108c57c-35b9-4ea7-9dd7-acbc83f88a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-453bfc35-a73f-4bfb-8d90-6e7bf7843137 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b27719f-3b24-4e77-97d5-0750ef20a850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:10 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-453bfc35-a73f-4bfb-8d90-6e7bf7843137 tempest-ProjectMemberTests-232601277 None] Volume volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb (342e9f36-0976-4af0-ae43-3bc66b5e82eb): created successfully Jul 07 17:43:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-453bfc35-a73f-4bfb-8d90-6e7bf7843137 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b27719f-3b24-4e77-97d5-0750ef20a850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:10 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-453bfc35-a73f-4bfb-8d90-6e7bf7843137 tempest-ProjectMemberTests-232601277 None] Flow 'volume_create_manager' (dfc535c7-fca3-4bbc-9985-5f909f390f30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:10 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-453bfc35-a73f-4bfb-8d90-6e7bf7843137 tempest-ProjectMemberTests-232601277 None] Created volume successfully. Jul 07 17:43:10 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-758a1018-0fc5-44be-8274-c438d865ce0a tempest-ProjectReaderTests-1784466903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bc2fd750-a256-4719-bf90-04f8787aeeaf" returned: 0 in 0.739s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-758a1018-0fc5-44be-8274-c438d865ce0a tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bc2fd750-a256-4719-bf90-04f8787aeeaf.77c8f458-bd46-4b8d-b2b3-96a2de548aeb {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:10 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bc2fd750-a256-4719-bf90-04f8787aeeaf.77c8f458-bd46-4b8d-b2b3-96a2de548aeb Jul 07 17:43:10 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1fd5c768-e045-4231-9225-5853a6444c91 tempest-ProjectMemberTests-232601277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1fd5c768-e045-4231-9225-5853a6444c91 tempest-ProjectMemberTests-232601277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:10 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-1fd5c768-e045-4231-9225-5853a6444c91 tempest-ProjectMemberTests-232601277 None] Creating offline snapshot 2379044e-9145-4c28-9d11-c78cebecdd06 of volume 342e9f36-0976-4af0-ae43-3bc66b5e82eb {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:43:10 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3882d8f-049b-4cdd-a964-0df6cfee837d]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1fd5c768-e045-4231-9225-5853a6444c91 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:10 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb Jul 07 17:43:10 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:11 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-758a1018-0fc5-44be-8274-c438d865ce0a tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bc2fd750-a256-4719-bf90-04f8787aeeaf.77c8f458-bd46-4b8d-b2b3-96a2de548aeb" returned: 0 in 0.782s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-758a1018-0fc5-44be-8274-c438d865ce0a tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bc2fd750-a256-4719-bf90-04f8787aeeaf.77c8f458-bd46-4b8d-b2b3-96a2de548aeb {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:11 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bc2fd750-a256-4719-bf90-04f8787aeeaf.77c8f458-bd46-4b8d-b2b3-96a2de548aeb Jul 07 17:43:11 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:11 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1fd5c768-e045-4231-9225-5853a6444c91 tempest-ProjectMemberTests-232601277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb" returned: 0 in 0.834s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1fd5c768-e045-4231-9225-5853a6444c91 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb.2379044e-9145-4c28-9d11-c78cebecdd06 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:11 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb.2379044e-9145-4c28-9d11-c78cebecdd06 1G Jul 07 17:43:11 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:11 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-758a1018-0fc5-44be-8274-c438d865ce0a tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bc2fd750-a256-4719-bf90-04f8787aeeaf.77c8f458-bd46-4b8d-b2b3-96a2de548aeb" returned: 0 in 0.671s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:11 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-758a1018-0fc5-44be-8274-c438d865ce0a tempest-ProjectReaderTests-1784466903 None] Lock "cinder-quobyte-77c8f458-bd46-4b8d-b2b3-96a2de548aeb" released by "_delete_snapshot" :: held 3.123s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:11 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-758a1018-0fc5-44be-8274-c438d865ce0a tempest-ProjectReaderTests-1784466903 None] Lock "cinder-quobyte-bc2fd750-a256-4719-bf90-04f8787aeeaf" released by "delete_snapshot" :: held 3.145s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:11 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-758a1018-0fc5-44be-8274-c438d865ce0a tempest-ProjectReaderTests-1784466903 None] Created reservations ['e787a847-f8de-400a-9e5b-961ee203b2ab', 'e4348e79-2528-4307-8f5e-b3bd3286f9a3', '5b1c0c8f-06ea-439c-af7f-8ba92bb8cc6c', 'ad186620-5450-487f-89ad-f3ff1eca7541'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:43:12 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-758a1018-0fc5-44be-8274-c438d865ce0a tempest-ProjectReaderTests-1784466903 None] Delete snapshot completed successfully. Jul 07 17:43:12 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-758a1018-0fc5-44be-8274-c438d865ce0a tempest-ProjectReaderTests-1784466903 None] Lock "cinder-77c8f458-bd46-4b8d-b2b3-96a2de548aeb-delete_snapshot" released by "delete_snapshot" :: held 3.287s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:12 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1fd5c768-e045-4231-9225-5853a6444c91 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb.2379044e-9145-4c28-9d11-c78cebecdd06 1G" returned: 0 in 0.795s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1fd5c768-e045-4231-9225-5853a6444c91 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb.2379044e-9145-4c28-9d11-c78cebecdd06 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:12 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb.2379044e-9145-4c28-9d11-c78cebecdd06 Jul 07 17:43:12 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:12 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-b9cd1859-ca06-41ab-98e6-9428925eda94 tempest-ProjectReaderTests-1784466903 None] Acquiring lock "cinder-bc2fd750-a256-4719-bf90-04f8787aeeaf-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:12 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-b9cd1859-ca06-41ab-98e6-9428925eda94 tempest-ProjectReaderTests-1784466903 None] Lock "cinder-bc2fd750-a256-4719-bf90-04f8787aeeaf-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:13 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-b9cd1859-ca06-41ab-98e6-9428925eda94 tempest-ProjectReaderTests-1784466903 None] Acquiring lock "cinder-quobyte-bc2fd750-a256-4719-bf90-04f8787aeeaf" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:13 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-b9cd1859-ca06-41ab-98e6-9428925eda94 tempest-ProjectReaderTests-1784466903 None] Lock "cinder-quobyte-bc2fd750-a256-4719-bf90-04f8787aeeaf" acquired by "delete_volume" :: waited 0.019s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:13 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[341a1a55-ab2c-4df5-9ff3-0b1b2c3039e0]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b9cd1859-ca06-41ab-98e6-9428925eda94 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bc2fd750-a256-4719-bf90-04f8787aeeaf {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:13 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bc2fd750-a256-4719-bf90-04f8787aeeaf Jul 07 17:43:13 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:13 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1fd5c768-e045-4231-9225-5853a6444c91 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb.2379044e-9145-4c28-9d11-c78cebecdd06" returned: 0 in 0.740s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:13 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-1fd5c768-e045-4231-9225-5853a6444c91 tempest-ProjectMemberTests-232601277 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb.2379044e-9145-4c28-9d11-c78cebecdd06 is being set with open permissions: ugo+rw Jul 07 17:43:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1fd5c768-e045-4231-9225-5853a6444c91 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb.2379044e-9145-4c28-9d11-c78cebecdd06 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:13 devstack sudo[106757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb.2379044e-9145-4c28-9d11-c78cebecdd06 Jul 07 17:43:13 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:13 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b9cd1859-ca06-41ab-98e6-9428925eda94 tempest-ProjectReaderTests-1784466903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bc2fd750-a256-4719-bf90-04f8787aeeaf" returned: 0 in 0.785s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b9cd1859-ca06-41ab-98e6-9428925eda94 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bc2fd750-a256-4719-bf90-04f8787aeeaf {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:13 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bc2fd750-a256-4719-bf90-04f8787aeeaf Jul 07 17:43:13 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:13 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1fd5c768-e045-4231-9225-5853a6444c91 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb.2379044e-9145-4c28-9d11-c78cebecdd06" returned: 0 in 0.691s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1fd5c768-e045-4231-9225-5853a6444c91 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:13 devstack sudo[106765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb.info Jul 07 17:43:13 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:14 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b9cd1859-ca06-41ab-98e6-9428925eda94 tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-bc2fd750-a256-4719-bf90-04f8787aeeaf" returned: 0 in 0.631s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:14 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-b9cd1859-ca06-41ab-98e6-9428925eda94 tempest-ProjectReaderTests-1784466903 None] Lock "cinder-quobyte-bc2fd750-a256-4719-bf90-04f8787aeeaf" released by "delete_volume" :: held 1.488s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:14 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-b9cd1859-ca06-41ab-98e6-9428925eda94 tempest-ProjectReaderTests-1784466903 None] Created reservations ['26afa50e-071b-4ae7-99ec-63aaeb833d27', '072a3de4-814f-46cd-8c40-a41c54dfb4a6', '9fd69dd1-d74c-4b51-b516-d20f608694f5', '4a3ac6b9-4233-4651-9011-5fd79084f70f'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:43:14 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1fd5c768-e045-4231-9225-5853a6444c91 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb.info" returned: 0 in 0.665s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:14 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-1fd5c768-e045-4231-9225-5853a6444c91 tempest-ProjectMemberTests-232601277 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb.info is being set with open permissions: ugo+rw Jul 07 17:43:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1fd5c768-e045-4231-9225-5853a6444c91 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:14 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb.info Jul 07 17:43:14 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b9cd1859-ca06-41ab-98e6-9428925eda94 tempest-ProjectReaderTests-1784466903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b9cd1859-ca06-41ab-98e6-9428925eda94 tempest-ProjectReaderTests-1784466903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:14 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b9cd1859-ca06-41ab-98e6-9428925eda94 tempest-ProjectReaderTests-1784466903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:14 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-b9cd1859-ca06-41ab-98e6-9428925eda94 tempest-ProjectReaderTests-1784466903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b9cd1859-ca06-41ab-98e6-9428925eda94 tempest-ProjectReaderTests-1784466903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b9cd1859-ca06-41ab-98e6-9428925eda94 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:14 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:43:14 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:15 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1fd5c768-e045-4231-9225-5853a6444c91 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb.info" returned: 0 in 0.633s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1fd5c768-e045-4231-9225-5853a6444c91 tempest-ProjectMemberTests-232601277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.450s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:15 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-1fd5c768-e045-4231-9225-5853a6444c91 tempest-ProjectMemberTests-232601277 None] Create snapshot completed successfully Jul 07 17:43:15 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b9cd1859-ca06-41ab-98e6-9428925eda94 tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.668s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:15 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-b9cd1859-ca06-41ab-98e6-9428925eda94 tempest-ProjectReaderTests-1784466903 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:43:15 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-b9cd1859-ca06-41ab-98e6-9428925eda94 tempest-ProjectReaderTests-1784466903 None] Deleted volume successfully. Jul 07 17:43:15 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-b9cd1859-ca06-41ab-98e6-9428925eda94 tempest-ProjectReaderTests-1784466903 None] Lock "cinder-bc2fd750-a256-4719-bf90-04f8787aeeaf-delete_volume" released by "delete_volume" :: held 2.389s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:15 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fcfef2c-660c-4497-bfd1-25b542658544 tempest-ProjectReaderTests-1784466903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:43:15 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-3fcfef2c-660c-4497-bfd1-25b542658544 tempest-ProjectReaderTests-1784466903 None] Flow 'volume_create_manager' (7bfdcef8-6f86-4fbd-a7c4-2183718e472c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:15 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-3fcfef2c-660c-4497-bfd1-25b542658544 tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61875d68-15ed-4e6b-8190-b9310dc7d53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:15 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-3fcfef2c-660c-4497-bfd1-25b542658544 tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61875d68-15ed-4e6b-8190-b9310dc7d53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1026608016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4320327f-1774-42b0-a768-6b05e5cf8142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f7af8480fe431192778df1c311e074',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:16Z,use_quota=True,user_id='98144cb6a2c64593a39ce3220c506359',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:15 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-3fcfef2c-660c-4497-bfd1-25b542658544 tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c098460-2054-42c6-aea7-beb33e7c7168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:15 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-3fcfef2c-660c-4497-bfd1-25b542658544 tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c098460-2054-42c6-aea7-beb33e7c7168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:15 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-3fcfef2c-660c-4497-bfd1-25b542658544 tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (527ff985-3224-4e81-a8ba-5ec4e9ef9cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:15 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-3fcfef2c-660c-4497-bfd1-25b542658544 tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (527ff985-3224-4e81-a8ba-5ec4e9ef9cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4320327f-1774-42b0-a768-6b05e5cf8142', 'volume_name': 'volume-4320327f-1774-42b0-a768-6b05e5cf8142', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:15 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-3fcfef2c-660c-4497-bfd1-25b542658544 tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81c3045a-80f4-42dd-acb7-781802666ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:15 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-3fcfef2c-660c-4497-bfd1-25b542658544 tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81c3045a-80f4-42dd-acb7-781802666ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:15 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-3fcfef2c-660c-4497-bfd1-25b542658544 tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57c28075-0fe9-433c-89f5-4074784e3976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:15 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-3fcfef2c-660c-4497-bfd1-25b542658544 tempest-ProjectReaderTests-1784466903 None] Volume 4320327f-1774-42b0-a768-6b05e5cf8142: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4320327f-1774-42b0-a768-6b05e5cf8142', 'volume_size': 1} Jul 07 17:43:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-3fcfef2c-660c-4497-bfd1-25b542658544 tempest-ProjectReaderTests-1784466903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-3fcfef2c-660c-4497-bfd1-25b542658544 tempest-ProjectReaderTests-1784466903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:15 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-3fcfef2c-660c-4497-bfd1-25b542658544 tempest-ProjectReaderTests-1784466903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1026608016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4320327f-1774-42b0-a768-6b05e5cf8142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f7af8480fe431192778df1c311e074',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:16Z,use_quota=True,user_id='98144cb6a2c64593a39ce3220c506359',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:43:15 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-3fcfef2c-660c-4497-bfd1-25b542658544 tempest-ProjectReaderTests-1784466903 None] Creating volume 4320327f-1774-42b0-a768-6b05e5cf8142 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:43:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-3fcfef2c-660c-4497-bfd1-25b542658544 tempest-ProjectReaderTests-1784466903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-3fcfef2c-660c-4497-bfd1-25b542658544 tempest-ProjectReaderTests-1784466903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:15 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-3fcfef2c-660c-4497-bfd1-25b542658544 tempest-ProjectReaderTests-1784466903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:15 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-3fcfef2c-660c-4497-bfd1-25b542658544 tempest-ProjectReaderTests-1784466903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-3fcfef2c-660c-4497-bfd1-25b542658544 tempest-ProjectReaderTests-1784466903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:15 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-3fcfef2c-660c-4497-bfd1-25b542658544 tempest-ProjectReaderTests-1784466903 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:43:15 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-3fcfef2c-660c-4497-bfd1-25b542658544 tempest-ProjectReaderTests-1784466903 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:43:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3fcfef2c-660c-4497-bfd1-25b542658544 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4320327f-1774-42b0-a768-6b05e5cf8142 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:15 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4320327f-1774-42b0-a768-6b05e5cf8142 1073741824 Jul 07 17:43:15 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:16 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0cd7109e-7335-43a4-bea5-d1a501d0beee tempest-ProjectMemberTests-232601277 None] Acquiring lock "cinder-2379044e-9145-4c28-9d11-c78cebecdd06-delete_snapshot" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:16 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0cd7109e-7335-43a4-bea5-d1a501d0beee tempest-ProjectMemberTests-232601277 None] Lock "cinder-2379044e-9145-4c28-9d11-c78cebecdd06-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:16 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0cd7109e-7335-43a4-bea5-d1a501d0beee tempest-ProjectMemberTests-232601277 None] Acquiring lock "cinder-quobyte-342e9f36-0976-4af0-ae43-3bc66b5e82eb" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:16 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0cd7109e-7335-43a4-bea5-d1a501d0beee tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-342e9f36-0976-4af0-ae43-3bc66b5e82eb" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:16 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0cd7109e-7335-43a4-bea5-d1a501d0beee tempest-ProjectMemberTests-232601277 None] Acquiring lock "cinder-quobyte-2379044e-9145-4c28-9d11-c78cebecdd06" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:16 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0cd7109e-7335-43a4-bea5-d1a501d0beee tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-2379044e-9145-4c28-9d11-c78cebecdd06" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:16 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-0cd7109e-7335-43a4-bea5-d1a501d0beee tempest-ProjectMemberTests-232601277 None] Deleting offline snapshot 2379044e-9145-4c28-9d11-c78cebecdd06 of volume 342e9f36-0976-4af0-ae43-3bc66b5e82eb {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:43:16 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-0cd7109e-7335-43a4-bea5-d1a501d0beee tempest-ProjectMemberTests-232601277 None] snapshot_file for this snap is: volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb.2379044e-9145-4c28-9d11-c78cebecdd06 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:43:16 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb5fc96-31c2-4332-bbd7-1f8afa4abe07]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0cd7109e-7335-43a4-bea5-d1a501d0beee tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb.2379044e-9145-4c28-9d11-c78cebecdd06 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:16 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb.2379044e-9145-4c28-9d11-c78cebecdd06 Jul 07 17:43:16 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:16 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3fcfef2c-660c-4497-bfd1-25b542658544 tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4320327f-1774-42b0-a768-6b05e5cf8142 1073741824" returned: 0 in 0.797s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3fcfef2c-660c-4497-bfd1-25b542658544 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4320327f-1774-42b0-a768-6b05e5cf8142 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:16 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4320327f-1774-42b0-a768-6b05e5cf8142 Jul 07 17:43:16 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:16 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0cd7109e-7335-43a4-bea5-d1a501d0beee tempest-ProjectMemberTests-232601277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb.2379044e-9145-4c28-9d11-c78cebecdd06" returned: 0 in 0.814s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:16 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-0cd7109e-7335-43a4-bea5-d1a501d0beee tempest-ProjectMemberTests-232601277 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:43:16 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89e9844-c43c-4228-8985-3e360480e90e]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0cd7109e-7335-43a4-bea5-d1a501d0beee tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:17 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb Jul 07 17:43:17 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:17 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3fcfef2c-660c-4497-bfd1-25b542658544 tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4320327f-1774-42b0-a768-6b05e5cf8142" returned: 0 in 0.683s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:17 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-3fcfef2c-660c-4497-bfd1-25b542658544 tempest-ProjectReaderTests-1784466903 None] <== create_volume: return (1519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:43:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-3fcfef2c-660c-4497-bfd1-25b542658544 tempest-ProjectReaderTests-1784466903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:17 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-3fcfef2c-660c-4497-bfd1-25b542658544 tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57c28075-0fe9-433c-89f5-4074784e3976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4320327f-1774-42b0-a768-6b05e5cf8142', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:17 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-3fcfef2c-660c-4497-bfd1-25b542658544 tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ca24964-bd7b-4565-8010-e94f45802280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:17 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-3fcfef2c-660c-4497-bfd1-25b542658544 tempest-ProjectReaderTests-1784466903 None] Volume volume-4320327f-1774-42b0-a768-6b05e5cf8142 (4320327f-1774-42b0-a768-6b05e5cf8142): created successfully Jul 07 17:43:17 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-3fcfef2c-660c-4497-bfd1-25b542658544 tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ca24964-bd7b-4565-8010-e94f45802280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:17 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-3fcfef2c-660c-4497-bfd1-25b542658544 tempest-ProjectReaderTests-1784466903 None] Flow 'volume_create_manager' (7bfdcef8-6f86-4fbd-a7c4-2183718e472c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:17 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-3fcfef2c-660c-4497-bfd1-25b542658544 tempest-ProjectReaderTests-1784466903 None] Created volume successfully. Jul 07 17:43:17 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0cd7109e-7335-43a4-bea5-d1a501d0beee tempest-ProjectMemberTests-232601277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb" returned: 0 in 0.753s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0cd7109e-7335-43a4-bea5-d1a501d0beee tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb.2379044e-9145-4c28-9d11-c78cebecdd06 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:17 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb.2379044e-9145-4c28-9d11-c78cebecdd06 Jul 07 17:43:17 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b7ad8ccf-3e49-4d4e-be97-cd3ed0871506 tempest-ProjectReaderTests-1784466903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b7ad8ccf-3e49-4d4e-be97-cd3ed0871506 tempest-ProjectReaderTests-1784466903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:17 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-b7ad8ccf-3e49-4d4e-be97-cd3ed0871506 tempest-ProjectReaderTests-1784466903 None] Creating offline snapshot 51ffbf77-f3fc-4047-b691-fd19598f7c58 of volume 4320327f-1774-42b0-a768-6b05e5cf8142 {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:43:17 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca245ded-4a34-47c0-90ca-45205cfd31b0]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b7ad8ccf-3e49-4d4e-be97-cd3ed0871506 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4320327f-1774-42b0-a768-6b05e5cf8142 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:18 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4320327f-1774-42b0-a768-6b05e5cf8142 Jul 07 17:43:18 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:18 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0cd7109e-7335-43a4-bea5-d1a501d0beee tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb.2379044e-9145-4c28-9d11-c78cebecdd06" returned: 0 in 0.764s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0cd7109e-7335-43a4-bea5-d1a501d0beee tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb.2379044e-9145-4c28-9d11-c78cebecdd06 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:18 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb.2379044e-9145-4c28-9d11-c78cebecdd06 Jul 07 17:43:18 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:18 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b7ad8ccf-3e49-4d4e-be97-cd3ed0871506 tempest-ProjectReaderTests-1784466903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4320327f-1774-42b0-a768-6b05e5cf8142" returned: 0 in 0.793s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b7ad8ccf-3e49-4d4e-be97-cd3ed0871506 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4320327f-1774-42b0-a768-6b05e5cf8142,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4320327f-1774-42b0-a768-6b05e5cf8142.51ffbf77-f3fc-4047-b691-fd19598f7c58 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:18 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4320327f-1774-42b0-a768-6b05e5cf8142,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4320327f-1774-42b0-a768-6b05e5cf8142.51ffbf77-f3fc-4047-b691-fd19598f7c58 1G Jul 07 17:43:18 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:19 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0cd7109e-7335-43a4-bea5-d1a501d0beee tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb.2379044e-9145-4c28-9d11-c78cebecdd06" returned: 0 in 0.657s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:19 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0cd7109e-7335-43a4-bea5-d1a501d0beee tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-2379044e-9145-4c28-9d11-c78cebecdd06" released by "_delete_snapshot" :: held 3.113s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:19 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0cd7109e-7335-43a4-bea5-d1a501d0beee tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-342e9f36-0976-4af0-ae43-3bc66b5e82eb" released by "delete_snapshot" :: held 3.141s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:19 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-0cd7109e-7335-43a4-bea5-d1a501d0beee tempest-ProjectMemberTests-232601277 None] Created reservations ['eefdb0df-b0a2-44a6-bd77-f64278ccb6e4', 'd1ee8c5d-b2bd-4324-8864-7a9db2157f7c', '596ace07-4d74-4856-a519-ac7d361a6fef', '53744fe3-6c1a-4f20-bf24-70420aaec6f5'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:43:19 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-0cd7109e-7335-43a4-bea5-d1a501d0beee tempest-ProjectMemberTests-232601277 None] Delete snapshot completed successfully. Jul 07 17:43:19 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-0cd7109e-7335-43a4-bea5-d1a501d0beee tempest-ProjectMemberTests-232601277 None] Lock "cinder-2379044e-9145-4c28-9d11-c78cebecdd06-delete_snapshot" released by "delete_snapshot" :: held 3.285s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:19 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b7ad8ccf-3e49-4d4e-be97-cd3ed0871506 tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4320327f-1774-42b0-a768-6b05e5cf8142,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4320327f-1774-42b0-a768-6b05e5cf8142.51ffbf77-f3fc-4047-b691-fd19598f7c58 1G" returned: 0 in 0.826s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b7ad8ccf-3e49-4d4e-be97-cd3ed0871506 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4320327f-1774-42b0-a768-6b05e5cf8142 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4320327f-1774-42b0-a768-6b05e5cf8142.51ffbf77-f3fc-4047-b691-fd19598f7c58 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:19 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4320327f-1774-42b0-a768-6b05e5cf8142 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4320327f-1774-42b0-a768-6b05e5cf8142.51ffbf77-f3fc-4047-b691-fd19598f7c58 Jul 07 17:43:19 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:20 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b7ad8ccf-3e49-4d4e-be97-cd3ed0871506 tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4320327f-1774-42b0-a768-6b05e5cf8142 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4320327f-1774-42b0-a768-6b05e5cf8142.51ffbf77-f3fc-4047-b691-fd19598f7c58" returned: 0 in 0.651s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:20 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-b7ad8ccf-3e49-4d4e-be97-cd3ed0871506 tempest-ProjectReaderTests-1784466903 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4320327f-1774-42b0-a768-6b05e5cf8142.51ffbf77-f3fc-4047-b691-fd19598f7c58 is being set with open permissions: ugo+rw Jul 07 17:43:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b7ad8ccf-3e49-4d4e-be97-cd3ed0871506 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4320327f-1774-42b0-a768-6b05e5cf8142.51ffbf77-f3fc-4047-b691-fd19598f7c58 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:20 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4320327f-1774-42b0-a768-6b05e5cf8142.51ffbf77-f3fc-4047-b691-fd19598f7c58 Jul 07 17:43:20 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:20 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5de9da0c-9cd7-4146-b119-185c0e45faa8 tempest-ProjectMemberTests-232601277 None] Acquiring lock "cinder-342e9f36-0976-4af0-ae43-3bc66b5e82eb-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:20 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5de9da0c-9cd7-4146-b119-185c0e45faa8 tempest-ProjectMemberTests-232601277 None] Lock "cinder-342e9f36-0976-4af0-ae43-3bc66b5e82eb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:20 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5de9da0c-9cd7-4146-b119-185c0e45faa8 tempest-ProjectMemberTests-232601277 None] Acquiring lock "cinder-quobyte-342e9f36-0976-4af0-ae43-3bc66b5e82eb" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:20 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5de9da0c-9cd7-4146-b119-185c0e45faa8 tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-342e9f36-0976-4af0-ae43-3bc66b5e82eb" acquired by "delete_volume" :: waited 0.016s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:20 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e009c3b3-ffc2-478d-a5ea-d5e6e40fca97]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5de9da0c-9cd7-4146-b119-185c0e45faa8 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:20 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb Jul 07 17:43:20 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:20 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b7ad8ccf-3e49-4d4e-be97-cd3ed0871506 tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4320327f-1774-42b0-a768-6b05e5cf8142.51ffbf77-f3fc-4047-b691-fd19598f7c58" returned: 0 in 0.647s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b7ad8ccf-3e49-4d4e-be97-cd3ed0871506 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4320327f-1774-42b0-a768-6b05e5cf8142.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:20 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4320327f-1774-42b0-a768-6b05e5cf8142.info Jul 07 17:43:20 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:21 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5de9da0c-9cd7-4146-b119-185c0e45faa8 tempest-ProjectMemberTests-232601277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb" returned: 0 in 0.748s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5de9da0c-9cd7-4146-b119-185c0e45faa8 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:21 devstack sudo[106829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb Jul 07 17:43:21 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:21 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b7ad8ccf-3e49-4d4e-be97-cd3ed0871506 tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4320327f-1774-42b0-a768-6b05e5cf8142.info" returned: 0 in 0.666s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:21 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-b7ad8ccf-3e49-4d4e-be97-cd3ed0871506 tempest-ProjectReaderTests-1784466903 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4320327f-1774-42b0-a768-6b05e5cf8142.info is being set with open permissions: ugo+rw Jul 07 17:43:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b7ad8ccf-3e49-4d4e-be97-cd3ed0871506 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4320327f-1774-42b0-a768-6b05e5cf8142.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:21 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4320327f-1774-42b0-a768-6b05e5cf8142.info Jul 07 17:43:21 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:21 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5de9da0c-9cd7-4146-b119-185c0e45faa8 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-342e9f36-0976-4af0-ae43-3bc66b5e82eb" returned: 0 in 0.680s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:21 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5de9da0c-9cd7-4146-b119-185c0e45faa8 tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-342e9f36-0976-4af0-ae43-3bc66b5e82eb" released by "delete_volume" :: held 1.490s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:21 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-5de9da0c-9cd7-4146-b119-185c0e45faa8 tempest-ProjectMemberTests-232601277 None] Created reservations ['f64b09ac-345b-450f-bd64-39088d819b7a', '776f93f7-014a-4fff-beda-0ccf835e7b34', '4f5e5646-b80b-4a70-b20a-ff781bbb44bc', '0e4a881c-2d32-4ca8-8538-a5baaec1b9d0'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:43:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-5de9da0c-9cd7-4146-b119-185c0e45faa8 tempest-ProjectMemberTests-232601277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-5de9da0c-9cd7-4146-b119-185c0e45faa8 tempest-ProjectMemberTests-232601277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:22 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-5de9da0c-9cd7-4146-b119-185c0e45faa8 tempest-ProjectMemberTests-232601277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:22 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-5de9da0c-9cd7-4146-b119-185c0e45faa8 tempest-ProjectMemberTests-232601277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-5de9da0c-9cd7-4146-b119-185c0e45faa8 tempest-ProjectMemberTests-232601277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5de9da0c-9cd7-4146-b119-185c0e45faa8 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:22 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:43:22 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:22 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b7ad8ccf-3e49-4d4e-be97-cd3ed0871506 tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4320327f-1774-42b0-a768-6b05e5cf8142.info" returned: 0 in 0.648s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-b7ad8ccf-3e49-4d4e-be97-cd3ed0871506 tempest-ProjectReaderTests-1784466903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.316s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:22 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-b7ad8ccf-3e49-4d4e-be97-cd3ed0871506 tempest-ProjectReaderTests-1784466903 None] Create snapshot completed successfully Jul 07 17:43:22 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-5de9da0c-9cd7-4146-b119-185c0e45faa8 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.683s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:22 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-5de9da0c-9cd7-4146-b119-185c0e45faa8 tempest-ProjectMemberTests-232601277 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:43:22 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-5de9da0c-9cd7-4146-b119-185c0e45faa8 tempest-ProjectMemberTests-232601277 None] Deleted volume successfully. Jul 07 17:43:22 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-5de9da0c-9cd7-4146-b119-185c0e45faa8 tempest-ProjectMemberTests-232601277 None] Lock "cinder-342e9f36-0976-4af0-ae43-3bc66b5e82eb-delete_volume" released by "delete_volume" :: held 2.431s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:22 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-828d0503-f000-4e73-afd5-44dc58760965 tempest-ProjectMemberTests-232601277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:43:23 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-828d0503-f000-4e73-afd5-44dc58760965 tempest-ProjectMemberTests-232601277 None] Flow 'volume_create_manager' (62cf6c2b-8ead-479b-8aeb-9c020624f5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:23 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-828d0503-f000-4e73-afd5-44dc58760965 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcffc6ae-9abf-491d-8ac9-a34083a19931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:23 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-828d0503-f000-4e73-afd5-44dc58760965 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcffc6ae-9abf-491d-8ac9-a34083a19931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1565214381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0764de4-d04b-46cc-8fb2-c4a36ead0330,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='126630bddcf5433fb704f04aac171bde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:23Z,use_quota=True,user_id='f03110d4128243fca6ab7f6b4b51123a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:23 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-828d0503-f000-4e73-afd5-44dc58760965 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc6ef51d-95d2-413f-9334-ae65324bbe58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:23 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-828d0503-f000-4e73-afd5-44dc58760965 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc6ef51d-95d2-413f-9334-ae65324bbe58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:23 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-828d0503-f000-4e73-afd5-44dc58760965 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a705447-d8da-4b89-be7c-87933ce02e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:23 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-828d0503-f000-4e73-afd5-44dc58760965 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a705447-d8da-4b89-be7c-87933ce02e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0764de4-d04b-46cc-8fb2-c4a36ead0330', 'volume_name': 'volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:23 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-828d0503-f000-4e73-afd5-44dc58760965 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd0f6cc6-fd3a-49fc-b0fb-dcddf256f033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:23 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-828d0503-f000-4e73-afd5-44dc58760965 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd0f6cc6-fd3a-49fc-b0fb-dcddf256f033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:23 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-828d0503-f000-4e73-afd5-44dc58760965 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2803c04b-f55b-4c12-843a-f4170a4a129e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:23 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-828d0503-f000-4e73-afd5-44dc58760965 tempest-ProjectMemberTests-232601277 None] Volume c0764de4-d04b-46cc-8fb2-c4a36ead0330: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330', 'volume_size': 1} Jul 07 17:43:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-828d0503-f000-4e73-afd5-44dc58760965 tempest-ProjectMemberTests-232601277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-828d0503-f000-4e73-afd5-44dc58760965 tempest-ProjectMemberTests-232601277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:23 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-828d0503-f000-4e73-afd5-44dc58760965 tempest-ProjectMemberTests-232601277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1565214381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0764de4-d04b-46cc-8fb2-c4a36ead0330,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='126630bddcf5433fb704f04aac171bde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:23Z,use_quota=True,user_id='f03110d4128243fca6ab7f6b4b51123a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:43:23 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-828d0503-f000-4e73-afd5-44dc58760965 tempest-ProjectMemberTests-232601277 None] Creating volume c0764de4-d04b-46cc-8fb2-c4a36ead0330 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:43:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-828d0503-f000-4e73-afd5-44dc58760965 tempest-ProjectMemberTests-232601277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-828d0503-f000-4e73-afd5-44dc58760965 tempest-ProjectMemberTests-232601277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:23 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-828d0503-f000-4e73-afd5-44dc58760965 tempest-ProjectMemberTests-232601277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:23 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-828d0503-f000-4e73-afd5-44dc58760965 tempest-ProjectMemberTests-232601277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-828d0503-f000-4e73-afd5-44dc58760965 tempest-ProjectMemberTests-232601277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:23 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-828d0503-f000-4e73-afd5-44dc58760965 tempest-ProjectMemberTests-232601277 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:43:23 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-828d0503-f000-4e73-afd5-44dc58760965 tempest-ProjectMemberTests-232601277 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:43:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-828d0503-f000-4e73-afd5-44dc58760965 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:23 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330 1073741824 Jul 07 17:43:23 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:23 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-923e8bdf-82a5-4e2d-87d6-be257b709e11 tempest-ProjectReaderTests-1784466903 None] Acquiring lock "cinder-51ffbf77-f3fc-4047-b691-fd19598f7c58-delete_snapshot" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:23 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-923e8bdf-82a5-4e2d-87d6-be257b709e11 tempest-ProjectReaderTests-1784466903 None] Lock "cinder-51ffbf77-f3fc-4047-b691-fd19598f7c58-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:23 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-923e8bdf-82a5-4e2d-87d6-be257b709e11 tempest-ProjectReaderTests-1784466903 None] Acquiring lock "cinder-quobyte-4320327f-1774-42b0-a768-6b05e5cf8142" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:23 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-923e8bdf-82a5-4e2d-87d6-be257b709e11 tempest-ProjectReaderTests-1784466903 None] Lock "cinder-quobyte-4320327f-1774-42b0-a768-6b05e5cf8142" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:23 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-923e8bdf-82a5-4e2d-87d6-be257b709e11 tempest-ProjectReaderTests-1784466903 None] Acquiring lock "cinder-quobyte-51ffbf77-f3fc-4047-b691-fd19598f7c58" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:23 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-923e8bdf-82a5-4e2d-87d6-be257b709e11 tempest-ProjectReaderTests-1784466903 None] Lock "cinder-quobyte-51ffbf77-f3fc-4047-b691-fd19598f7c58" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:23 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-923e8bdf-82a5-4e2d-87d6-be257b709e11 tempest-ProjectReaderTests-1784466903 None] Deleting offline snapshot 51ffbf77-f3fc-4047-b691-fd19598f7c58 of volume 4320327f-1774-42b0-a768-6b05e5cf8142 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:43:23 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-923e8bdf-82a5-4e2d-87d6-be257b709e11 tempest-ProjectReaderTests-1784466903 None] snapshot_file for this snap is: volume-4320327f-1774-42b0-a768-6b05e5cf8142.51ffbf77-f3fc-4047-b691-fd19598f7c58 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:43:23 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6416b4f6-1916-4b06-8fe1-6729ff693dad]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-923e8bdf-82a5-4e2d-87d6-be257b709e11 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4320327f-1774-42b0-a768-6b05e5cf8142.51ffbf77-f3fc-4047-b691-fd19598f7c58 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:23 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4320327f-1774-42b0-a768-6b05e5cf8142.51ffbf77-f3fc-4047-b691-fd19598f7c58 Jul 07 17:43:23 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:23 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-828d0503-f000-4e73-afd5-44dc58760965 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330 1073741824" returned: 0 in 0.862s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-828d0503-f000-4e73-afd5-44dc58760965 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:24 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330 Jul 07 17:43:24 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:24 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-923e8bdf-82a5-4e2d-87d6-be257b709e11 tempest-ProjectReaderTests-1784466903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4320327f-1774-42b0-a768-6b05e5cf8142.51ffbf77-f3fc-4047-b691-fd19598f7c58" returned: 0 in 0.832s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:24 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-923e8bdf-82a5-4e2d-87d6-be257b709e11 tempest-ProjectReaderTests-1784466903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4320327f-1774-42b0-a768-6b05e5cf8142(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:43:24 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0596e9-157e-41eb-bdbc-8b02f0f1ca03]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-923e8bdf-82a5-4e2d-87d6-be257b709e11 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4320327f-1774-42b0-a768-6b05e5cf8142 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:24 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4320327f-1774-42b0-a768-6b05e5cf8142 Jul 07 17:43:24 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:24 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-828d0503-f000-4e73-afd5-44dc58760965 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330" returned: 0 in 0.673s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:24 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-828d0503-f000-4e73-afd5-44dc58760965 tempest-ProjectMemberTests-232601277 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:43:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-828d0503-f000-4e73-afd5-44dc58760965 tempest-ProjectMemberTests-232601277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:24 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-828d0503-f000-4e73-afd5-44dc58760965 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2803c04b-f55b-4c12-843a-f4170a4a129e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:24 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-828d0503-f000-4e73-afd5-44dc58760965 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdc73607-0d83-4081-86ab-a30c376f9c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:24 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-828d0503-f000-4e73-afd5-44dc58760965 tempest-ProjectMemberTests-232601277 None] Volume volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330 (c0764de4-d04b-46cc-8fb2-c4a36ead0330): created successfully Jul 07 17:43:24 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-828d0503-f000-4e73-afd5-44dc58760965 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdc73607-0d83-4081-86ab-a30c376f9c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:24 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-828d0503-f000-4e73-afd5-44dc58760965 tempest-ProjectMemberTests-232601277 None] Flow 'volume_create_manager' (62cf6c2b-8ead-479b-8aeb-9c020624f5d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:24 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-828d0503-f000-4e73-afd5-44dc58760965 tempest-ProjectMemberTests-232601277 None] Created volume successfully. Jul 07 17:43:24 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-923e8bdf-82a5-4e2d-87d6-be257b709e11 tempest-ProjectReaderTests-1784466903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4320327f-1774-42b0-a768-6b05e5cf8142" returned: 0 in 0.756s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-923e8bdf-82a5-4e2d-87d6-be257b709e11 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4320327f-1774-42b0-a768-6b05e5cf8142.51ffbf77-f3fc-4047-b691-fd19598f7c58 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:24 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4320327f-1774-42b0-a768-6b05e5cf8142.51ffbf77-f3fc-4047-b691-fd19598f7c58 Jul 07 17:43:24 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4f498da5-ae61-4bcc-bf0c-4a352885f372 tempest-ProjectMemberTests-232601277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4f498da5-ae61-4bcc-bf0c-4a352885f372 tempest-ProjectMemberTests-232601277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:25 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-4f498da5-ae61-4bcc-bf0c-4a352885f372 tempest-ProjectMemberTests-232601277 None] Creating offline snapshot e6e08486-0c92-4aeb-aba2-a28e32d9b793 of volume c0764de4-d04b-46cc-8fb2-c4a36ead0330 {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:43:25 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f97e6c-03c5-4d33-a2d5-1c47af98af97]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4f498da5-ae61-4bcc-bf0c-4a352885f372 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:25 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330 Jul 07 17:43:25 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:25 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-923e8bdf-82a5-4e2d-87d6-be257b709e11 tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4320327f-1774-42b0-a768-6b05e5cf8142.51ffbf77-f3fc-4047-b691-fd19598f7c58" returned: 0 in 0.736s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-923e8bdf-82a5-4e2d-87d6-be257b709e11 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4320327f-1774-42b0-a768-6b05e5cf8142.51ffbf77-f3fc-4047-b691-fd19598f7c58 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:25 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4320327f-1774-42b0-a768-6b05e5cf8142.51ffbf77-f3fc-4047-b691-fd19598f7c58 Jul 07 17:43:25 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:26 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4f498da5-ae61-4bcc-bf0c-4a352885f372 tempest-ProjectMemberTests-232601277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330" returned: 0 in 0.756s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4f498da5-ae61-4bcc-bf0c-4a352885f372 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330.e6e08486-0c92-4aeb-aba2-a28e32d9b793 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:26 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330.e6e08486-0c92-4aeb-aba2-a28e32d9b793 1G Jul 07 17:43:26 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:26 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-923e8bdf-82a5-4e2d-87d6-be257b709e11 tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4320327f-1774-42b0-a768-6b05e5cf8142.51ffbf77-f3fc-4047-b691-fd19598f7c58" returned: 0 in 0.638s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:26 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-923e8bdf-82a5-4e2d-87d6-be257b709e11 tempest-ProjectReaderTests-1784466903 None] Lock "cinder-quobyte-51ffbf77-f3fc-4047-b691-fd19598f7c58" released by "_delete_snapshot" :: held 3.050s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:26 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-923e8bdf-82a5-4e2d-87d6-be257b709e11 tempest-ProjectReaderTests-1784466903 None] Lock "cinder-quobyte-4320327f-1774-42b0-a768-6b05e5cf8142" released by "delete_snapshot" :: held 3.074s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:26 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-923e8bdf-82a5-4e2d-87d6-be257b709e11 tempest-ProjectReaderTests-1784466903 None] Created reservations ['c987a05b-ad81-47ff-9319-57c2b87e33c7', '8133d37a-10d1-46c3-8877-7553f55686df', 'c7bc47f2-92d7-4061-a14d-29234da1ae3e', '28be70d2-c2b7-4d9c-8e32-a78344335065'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:43:26 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-923e8bdf-82a5-4e2d-87d6-be257b709e11 tempest-ProjectReaderTests-1784466903 None] Delete snapshot completed successfully. Jul 07 17:43:26 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-923e8bdf-82a5-4e2d-87d6-be257b709e11 tempest-ProjectReaderTests-1784466903 None] Lock "cinder-51ffbf77-f3fc-4047-b691-fd19598f7c58-delete_snapshot" released by "delete_snapshot" :: held 3.211s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:26 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4f498da5-ae61-4bcc-bf0c-4a352885f372 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330.e6e08486-0c92-4aeb-aba2-a28e32d9b793 1G" returned: 0 in 0.776s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4f498da5-ae61-4bcc-bf0c-4a352885f372 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330.e6e08486-0c92-4aeb-aba2-a28e32d9b793 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:26 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330.e6e08486-0c92-4aeb-aba2-a28e32d9b793 Jul 07 17:43:26 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:27 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-8b25846f-6b4f-4094-ac24-e5b11112404f tempest-ProjectReaderTests-1784466903 None] Acquiring lock "cinder-4320327f-1774-42b0-a768-6b05e5cf8142-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:27 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-8b25846f-6b4f-4094-ac24-e5b11112404f tempest-ProjectReaderTests-1784466903 None] Lock "cinder-4320327f-1774-42b0-a768-6b05e5cf8142-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:27 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-8b25846f-6b4f-4094-ac24-e5b11112404f tempest-ProjectReaderTests-1784466903 None] Acquiring lock "cinder-quobyte-4320327f-1774-42b0-a768-6b05e5cf8142" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:27 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-8b25846f-6b4f-4094-ac24-e5b11112404f tempest-ProjectReaderTests-1784466903 None] Lock "cinder-quobyte-4320327f-1774-42b0-a768-6b05e5cf8142" acquired by "delete_volume" :: waited 0.021s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:27 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4f498da5-ae61-4bcc-bf0c-4a352885f372 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330.e6e08486-0c92-4aeb-aba2-a28e32d9b793" returned: 0 in 0.764s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:27 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-4f498da5-ae61-4bcc-bf0c-4a352885f372 tempest-ProjectMemberTests-232601277 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330.e6e08486-0c92-4aeb-aba2-a28e32d9b793 is being set with open permissions: ugo+rw Jul 07 17:43:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4f498da5-ae61-4bcc-bf0c-4a352885f372 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330.e6e08486-0c92-4aeb-aba2-a28e32d9b793 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:27 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a9966f-84cf-4d5c-b35b-7cf99c84862b]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8b25846f-6b4f-4094-ac24-e5b11112404f tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4320327f-1774-42b0-a768-6b05e5cf8142 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:27 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330.e6e08486-0c92-4aeb-aba2-a28e32d9b793 Jul 07 17:43:27 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:27 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4320327f-1774-42b0-a768-6b05e5cf8142 Jul 07 17:43:27 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:28 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4f498da5-ae61-4bcc-bf0c-4a352885f372 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330.e6e08486-0c92-4aeb-aba2-a28e32d9b793" returned: 0 in 0.629s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4f498da5-ae61-4bcc-bf0c-4a352885f372 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:28 devstack sudo[106932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330.info Jul 07 17:43:28 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:28 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8b25846f-6b4f-4094-ac24-e5b11112404f tempest-ProjectReaderTests-1784466903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4320327f-1774-42b0-a768-6b05e5cf8142" returned: 0 in 0.771s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8b25846f-6b4f-4094-ac24-e5b11112404f tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4320327f-1774-42b0-a768-6b05e5cf8142 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:28 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4320327f-1774-42b0-a768-6b05e5cf8142 Jul 07 17:43:28 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:28 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4f498da5-ae61-4bcc-bf0c-4a352885f372 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330.info" returned: 0 in 0.671s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:28 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-4f498da5-ae61-4bcc-bf0c-4a352885f372 tempest-ProjectMemberTests-232601277 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330.info is being set with open permissions: ugo+rw Jul 07 17:43:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4f498da5-ae61-4bcc-bf0c-4a352885f372 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:28 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330.info Jul 07 17:43:28 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:29 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8b25846f-6b4f-4094-ac24-e5b11112404f tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-4320327f-1774-42b0-a768-6b05e5cf8142" returned: 0 in 0.638s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:29 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-8b25846f-6b4f-4094-ac24-e5b11112404f tempest-ProjectReaderTests-1784466903 None] Lock "cinder-quobyte-4320327f-1774-42b0-a768-6b05e5cf8142" released by "delete_volume" :: held 1.485s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:29 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-8b25846f-6b4f-4094-ac24-e5b11112404f tempest-ProjectReaderTests-1784466903 None] Created reservations ['82f02289-af0b-4bfc-a0f7-a3a762784746', '00470792-8dc7-4421-a5fd-1fc3285b4b51', 'cad2293c-f9fd-499e-8de9-615aa6350bf1', '6043627e-1297-413d-8848-6c4c517d867e'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:43:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-8b25846f-6b4f-4094-ac24-e5b11112404f tempest-ProjectReaderTests-1784466903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-8b25846f-6b4f-4094-ac24-e5b11112404f tempest-ProjectReaderTests-1784466903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:29 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-8b25846f-6b4f-4094-ac24-e5b11112404f tempest-ProjectReaderTests-1784466903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:29 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-8b25846f-6b4f-4094-ac24-e5b11112404f tempest-ProjectReaderTests-1784466903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-8b25846f-6b4f-4094-ac24-e5b11112404f tempest-ProjectReaderTests-1784466903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8b25846f-6b4f-4094-ac24-e5b11112404f tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:29 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:43:29 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:29 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-4f498da5-ae61-4bcc-bf0c-4a352885f372 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330.info" returned: 0 in 0.673s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-4f498da5-ae61-4bcc-bf0c-4a352885f372 tempest-ProjectMemberTests-232601277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.366s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:29 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-4f498da5-ae61-4bcc-bf0c-4a352885f372 tempest-ProjectMemberTests-232601277 None] Create snapshot completed successfully Jul 07 17:43:29 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8b25846f-6b4f-4094-ac24-e5b11112404f tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.666s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:29 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-8b25846f-6b4f-4094-ac24-e5b11112404f tempest-ProjectReaderTests-1784466903 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:43:29 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-8b25846f-6b4f-4094-ac24-e5b11112404f tempest-ProjectReaderTests-1784466903 None] Deleted volume successfully. Jul 07 17:43:29 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-8b25846f-6b4f-4094-ac24-e5b11112404f tempest-ProjectReaderTests-1784466903 None] Lock "cinder-4320327f-1774-42b0-a768-6b05e5cf8142-delete_volume" released by "delete_volume" :: held 2.363s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:30 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3da83c4-bdeb-42cc-8391-e68e5a6e0785 tempest-ProjectReaderTests-1784466903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:43:30 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d3da83c4-bdeb-42cc-8391-e68e5a6e0785 tempest-ProjectReaderTests-1784466903 None] Flow 'volume_create_manager' (a4f36ae5-77dc-4c1f-8a02-bfcfeeb33282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:30 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d3da83c4-bdeb-42cc-8391-e68e5a6e0785 tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (910fd2e9-4de2-4127-b393-930454b52a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:30 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d3da83c4-bdeb-42cc-8391-e68e5a6e0785 tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (910fd2e9-4de2-4127-b393-930454b52a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1093243473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d6fcb88-32bb-4138-be68-44c7d05fb5d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f7af8480fe431192778df1c311e074',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:30Z,use_quota=True,user_id='98144cb6a2c64593a39ce3220c506359',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:30 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d3da83c4-bdeb-42cc-8391-e68e5a6e0785 tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b55ba0c0-54bf-4658-ba2d-d14e24f89460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:30 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d3da83c4-bdeb-42cc-8391-e68e5a6e0785 tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b55ba0c0-54bf-4658-ba2d-d14e24f89460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:30 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d3da83c4-bdeb-42cc-8391-e68e5a6e0785 tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c5fb4ff-7023-4f61-a821-b796ad2af040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:30 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d3da83c4-bdeb-42cc-8391-e68e5a6e0785 tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c5fb4ff-7023-4f61-a821-b796ad2af040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d6fcb88-32bb-4138-be68-44c7d05fb5d5', 'volume_name': 'volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:30 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d3da83c4-bdeb-42cc-8391-e68e5a6e0785 tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f744b9fe-e1fa-437d-a87a-99a175c1c504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:30 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d3da83c4-bdeb-42cc-8391-e68e5a6e0785 tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f744b9fe-e1fa-437d-a87a-99a175c1c504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:30 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d3da83c4-bdeb-42cc-8391-e68e5a6e0785 tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f87b54b9-0131-4a46-8c60-12a4a0784eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:30 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-d3da83c4-bdeb-42cc-8391-e68e5a6e0785 tempest-ProjectReaderTests-1784466903 None] Volume 0d6fcb88-32bb-4138-be68-44c7d05fb5d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5', 'volume_size': 1} Jul 07 17:43:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d3da83c4-bdeb-42cc-8391-e68e5a6e0785 tempest-ProjectReaderTests-1784466903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d3da83c4-bdeb-42cc-8391-e68e5a6e0785 tempest-ProjectReaderTests-1784466903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:30 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d3da83c4-bdeb-42cc-8391-e68e5a6e0785 tempest-ProjectReaderTests-1784466903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1093243473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d6fcb88-32bb-4138-be68-44c7d05fb5d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f7af8480fe431192778df1c311e074',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:30Z,use_quota=True,user_id='98144cb6a2c64593a39ce3220c506359',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:43:30 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-d3da83c4-bdeb-42cc-8391-e68e5a6e0785 tempest-ProjectReaderTests-1784466903 None] Creating volume 0d6fcb88-32bb-4138-be68-44c7d05fb5d5 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:43:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d3da83c4-bdeb-42cc-8391-e68e5a6e0785 tempest-ProjectReaderTests-1784466903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d3da83c4-bdeb-42cc-8391-e68e5a6e0785 tempest-ProjectReaderTests-1784466903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:30 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d3da83c4-bdeb-42cc-8391-e68e5a6e0785 tempest-ProjectReaderTests-1784466903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:30 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d3da83c4-bdeb-42cc-8391-e68e5a6e0785 tempest-ProjectReaderTests-1784466903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d3da83c4-bdeb-42cc-8391-e68e5a6e0785 tempest-ProjectReaderTests-1784466903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:30 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d3da83c4-bdeb-42cc-8391-e68e5a6e0785 tempest-ProjectReaderTests-1784466903 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:43:30 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-d3da83c4-bdeb-42cc-8391-e68e5a6e0785 tempest-ProjectReaderTests-1784466903 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:43:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d3da83c4-bdeb-42cc-8391-e68e5a6e0785 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:30 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5 1073741824 Jul 07 17:43:30 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:30 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d6840bd1-4e3a-4ac0-8530-dcca17033ef6 tempest-ProjectMemberTests-232601277 None] Acquiring lock "cinder-e6e08486-0c92-4aeb-aba2-a28e32d9b793-delete_snapshot" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:30 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d6840bd1-4e3a-4ac0-8530-dcca17033ef6 tempest-ProjectMemberTests-232601277 None] Lock "cinder-e6e08486-0c92-4aeb-aba2-a28e32d9b793-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:30 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d6840bd1-4e3a-4ac0-8530-dcca17033ef6 tempest-ProjectMemberTests-232601277 None] Acquiring lock "cinder-quobyte-c0764de4-d04b-46cc-8fb2-c4a36ead0330" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:30 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d6840bd1-4e3a-4ac0-8530-dcca17033ef6 tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-c0764de4-d04b-46cc-8fb2-c4a36ead0330" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:30 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d6840bd1-4e3a-4ac0-8530-dcca17033ef6 tempest-ProjectMemberTests-232601277 None] Acquiring lock "cinder-quobyte-e6e08486-0c92-4aeb-aba2-a28e32d9b793" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:30 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d6840bd1-4e3a-4ac0-8530-dcca17033ef6 tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-e6e08486-0c92-4aeb-aba2-a28e32d9b793" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:30 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-d6840bd1-4e3a-4ac0-8530-dcca17033ef6 tempest-ProjectMemberTests-232601277 None] Deleting offline snapshot e6e08486-0c92-4aeb-aba2-a28e32d9b793 of volume c0764de4-d04b-46cc-8fb2-c4a36ead0330 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:43:30 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-d6840bd1-4e3a-4ac0-8530-dcca17033ef6 tempest-ProjectMemberTests-232601277 None] snapshot_file for this snap is: volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330.e6e08486-0c92-4aeb-aba2-a28e32d9b793 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:43:30 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[db30764b-c8c7-4f37-b97f-a866f94b5555]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d6840bd1-4e3a-4ac0-8530-dcca17033ef6 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330.e6e08486-0c92-4aeb-aba2-a28e32d9b793 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:30 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330.e6e08486-0c92-4aeb-aba2-a28e32d9b793 Jul 07 17:43:30 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:31 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d3da83c4-bdeb-42cc-8391-e68e5a6e0785 tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5 1073741824" returned: 0 in 0.843s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d3da83c4-bdeb-42cc-8391-e68e5a6e0785 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:31 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5 Jul 07 17:43:31 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:31 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d6840bd1-4e3a-4ac0-8530-dcca17033ef6 tempest-ProjectMemberTests-232601277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330.e6e08486-0c92-4aeb-aba2-a28e32d9b793" returned: 0 in 0.829s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:31 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-d6840bd1-4e3a-4ac0-8530-dcca17033ef6 tempest-ProjectMemberTests-232601277 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:43:31 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8961860-c6fd-477d-b23b-c482b3e0ef2e]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d6840bd1-4e3a-4ac0-8530-dcca17033ef6 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:31 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330 Jul 07 17:43:31 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:31 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d3da83c4-bdeb-42cc-8391-e68e5a6e0785 tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5" returned: 0 in 0.664s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:31 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d3da83c4-bdeb-42cc-8391-e68e5a6e0785 tempest-ProjectReaderTests-1784466903 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:43:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d3da83c4-bdeb-42cc-8391-e68e5a6e0785 tempest-ProjectReaderTests-1784466903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d3da83c4-bdeb-42cc-8391-e68e5a6e0785 tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f87b54b9-0131-4a46-8c60-12a4a0784eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d3da83c4-bdeb-42cc-8391-e68e5a6e0785 tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d23cb59-6933-43f1-b38e-c741afa69c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:31 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-d3da83c4-bdeb-42cc-8391-e68e5a6e0785 tempest-ProjectReaderTests-1784466903 None] Volume volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5 (0d6fcb88-32bb-4138-be68-44c7d05fb5d5): created successfully Jul 07 17:43:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d3da83c4-bdeb-42cc-8391-e68e5a6e0785 tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d23cb59-6933-43f1-b38e-c741afa69c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:31 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-d3da83c4-bdeb-42cc-8391-e68e5a6e0785 tempest-ProjectReaderTests-1784466903 None] Flow 'volume_create_manager' (a4f36ae5-77dc-4c1f-8a02-bfcfeeb33282) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:31 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-d3da83c4-bdeb-42cc-8391-e68e5a6e0785 tempest-ProjectReaderTests-1784466903 None] Created volume successfully. Jul 07 17:43:32 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d6840bd1-4e3a-4ac0-8530-dcca17033ef6 tempest-ProjectMemberTests-232601277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330" returned: 0 in 0.787s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d6840bd1-4e3a-4ac0-8530-dcca17033ef6 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330.e6e08486-0c92-4aeb-aba2-a28e32d9b793 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:32 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330.e6e08486-0c92-4aeb-aba2-a28e32d9b793 Jul 07 17:43:32 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0a7ea550-a6d9-42d4-9553-331e2ed9fd75 tempest-ProjectReaderTests-1784466903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0a7ea550-a6d9-42d4-9553-331e2ed9fd75 tempest-ProjectReaderTests-1784466903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:32 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-0a7ea550-a6d9-42d4-9553-331e2ed9fd75 tempest-ProjectReaderTests-1784466903 None] Creating offline snapshot a6f038d0-d317-40c0-b975-b4a9620cbd2c of volume 0d6fcb88-32bb-4138-be68-44c7d05fb5d5 {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:43:32 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5923e1b5-694a-4d81-a76c-7883bbc848a7]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0a7ea550-a6d9-42d4-9553-331e2ed9fd75 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:32 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5 Jul 07 17:43:32 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:33 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d6840bd1-4e3a-4ac0-8530-dcca17033ef6 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330.e6e08486-0c92-4aeb-aba2-a28e32d9b793" returned: 0 in 0.784s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d6840bd1-4e3a-4ac0-8530-dcca17033ef6 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330.e6e08486-0c92-4aeb-aba2-a28e32d9b793 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:33 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330.e6e08486-0c92-4aeb-aba2-a28e32d9b793 Jul 07 17:43:33 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:33 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0a7ea550-a6d9-42d4-9553-331e2ed9fd75 tempest-ProjectReaderTests-1784466903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5" returned: 0 in 0.825s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0a7ea550-a6d9-42d4-9553-331e2ed9fd75 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5.a6f038d0-d317-40c0-b975-b4a9620cbd2c 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:33 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5.a6f038d0-d317-40c0-b975-b4a9620cbd2c 1G Jul 07 17:43:33 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:33 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d6840bd1-4e3a-4ac0-8530-dcca17033ef6 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330.e6e08486-0c92-4aeb-aba2-a28e32d9b793" returned: 0 in 0.666s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:33 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d6840bd1-4e3a-4ac0-8530-dcca17033ef6 tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-e6e08486-0c92-4aeb-aba2-a28e32d9b793" released by "_delete_snapshot" :: held 3.162s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:33 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d6840bd1-4e3a-4ac0-8530-dcca17033ef6 tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-c0764de4-d04b-46cc-8fb2-c4a36ead0330" released by "delete_snapshot" :: held 3.185s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:33 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-d6840bd1-4e3a-4ac0-8530-dcca17033ef6 tempest-ProjectMemberTests-232601277 None] Created reservations ['701e7ecd-b723-4aea-8b78-f2b9a1c3d85e', 'd57654cb-c3ed-4e82-8f0d-94520bc06ed3', '0946c3d7-d075-407b-8bb2-13fb7d53e812', 'c63b2531-7fc0-47c2-9ecd-352700039355'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:43:33 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-d6840bd1-4e3a-4ac0-8530-dcca17033ef6 tempest-ProjectMemberTests-232601277 None] Delete snapshot completed successfully. Jul 07 17:43:33 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d6840bd1-4e3a-4ac0-8530-dcca17033ef6 tempest-ProjectMemberTests-232601277 None] Lock "cinder-e6e08486-0c92-4aeb-aba2-a28e32d9b793-delete_snapshot" released by "delete_snapshot" :: held 3.344s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:34 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0a7ea550-a6d9-42d4-9553-331e2ed9fd75 tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5.a6f038d0-d317-40c0-b975-b4a9620cbd2c 1G" returned: 0 in 0.839s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0a7ea550-a6d9-42d4-9553-331e2ed9fd75 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5.a6f038d0-d317-40c0-b975-b4a9620cbd2c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:34 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5.a6f038d0-d317-40c0-b975-b4a9620cbd2c Jul 07 17:43:34 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:34 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ab16440c-6bfa-41ae-ad30-0e43f54c0ab5 tempest-ProjectMemberTests-232601277 None] Acquiring lock "cinder-c0764de4-d04b-46cc-8fb2-c4a36ead0330-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:34 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ab16440c-6bfa-41ae-ad30-0e43f54c0ab5 tempest-ProjectMemberTests-232601277 None] Lock "cinder-c0764de4-d04b-46cc-8fb2-c4a36ead0330-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:34 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ab16440c-6bfa-41ae-ad30-0e43f54c0ab5 tempest-ProjectMemberTests-232601277 None] Acquiring lock "cinder-quobyte-c0764de4-d04b-46cc-8fb2-c4a36ead0330" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:34 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ab16440c-6bfa-41ae-ad30-0e43f54c0ab5 tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-c0764de4-d04b-46cc-8fb2-c4a36ead0330" acquired by "delete_volume" :: waited 0.019s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:34 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0a7ea550-a6d9-42d4-9553-331e2ed9fd75 tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5.a6f038d0-d317-40c0-b975-b4a9620cbd2c" returned: 0 in 0.804s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:34 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-0a7ea550-a6d9-42d4-9553-331e2ed9fd75 tempest-ProjectReaderTests-1784466903 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5.a6f038d0-d317-40c0-b975-b4a9620cbd2c is being set with open permissions: ugo+rw Jul 07 17:43:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0a7ea550-a6d9-42d4-9553-331e2ed9fd75 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5.a6f038d0-d317-40c0-b975-b4a9620cbd2c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:34 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c06abd-ea0b-46a7-989b-43f59579ba31]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ab16440c-6bfa-41ae-ad30-0e43f54c0ab5 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:34 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5.a6f038d0-d317-40c0-b975-b4a9620cbd2c Jul 07 17:43:34 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:35 devstack sudo[106990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330 Jul 07 17:43:35 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:35 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0a7ea550-a6d9-42d4-9553-331e2ed9fd75 tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5.a6f038d0-d317-40c0-b975-b4a9620cbd2c" returned: 0 in 0.664s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0a7ea550-a6d9-42d4-9553-331e2ed9fd75 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:35 devstack sudo[106996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5.info Jul 07 17:43:35 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:35 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ab16440c-6bfa-41ae-ad30-0e43f54c0ab5 tempest-ProjectMemberTests-232601277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330" returned: 0 in 0.781s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ab16440c-6bfa-41ae-ad30-0e43f54c0ab5 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:35 devstack sudo[106999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330 Jul 07 17:43:35 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:36 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0a7ea550-a6d9-42d4-9553-331e2ed9fd75 tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5.info" returned: 0 in 0.666s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:36 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-0a7ea550-a6d9-42d4-9553-331e2ed9fd75 tempest-ProjectReaderTests-1784466903 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5.info is being set with open permissions: ugo+rw Jul 07 17:43:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0a7ea550-a6d9-42d4-9553-331e2ed9fd75 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:36 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5.info Jul 07 17:43:36 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:36 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ab16440c-6bfa-41ae-ad30-0e43f54c0ab5 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-c0764de4-d04b-46cc-8fb2-c4a36ead0330" returned: 0 in 0.644s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:36 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ab16440c-6bfa-41ae-ad30-0e43f54c0ab5 tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-c0764de4-d04b-46cc-8fb2-c4a36ead0330" released by "delete_volume" :: held 1.511s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:36 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-ab16440c-6bfa-41ae-ad30-0e43f54c0ab5 tempest-ProjectMemberTests-232601277 None] Created reservations ['8efbe8b6-16bf-488d-b0b1-ec0be28234e6', '5bee2fa9-8c4d-4703-b26b-bab4b5af8b3b', '8d0d62df-ac58-466e-aa7f-91da9e7067d2', 'bea5df4d-2931-427e-a2c2-7762c3dbdb7c'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:43:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ab16440c-6bfa-41ae-ad30-0e43f54c0ab5 tempest-ProjectMemberTests-232601277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ab16440c-6bfa-41ae-ad30-0e43f54c0ab5 tempest-ProjectMemberTests-232601277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:36 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ab16440c-6bfa-41ae-ad30-0e43f54c0ab5 tempest-ProjectMemberTests-232601277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:36 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ab16440c-6bfa-41ae-ad30-0e43f54c0ab5 tempest-ProjectMemberTests-232601277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ab16440c-6bfa-41ae-ad30-0e43f54c0ab5 tempest-ProjectMemberTests-232601277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ab16440c-6bfa-41ae-ad30-0e43f54c0ab5 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:36 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:43:36 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:36 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-0a7ea550-a6d9-42d4-9553-331e2ed9fd75 tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5.info" returned: 0 in 0.645s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:36 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-0a7ea550-a6d9-42d4-9553-331e2ed9fd75 tempest-ProjectReaderTests-1784466903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.532s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:37 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-0a7ea550-a6d9-42d4-9553-331e2ed9fd75 tempest-ProjectReaderTests-1784466903 None] Create snapshot completed successfully Jul 07 17:43:37 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ab16440c-6bfa-41ae-ad30-0e43f54c0ab5 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.667s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:37 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-ab16440c-6bfa-41ae-ad30-0e43f54c0ab5 tempest-ProjectMemberTests-232601277 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:43:37 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-ab16440c-6bfa-41ae-ad30-0e43f54c0ab5 tempest-ProjectMemberTests-232601277 None] Deleted volume successfully. Jul 07 17:43:37 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-ab16440c-6bfa-41ae-ad30-0e43f54c0ab5 tempest-ProjectMemberTests-232601277 None] Lock "cinder-c0764de4-d04b-46cc-8fb2-c4a36ead0330-delete_volume" released by "delete_volume" :: held 2.397s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:37 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-48ea9651-a4eb-4d7f-a802-0a1c2a77d201 tempest-ProjectMemberTests-232601277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:43:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-48ea9651-a4eb-4d7f-a802-0a1c2a77d201 tempest-ProjectMemberTests-232601277 None] Flow 'volume_create_manager' (0fb80792-ea63-4cbb-ad6f-e18d6717ee02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-48ea9651-a4eb-4d7f-a802-0a1c2a77d201 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16cf80b9-d1a4-428c-be48-4f7786089995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-48ea9651-a4eb-4d7f-a802-0a1c2a77d201 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16cf80b9-d1a4-428c-be48-4f7786089995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1836777470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d605a9b-41f7-4ee2-99ed-859e59aaba14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='126630bddcf5433fb704f04aac171bde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:38Z,use_quota=True,user_id='f03110d4128243fca6ab7f6b4b51123a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-48ea9651-a4eb-4d7f-a802-0a1c2a77d201 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf9e2d88-ff47-47c3-b955-b8db9b83c7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-48ea9651-a4eb-4d7f-a802-0a1c2a77d201 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf9e2d88-ff47-47c3-b955-b8db9b83c7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-48ea9651-a4eb-4d7f-a802-0a1c2a77d201 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3aaf20d-502e-41e8-9243-272f78cfbc46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-48ea9651-a4eb-4d7f-a802-0a1c2a77d201 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3aaf20d-502e-41e8-9243-272f78cfbc46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d605a9b-41f7-4ee2-99ed-859e59aaba14', 'volume_name': 'volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-48ea9651-a4eb-4d7f-a802-0a1c2a77d201 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (146c287d-a0e9-47a9-9179-755fb0db0cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-48ea9651-a4eb-4d7f-a802-0a1c2a77d201 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (146c287d-a0e9-47a9-9179-755fb0db0cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:37 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-48ea9651-a4eb-4d7f-a802-0a1c2a77d201 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7089586c-ceee-4907-95e3-ff540a9945c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:37 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-48ea9651-a4eb-4d7f-a802-0a1c2a77d201 tempest-ProjectMemberTests-232601277 None] Volume 8d605a9b-41f7-4ee2-99ed-859e59aaba14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14', 'volume_size': 1} Jul 07 17:43:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-48ea9651-a4eb-4d7f-a802-0a1c2a77d201 tempest-ProjectMemberTests-232601277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-48ea9651-a4eb-4d7f-a802-0a1c2a77d201 tempest-ProjectMemberTests-232601277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:37 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-48ea9651-a4eb-4d7f-a802-0a1c2a77d201 tempest-ProjectMemberTests-232601277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1836777470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d605a9b-41f7-4ee2-99ed-859e59aaba14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='126630bddcf5433fb704f04aac171bde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:38Z,use_quota=True,user_id='f03110d4128243fca6ab7f6b4b51123a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:43:37 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-48ea9651-a4eb-4d7f-a802-0a1c2a77d201 tempest-ProjectMemberTests-232601277 None] Creating volume 8d605a9b-41f7-4ee2-99ed-859e59aaba14 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:43:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-48ea9651-a4eb-4d7f-a802-0a1c2a77d201 tempest-ProjectMemberTests-232601277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-48ea9651-a4eb-4d7f-a802-0a1c2a77d201 tempest-ProjectMemberTests-232601277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:37 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-48ea9651-a4eb-4d7f-a802-0a1c2a77d201 tempest-ProjectMemberTests-232601277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:37 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-48ea9651-a4eb-4d7f-a802-0a1c2a77d201 tempest-ProjectMemberTests-232601277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-48ea9651-a4eb-4d7f-a802-0a1c2a77d201 tempest-ProjectMemberTests-232601277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:37 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-48ea9651-a4eb-4d7f-a802-0a1c2a77d201 tempest-ProjectMemberTests-232601277 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:43:37 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-48ea9651-a4eb-4d7f-a802-0a1c2a77d201 tempest-ProjectMemberTests-232601277 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:43:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-48ea9651-a4eb-4d7f-a802-0a1c2a77d201 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:37 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-23be681e-8463-4be7-9a72-75a0cf680bca tempest-ProjectReaderTests-1784466903 None] Acquiring lock "cinder-a6f038d0-d317-40c0-b975-b4a9620cbd2c-delete_snapshot" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:37 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14 1073741824 Jul 07 17:43:37 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:37 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-23be681e-8463-4be7-9a72-75a0cf680bca tempest-ProjectReaderTests-1784466903 None] Lock "cinder-a6f038d0-d317-40c0-b975-b4a9620cbd2c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:37 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-23be681e-8463-4be7-9a72-75a0cf680bca tempest-ProjectReaderTests-1784466903 None] Acquiring lock "cinder-quobyte-0d6fcb88-32bb-4138-be68-44c7d05fb5d5" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:37 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-23be681e-8463-4be7-9a72-75a0cf680bca tempest-ProjectReaderTests-1784466903 None] Lock "cinder-quobyte-0d6fcb88-32bb-4138-be68-44c7d05fb5d5" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:37 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-23be681e-8463-4be7-9a72-75a0cf680bca tempest-ProjectReaderTests-1784466903 None] Acquiring lock "cinder-quobyte-a6f038d0-d317-40c0-b975-b4a9620cbd2c" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:37 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-23be681e-8463-4be7-9a72-75a0cf680bca tempest-ProjectReaderTests-1784466903 None] Lock "cinder-quobyte-a6f038d0-d317-40c0-b975-b4a9620cbd2c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:37 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-23be681e-8463-4be7-9a72-75a0cf680bca tempest-ProjectReaderTests-1784466903 None] Deleting offline snapshot a6f038d0-d317-40c0-b975-b4a9620cbd2c of volume 0d6fcb88-32bb-4138-be68-44c7d05fb5d5 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:43:37 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-23be681e-8463-4be7-9a72-75a0cf680bca tempest-ProjectReaderTests-1784466903 None] snapshot_file for this snap is: volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5.a6f038d0-d317-40c0-b975-b4a9620cbd2c {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:43:37 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc69493-ad15-4516-bc5f-da6d91bdb85f]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:37 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-23be681e-8463-4be7-9a72-75a0cf680bca tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5.a6f038d0-d317-40c0-b975-b4a9620cbd2c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:37 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5.a6f038d0-d317-40c0-b975-b4a9620cbd2c Jul 07 17:43:37 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:38 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-23be681e-8463-4be7-9a72-75a0cf680bca tempest-ProjectReaderTests-1784466903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5.a6f038d0-d317-40c0-b975-b4a9620cbd2c" returned: 0 in 0.812s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:38 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-23be681e-8463-4be7-9a72-75a0cf680bca tempest-ProjectReaderTests-1784466903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:43:38 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-48ea9651-a4eb-4d7f-a802-0a1c2a77d201 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14 1073741824" returned: 0 in 0.957s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:38 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9dcdcd3-2b9c-43ff-94f0-087b8c0ef8e5]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-23be681e-8463-4be7-9a72-75a0cf680bca tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:38 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-48ea9651-a4eb-4d7f-a802-0a1c2a77d201 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:38 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14 Jul 07 17:43:38 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:38 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5 Jul 07 17:43:38 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:39 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-48ea9651-a4eb-4d7f-a802-0a1c2a77d201 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14" returned: 0 in 0.687s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:39 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-48ea9651-a4eb-4d7f-a802-0a1c2a77d201 tempest-ProjectMemberTests-232601277 None] <== create_volume: return (1700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:43:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-48ea9651-a4eb-4d7f-a802-0a1c2a77d201 tempest-ProjectMemberTests-232601277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:39 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-48ea9651-a4eb-4d7f-a802-0a1c2a77d201 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7089586c-ceee-4907-95e3-ff540a9945c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:39 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-48ea9651-a4eb-4d7f-a802-0a1c2a77d201 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a0c0288-8ce0-4ec0-a077-a98455a724fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:39 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:39 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-48ea9651-a4eb-4d7f-a802-0a1c2a77d201 tempest-ProjectMemberTests-232601277 None] Volume volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14 (8d605a9b-41f7-4ee2-99ed-859e59aaba14): created successfully Jul 07 17:43:39 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-48ea9651-a4eb-4d7f-a802-0a1c2a77d201 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a0c0288-8ce0-4ec0-a077-a98455a724fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:39 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-48ea9651-a4eb-4d7f-a802-0a1c2a77d201 tempest-ProjectMemberTests-232601277 None] Flow 'volume_create_manager' (0fb80792-ea63-4cbb-ad6f-e18d6717ee02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-23be681e-8463-4be7-9a72-75a0cf680bca tempest-ProjectReaderTests-1784466903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5" returned: 0 in 0.780s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-23be681e-8463-4be7-9a72-75a0cf680bca tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5.a6f038d0-d317-40c0-b975-b4a9620cbd2c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:39 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-48ea9651-a4eb-4d7f-a802-0a1c2a77d201 tempest-ProjectMemberTests-232601277 None] Created volume successfully. Jul 07 17:43:39 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5.a6f038d0-d317-40c0-b975-b4a9620cbd2c Jul 07 17:43:39 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-725ceaee-4e44-4db0-a33a-b2e3c235ec69 tempest-ProjectMemberTests-232601277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-725ceaee-4e44-4db0-a33a-b2e3c235ec69 tempest-ProjectMemberTests-232601277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:39 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-725ceaee-4e44-4db0-a33a-b2e3c235ec69 tempest-ProjectMemberTests-232601277 None] Creating offline snapshot a39f3e73-4d2f-4d32-83d7-9e6f342893b0 of volume 8d605a9b-41f7-4ee2-99ed-859e59aaba14 {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:43:39 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba69e5b-2270-4d5f-8ad7-060afa2f261d]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-725ceaee-4e44-4db0-a33a-b2e3c235ec69 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:39 devstack sudo[107030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14 Jul 07 17:43:39 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:40 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-23be681e-8463-4be7-9a72-75a0cf680bca tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5.a6f038d0-d317-40c0-b975-b4a9620cbd2c" returned: 0 in 0.816s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-23be681e-8463-4be7-9a72-75a0cf680bca tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5.a6f038d0-d317-40c0-b975-b4a9620cbd2c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:40 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5.a6f038d0-d317-40c0-b975-b4a9620cbd2c Jul 07 17:43:40 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:40 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-725ceaee-4e44-4db0-a33a-b2e3c235ec69 tempest-ProjectMemberTests-232601277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14" returned: 0 in 0.790s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-725ceaee-4e44-4db0-a33a-b2e3c235ec69 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14.a39f3e73-4d2f-4d32-83d7-9e6f342893b0 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:40 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14.a39f3e73-4d2f-4d32-83d7-9e6f342893b0 1G Jul 07 17:43:40 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:40 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-23be681e-8463-4be7-9a72-75a0cf680bca tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5.a6f038d0-d317-40c0-b975-b4a9620cbd2c" returned: 0 in 0.699s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:40 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-23be681e-8463-4be7-9a72-75a0cf680bca tempest-ProjectReaderTests-1784466903 None] Lock "cinder-quobyte-a6f038d0-d317-40c0-b975-b4a9620cbd2c" released by "_delete_snapshot" :: held 3.206s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:40 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-23be681e-8463-4be7-9a72-75a0cf680bca tempest-ProjectReaderTests-1784466903 None] Lock "cinder-quobyte-0d6fcb88-32bb-4138-be68-44c7d05fb5d5" released by "delete_snapshot" :: held 3.233s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:41 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-23be681e-8463-4be7-9a72-75a0cf680bca tempest-ProjectReaderTests-1784466903 None] Created reservations ['b8fc376d-9bd9-4585-9001-35a9a4df5efc', '728dbb02-8223-481b-8c89-da9148107c22', '2c976d7d-bd1d-4537-8cf0-84a4ff2894dc', 'e3c9bd87-a1ad-48a5-ac3f-dd0675ee29d7'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:43:41 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-23be681e-8463-4be7-9a72-75a0cf680bca tempest-ProjectReaderTests-1784466903 None] Delete snapshot completed successfully. Jul 07 17:43:41 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-23be681e-8463-4be7-9a72-75a0cf680bca tempest-ProjectReaderTests-1784466903 None] Lock "cinder-a6f038d0-d317-40c0-b975-b4a9620cbd2c-delete_snapshot" released by "delete_snapshot" :: held 3.383s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:41 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-725ceaee-4e44-4db0-a33a-b2e3c235ec69 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14.a39f3e73-4d2f-4d32-83d7-9e6f342893b0 1G" returned: 0 in 0.788s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-725ceaee-4e44-4db0-a33a-b2e3c235ec69 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14.a39f3e73-4d2f-4d32-83d7-9e6f342893b0 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:41 devstack sudo[107047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14.a39f3e73-4d2f-4d32-83d7-9e6f342893b0 Jul 07 17:43:41 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:41 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d3eb21fa-5852-4824-8bf7-4cbdc7d741c9 tempest-ProjectReaderTests-1784466903 None] Acquiring lock "cinder-0d6fcb88-32bb-4138-be68-44c7d05fb5d5-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:41 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d3eb21fa-5852-4824-8bf7-4cbdc7d741c9 tempest-ProjectReaderTests-1784466903 None] Lock "cinder-0d6fcb88-32bb-4138-be68-44c7d05fb5d5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:42 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d3eb21fa-5852-4824-8bf7-4cbdc7d741c9 tempest-ProjectReaderTests-1784466903 None] Acquiring lock "cinder-quobyte-0d6fcb88-32bb-4138-be68-44c7d05fb5d5" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:42 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d3eb21fa-5852-4824-8bf7-4cbdc7d741c9 tempest-ProjectReaderTests-1784466903 None] Lock "cinder-quobyte-0d6fcb88-32bb-4138-be68-44c7d05fb5d5" acquired by "delete_volume" :: waited 0.014s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:42 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7775e704-0cc6-4b43-ab20-d1fac5ca869c]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d3eb21fa-5852-4824-8bf7-4cbdc7d741c9 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:42 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-725ceaee-4e44-4db0-a33a-b2e3c235ec69 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14.a39f3e73-4d2f-4d32-83d7-9e6f342893b0" returned: 0 in 0.726s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:42 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-725ceaee-4e44-4db0-a33a-b2e3c235ec69 tempest-ProjectMemberTests-232601277 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14.a39f3e73-4d2f-4d32-83d7-9e6f342893b0 is being set with open permissions: ugo+rw Jul 07 17:43:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-725ceaee-4e44-4db0-a33a-b2e3c235ec69 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14.a39f3e73-4d2f-4d32-83d7-9e6f342893b0 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:42 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5 Jul 07 17:43:42 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:42 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14.a39f3e73-4d2f-4d32-83d7-9e6f342893b0 Jul 07 17:43:42 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:42 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-725ceaee-4e44-4db0-a33a-b2e3c235ec69 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14.a39f3e73-4d2f-4d32-83d7-9e6f342893b0" returned: 0 in 0.628s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-725ceaee-4e44-4db0-a33a-b2e3c235ec69 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:42 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d3eb21fa-5852-4824-8bf7-4cbdc7d741c9 tempest-ProjectReaderTests-1784466903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5" returned: 0 in 0.768s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d3eb21fa-5852-4824-8bf7-4cbdc7d741c9 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:42 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14.info Jul 07 17:43:42 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:42 devstack sudo[107062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5 Jul 07 17:43:42 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:43 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:43:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:43 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:43:43 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:43 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d3eb21fa-5852-4824-8bf7-4cbdc7d741c9 tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-0d6fcb88-32bb-4138-be68-44c7d05fb5d5" returned: 0 in 0.627s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:43 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d3eb21fa-5852-4824-8bf7-4cbdc7d741c9 tempest-ProjectReaderTests-1784466903 None] Lock "cinder-quobyte-0d6fcb88-32bb-4138-be68-44c7d05fb5d5" released by "delete_volume" :: held 1.457s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:43 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:SELECT=124,cinder:UPDATE=133,cinder:INSERT=38,cinder:DELETE=10 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:43:43 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-725ceaee-4e44-4db0-a33a-b2e3c235ec69 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14.info" returned: 0 in 0.677s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:43 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-725ceaee-4e44-4db0-a33a-b2e3c235ec69 tempest-ProjectMemberTests-232601277 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14.info is being set with open permissions: ugo+rw Jul 07 17:43:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-725ceaee-4e44-4db0-a33a-b2e3c235ec69 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:43 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:SELECT=98,cinder:UPDATE=141,cinder:DELETE=13,cinder:INSERT=39 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:43:43 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14.info Jul 07 17:43:43 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:43 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-d3eb21fa-5852-4824-8bf7-4cbdc7d741c9 tempest-ProjectReaderTests-1784466903 None] Created reservations ['2d509acd-cd3c-4d45-a2aa-3e3f84121b6d', 'eac125cd-35b9-4601-a6db-3383de173b45', 'f2df41e1-517a-4a35-b2c1-2d1a848199e3', '8bf72ada-0cea-489e-bd17-9dbb851418aa'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:43:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d3eb21fa-5852-4824-8bf7-4cbdc7d741c9 tempest-ProjectReaderTests-1784466903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d3eb21fa-5852-4824-8bf7-4cbdc7d741c9 tempest-ProjectReaderTests-1784466903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d3eb21fa-5852-4824-8bf7-4cbdc7d741c9 tempest-ProjectReaderTests-1784466903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-d3eb21fa-5852-4824-8bf7-4cbdc7d741c9 tempest-ProjectReaderTests-1784466903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-d3eb21fa-5852-4824-8bf7-4cbdc7d741c9 tempest-ProjectReaderTests-1784466903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d3eb21fa-5852-4824-8bf7-4cbdc7d741c9 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:43 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:43:43 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:44 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.660s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:44 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:43:44 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:43:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread count: 28 {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:43:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread info: [<_MainThread(MainThread, started 126077716062336)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:43:44 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-725ceaee-4e44-4db0-a33a-b2e3c235ec69 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14.info" returned: 0 in 0.652s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-725ceaee-4e44-4db0-a33a-b2e3c235ec69 tempest-ProjectMemberTests-232601277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.356s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:44 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-725ceaee-4e44-4db0-a33a-b2e3c235ec69 tempest-ProjectMemberTests-232601277 None] Create snapshot completed successfully Jul 07 17:43:44 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-d3eb21fa-5852-4824-8bf7-4cbdc7d741c9 tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.697s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:44 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-d3eb21fa-5852-4824-8bf7-4cbdc7d741c9 tempest-ProjectReaderTests-1784466903 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:43:44 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-d3eb21fa-5852-4824-8bf7-4cbdc7d741c9 tempest-ProjectReaderTests-1784466903 None] Deleted volume successfully. Jul 07 17:43:44 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-d3eb21fa-5852-4824-8bf7-4cbdc7d741c9 tempest-ProjectReaderTests-1784466903 None] Lock "cinder-0d6fcb88-32bb-4138-be68-44c7d05fb5d5-delete_volume" released by "delete_volume" :: held 2.404s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:44 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ed7ac1e-0c64-409f-8689-ea7d5a1e962c tempest-ProjectReaderTests-1784466903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:43:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7ed7ac1e-0c64-409f-8689-ea7d5a1e962c tempest-ProjectReaderTests-1784466903 None] Flow 'volume_create_manager' (f11df467-a72f-4706-a221-1d3c84fc3939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7ed7ac1e-0c64-409f-8689-ea7d5a1e962c tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7356fa5a-bbbf-4763-926a-9285bd4e44ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7ed7ac1e-0c64-409f-8689-ea7d5a1e962c tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7356fa5a-bbbf-4763-926a-9285bd4e44ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-949653500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a15e6a9-6e31-4c35-a438-d68bce4e7d2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f7af8480fe431192778df1c311e074',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:45Z,use_quota=True,user_id='98144cb6a2c64593a39ce3220c506359',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7ed7ac1e-0c64-409f-8689-ea7d5a1e962c tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c9f6d81-2110-42fd-adc5-5c9a73ab5c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7ed7ac1e-0c64-409f-8689-ea7d5a1e962c tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c9f6d81-2110-42fd-adc5-5c9a73ab5c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7ed7ac1e-0c64-409f-8689-ea7d5a1e962c tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8888cff2-3ce7-4d58-856a-e0063bd659f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7ed7ac1e-0c64-409f-8689-ea7d5a1e962c tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8888cff2-3ce7-4d58-856a-e0063bd659f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a15e6a9-6e31-4c35-a438-d68bce4e7d2d', 'volume_name': 'volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7ed7ac1e-0c64-409f-8689-ea7d5a1e962c tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6877bd8e-78f9-4ee0-acd8-1ef4dac9d461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7ed7ac1e-0c64-409f-8689-ea7d5a1e962c tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6877bd8e-78f9-4ee0-acd8-1ef4dac9d461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7ed7ac1e-0c64-409f-8689-ea7d5a1e962c tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e72c3379-8d8b-4a6e-9220-ccd47e153c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:44 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-7ed7ac1e-0c64-409f-8689-ea7d5a1e962c tempest-ProjectReaderTests-1784466903 None] Volume 5a15e6a9-6e31-4c35-a438-d68bce4e7d2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d', 'volume_size': 1} Jul 07 17:43:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-7ed7ac1e-0c64-409f-8689-ea7d5a1e962c tempest-ProjectReaderTests-1784466903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-7ed7ac1e-0c64-409f-8689-ea7d5a1e962c tempest-ProjectReaderTests-1784466903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:44 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-7ed7ac1e-0c64-409f-8689-ea7d5a1e962c tempest-ProjectReaderTests-1784466903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-949653500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a15e6a9-6e31-4c35-a438-d68bce4e7d2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f7af8480fe431192778df1c311e074',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:45Z,use_quota=True,user_id='98144cb6a2c64593a39ce3220c506359',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:43:44 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-7ed7ac1e-0c64-409f-8689-ea7d5a1e962c tempest-ProjectReaderTests-1784466903 None] Creating volume 5a15e6a9-6e31-4c35-a438-d68bce4e7d2d {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:43:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-7ed7ac1e-0c64-409f-8689-ea7d5a1e962c tempest-ProjectReaderTests-1784466903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-7ed7ac1e-0c64-409f-8689-ea7d5a1e962c tempest-ProjectReaderTests-1784466903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:44 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-7ed7ac1e-0c64-409f-8689-ea7d5a1e962c tempest-ProjectReaderTests-1784466903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:44 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-7ed7ac1e-0c64-409f-8689-ea7d5a1e962c tempest-ProjectReaderTests-1784466903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-7ed7ac1e-0c64-409f-8689-ea7d5a1e962c tempest-ProjectReaderTests-1784466903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:44 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-7ed7ac1e-0c64-409f-8689-ea7d5a1e962c tempest-ProjectReaderTests-1784466903 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:43:44 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-7ed7ac1e-0c64-409f-8689-ea7d5a1e962c tempest-ProjectReaderTests-1784466903 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:43:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7ed7ac1e-0c64-409f-8689-ea7d5a1e962c tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:44 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d 1073741824 Jul 07 17:43:44 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:45 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-b19a5e2f-cdf3-45d0-b03a-810a83328f88 tempest-ProjectMemberTests-232601277 None] Acquiring lock "cinder-a39f3e73-4d2f-4d32-83d7-9e6f342893b0-delete_snapshot" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:45 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-b19a5e2f-cdf3-45d0-b03a-810a83328f88 tempest-ProjectMemberTests-232601277 None] Lock "cinder-a39f3e73-4d2f-4d32-83d7-9e6f342893b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:45 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-b19a5e2f-cdf3-45d0-b03a-810a83328f88 tempest-ProjectMemberTests-232601277 None] Acquiring lock "cinder-quobyte-8d605a9b-41f7-4ee2-99ed-859e59aaba14" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:45 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-b19a5e2f-cdf3-45d0-b03a-810a83328f88 tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-8d605a9b-41f7-4ee2-99ed-859e59aaba14" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:45 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-b19a5e2f-cdf3-45d0-b03a-810a83328f88 tempest-ProjectMemberTests-232601277 None] Acquiring lock "cinder-quobyte-a39f3e73-4d2f-4d32-83d7-9e6f342893b0" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:45 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-b19a5e2f-cdf3-45d0-b03a-810a83328f88 tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-a39f3e73-4d2f-4d32-83d7-9e6f342893b0" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:45 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-b19a5e2f-cdf3-45d0-b03a-810a83328f88 tempest-ProjectMemberTests-232601277 None] Deleting offline snapshot a39f3e73-4d2f-4d32-83d7-9e6f342893b0 of volume 8d605a9b-41f7-4ee2-99ed-859e59aaba14 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:43:45 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-b19a5e2f-cdf3-45d0-b03a-810a83328f88 tempest-ProjectMemberTests-232601277 None] snapshot_file for this snap is: volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14.a39f3e73-4d2f-4d32-83d7-9e6f342893b0 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:43:45 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc95da0e-23a4-4a8a-9484-d0a7bfe58be8]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b19a5e2f-cdf3-45d0-b03a-810a83328f88 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14.a39f3e73-4d2f-4d32-83d7-9e6f342893b0 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:45 devstack sudo[107079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14.a39f3e73-4d2f-4d32-83d7-9e6f342893b0 Jul 07 17:43:45 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:45 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7ed7ac1e-0c64-409f-8689-ea7d5a1e962c tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d 1073741824" returned: 0 in 0.804s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7ed7ac1e-0c64-409f-8689-ea7d5a1e962c tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:45 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d Jul 07 17:43:45 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:45 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b19a5e2f-cdf3-45d0-b03a-810a83328f88 tempest-ProjectMemberTests-232601277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14.a39f3e73-4d2f-4d32-83d7-9e6f342893b0" returned: 0 in 0.763s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:45 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-b19a5e2f-cdf3-45d0-b03a-810a83328f88 tempest-ProjectMemberTests-232601277 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:43:45 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5747af-1c88-4d20-8ec4-a0f1cfdb6829]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b19a5e2f-cdf3-45d0-b03a-810a83328f88 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:46 devstack sudo[107090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14 Jul 07 17:43:46 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:46 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7ed7ac1e-0c64-409f-8689-ea7d5a1e962c tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d" returned: 0 in 0.650s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:46 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-7ed7ac1e-0c64-409f-8689-ea7d5a1e962c tempest-ProjectReaderTests-1784466903 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:43:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-7ed7ac1e-0c64-409f-8689-ea7d5a1e962c tempest-ProjectReaderTests-1784466903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:46 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7ed7ac1e-0c64-409f-8689-ea7d5a1e962c tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e72c3379-8d8b-4a6e-9220-ccd47e153c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:46 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7ed7ac1e-0c64-409f-8689-ea7d5a1e962c tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e8bb4a7-2190-4f5b-9505-3df3b25db27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:46 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-7ed7ac1e-0c64-409f-8689-ea7d5a1e962c tempest-ProjectReaderTests-1784466903 None] Volume volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d (5a15e6a9-6e31-4c35-a438-d68bce4e7d2d): created successfully Jul 07 17:43:46 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7ed7ac1e-0c64-409f-8689-ea7d5a1e962c tempest-ProjectReaderTests-1784466903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e8bb4a7-2190-4f5b-9505-3df3b25db27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:46 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-7ed7ac1e-0c64-409f-8689-ea7d5a1e962c tempest-ProjectReaderTests-1784466903 None] Flow 'volume_create_manager' (f11df467-a72f-4706-a221-1d3c84fc3939) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:46 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-7ed7ac1e-0c64-409f-8689-ea7d5a1e962c tempest-ProjectReaderTests-1784466903 None] Created volume successfully. Jul 07 17:43:46 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b19a5e2f-cdf3-45d0-b03a-810a83328f88 tempest-ProjectMemberTests-232601277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14" returned: 0 in 0.760s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b19a5e2f-cdf3-45d0-b03a-810a83328f88 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14.a39f3e73-4d2f-4d32-83d7-9e6f342893b0 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:46 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14.a39f3e73-4d2f-4d32-83d7-9e6f342893b0 Jul 07 17:43:46 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1785649d-15ed-4249-b5bb-679ee5161797 tempest-ProjectReaderTests-1784466903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1785649d-15ed-4249-b5bb-679ee5161797 tempest-ProjectReaderTests-1784466903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:46 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-1785649d-15ed-4249-b5bb-679ee5161797 tempest-ProjectReaderTests-1784466903 None] Creating offline snapshot dd3684a7-17c3-4679-a7f3-6c315eb350e2 of volume 5a15e6a9-6e31-4c35-a438-d68bce4e7d2d {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:43:46 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[191a1e83-56ac-45de-92a0-b59bfb640014]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1785649d-15ed-4249-b5bb-679ee5161797 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:47 devstack sudo[107098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d Jul 07 17:43:47 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:47 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b19a5e2f-cdf3-45d0-b03a-810a83328f88 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14.a39f3e73-4d2f-4d32-83d7-9e6f342893b0" returned: 0 in 0.860s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b19a5e2f-cdf3-45d0-b03a-810a83328f88 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14.a39f3e73-4d2f-4d32-83d7-9e6f342893b0 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:47 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14.a39f3e73-4d2f-4d32-83d7-9e6f342893b0 Jul 07 17:43:47 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:47 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1785649d-15ed-4249-b5bb-679ee5161797 tempest-ProjectReaderTests-1784466903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d" returned: 0 in 0.889s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1785649d-15ed-4249-b5bb-679ee5161797 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d.dd3684a7-17c3-4679-a7f3-6c315eb350e2 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:47 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d.dd3684a7-17c3-4679-a7f3-6c315eb350e2 1G Jul 07 17:43:47 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:48 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-b19a5e2f-cdf3-45d0-b03a-810a83328f88 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14.a39f3e73-4d2f-4d32-83d7-9e6f342893b0" returned: 0 in 0.716s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:48 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-b19a5e2f-cdf3-45d0-b03a-810a83328f88 tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-a39f3e73-4d2f-4d32-83d7-9e6f342893b0" released by "_delete_snapshot" :: held 3.190s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:48 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-b19a5e2f-cdf3-45d0-b03a-810a83328f88 tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-8d605a9b-41f7-4ee2-99ed-859e59aaba14" released by "delete_snapshot" :: held 3.211s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:48 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-b19a5e2f-cdf3-45d0-b03a-810a83328f88 tempest-ProjectMemberTests-232601277 None] Created reservations ['5f72a454-847f-46d1-915d-490158e42996', 'c027eddd-a607-4969-abc0-c85dffc125d9', 'a0fe770e-fb77-4299-afae-0de6e006b510', 'fa596792-6135-4623-9a3d-2fbf66f0ed0d'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:43:48 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-b19a5e2f-cdf3-45d0-b03a-810a83328f88 tempest-ProjectMemberTests-232601277 None] Delete snapshot completed successfully. Jul 07 17:43:48 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-b19a5e2f-cdf3-45d0-b03a-810a83328f88 tempest-ProjectMemberTests-232601277 None] Lock "cinder-a39f3e73-4d2f-4d32-83d7-9e6f342893b0-delete_snapshot" released by "delete_snapshot" :: held 3.372s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:48 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1785649d-15ed-4249-b5bb-679ee5161797 tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d.dd3684a7-17c3-4679-a7f3-6c315eb350e2 1G" returned: 0 in 0.876s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1785649d-15ed-4249-b5bb-679ee5161797 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d.dd3684a7-17c3-4679-a7f3-6c315eb350e2 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:48 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d.dd3684a7-17c3-4679-a7f3-6c315eb350e2 Jul 07 17:43:48 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:49 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-188ffc5d-2e0b-4be6-b08f-3e8eed8cf876 tempest-ProjectMemberTests-232601277 None] Acquiring lock "cinder-8d605a9b-41f7-4ee2-99ed-859e59aaba14-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:49 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-188ffc5d-2e0b-4be6-b08f-3e8eed8cf876 tempest-ProjectMemberTests-232601277 None] Lock "cinder-8d605a9b-41f7-4ee2-99ed-859e59aaba14-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:49 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-188ffc5d-2e0b-4be6-b08f-3e8eed8cf876 tempest-ProjectMemberTests-232601277 None] Acquiring lock "cinder-quobyte-8d605a9b-41f7-4ee2-99ed-859e59aaba14" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:49 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-188ffc5d-2e0b-4be6-b08f-3e8eed8cf876 tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-8d605a9b-41f7-4ee2-99ed-859e59aaba14" acquired by "delete_volume" :: waited 0.017s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:49 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b80d8f-5aa7-445f-9ea2-0d5505e0deaf]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-188ffc5d-2e0b-4be6-b08f-3e8eed8cf876 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:49 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1785649d-15ed-4249-b5bb-679ee5161797 tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d.dd3684a7-17c3-4679-a7f3-6c315eb350e2" returned: 0 in 0.846s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:49 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-1785649d-15ed-4249-b5bb-679ee5161797 tempest-ProjectReaderTests-1784466903 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d.dd3684a7-17c3-4679-a7f3-6c315eb350e2 is being set with open permissions: ugo+rw Jul 07 17:43:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1785649d-15ed-4249-b5bb-679ee5161797 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d.dd3684a7-17c3-4679-a7f3-6c315eb350e2 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:49 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14 Jul 07 17:43:49 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:49 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d.dd3684a7-17c3-4679-a7f3-6c315eb350e2 Jul 07 17:43:49 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:50 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-188ffc5d-2e0b-4be6-b08f-3e8eed8cf876 tempest-ProjectMemberTests-232601277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14" returned: 0 in 0.800s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-188ffc5d-2e0b-4be6-b08f-3e8eed8cf876 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:50 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14 Jul 07 17:43:50 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:50 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1785649d-15ed-4249-b5bb-679ee5161797 tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d.dd3684a7-17c3-4679-a7f3-6c315eb350e2" returned: 0 in 0.818s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1785649d-15ed-4249-b5bb-679ee5161797 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:50 devstack sudo[107129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d.info Jul 07 17:43:50 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:51 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-188ffc5d-2e0b-4be6-b08f-3e8eed8cf876 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-8d605a9b-41f7-4ee2-99ed-859e59aaba14" returned: 0 in 0.732s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:51 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-188ffc5d-2e0b-4be6-b08f-3e8eed8cf876 tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-8d605a9b-41f7-4ee2-99ed-859e59aaba14" released by "delete_volume" :: held 1.596s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:51 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-188ffc5d-2e0b-4be6-b08f-3e8eed8cf876 tempest-ProjectMemberTests-232601277 None] Created reservations ['60f17da6-f980-465f-bc3a-60402c63db4b', 'e93ce6ab-34ce-453b-959f-999e4baf66f3', 'b3929008-c1da-462a-af7a-7fa5eff46f06', '0b9f3f69-f141-4f25-a605-6316540ebb04'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:43:51 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1785649d-15ed-4249-b5bb-679ee5161797 tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d.info" returned: 0 in 0.718s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:51 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-1785649d-15ed-4249-b5bb-679ee5161797 tempest-ProjectReaderTests-1784466903 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d.info is being set with open permissions: ugo+rw Jul 07 17:43:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1785649d-15ed-4249-b5bb-679ee5161797 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:51 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d.info Jul 07 17:43:51 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-188ffc5d-2e0b-4be6-b08f-3e8eed8cf876 tempest-ProjectMemberTests-232601277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-188ffc5d-2e0b-4be6-b08f-3e8eed8cf876 tempest-ProjectMemberTests-232601277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:51 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-188ffc5d-2e0b-4be6-b08f-3e8eed8cf876 tempest-ProjectMemberTests-232601277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:51 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-188ffc5d-2e0b-4be6-b08f-3e8eed8cf876 tempest-ProjectMemberTests-232601277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-188ffc5d-2e0b-4be6-b08f-3e8eed8cf876 tempest-ProjectMemberTests-232601277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-188ffc5d-2e0b-4be6-b08f-3e8eed8cf876 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:51 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:43:51 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:51 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-1785649d-15ed-4249-b5bb-679ee5161797 tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d.info" returned: 0 in 0.684s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-1785649d-15ed-4249-b5bb-679ee5161797 tempest-ProjectReaderTests-1784466903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.926s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:51 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-1785649d-15ed-4249-b5bb-679ee5161797 tempest-ProjectReaderTests-1784466903 None] Create snapshot completed successfully Jul 07 17:43:51 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-188ffc5d-2e0b-4be6-b08f-3e8eed8cf876 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.825s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:52 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-188ffc5d-2e0b-4be6-b08f-3e8eed8cf876 tempest-ProjectMemberTests-232601277 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:43:52 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-188ffc5d-2e0b-4be6-b08f-3e8eed8cf876 tempest-ProjectMemberTests-232601277 None] Deleted volume successfully. Jul 07 17:43:52 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-188ffc5d-2e0b-4be6-b08f-3e8eed8cf876 tempest-ProjectMemberTests-232601277 None] Lock "cinder-8d605a9b-41f7-4ee2-99ed-859e59aaba14-delete_volume" released by "delete_volume" :: held 2.671s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:52 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-298867b2-be95-43cc-8d1e-10dd6aa0eb89 tempest-ProjectMemberTests-232601277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:43:52 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-298867b2-be95-43cc-8d1e-10dd6aa0eb89 tempest-ProjectMemberTests-232601277 None] Flow 'volume_create_manager' (012f0fb4-d5a5-41a9-ba28-63cc198ffb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:52 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-298867b2-be95-43cc-8d1e-10dd6aa0eb89 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (429788c7-3249-4d97-82d5-c99a46015db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:52 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-298867b2-be95-43cc-8d1e-10dd6aa0eb89 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (429788c7-3249-4d97-82d5-c99a46015db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1329831210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53ed9ea2-f613-4b8e-b6a9-9966a74ce8be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='126630bddcf5433fb704f04aac171bde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:52Z,use_quota=True,user_id='f03110d4128243fca6ab7f6b4b51123a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:52 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-298867b2-be95-43cc-8d1e-10dd6aa0eb89 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cba8df5-c356-4bc9-8ecf-8731b8140a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:52 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-298867b2-be95-43cc-8d1e-10dd6aa0eb89 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cba8df5-c356-4bc9-8ecf-8731b8140a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:52 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-298867b2-be95-43cc-8d1e-10dd6aa0eb89 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59034838-397d-463b-b995-ae369de772f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:52 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-298867b2-be95-43cc-8d1e-10dd6aa0eb89 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59034838-397d-463b-b995-ae369de772f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53ed9ea2-f613-4b8e-b6a9-9966a74ce8be', 'volume_name': 'volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:52 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-298867b2-be95-43cc-8d1e-10dd6aa0eb89 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeed3d6e-9e21-458c-a5c6-f55216428e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:52 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-298867b2-be95-43cc-8d1e-10dd6aa0eb89 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeed3d6e-9e21-458c-a5c6-f55216428e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:52 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-298867b2-be95-43cc-8d1e-10dd6aa0eb89 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41f5d490-7563-492b-8755-84a88627c750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:52 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-298867b2-be95-43cc-8d1e-10dd6aa0eb89 tempest-ProjectMemberTests-232601277 None] Volume 53ed9ea2-f613-4b8e-b6a9-9966a74ce8be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be', 'volume_size': 1} Jul 07 17:43:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-298867b2-be95-43cc-8d1e-10dd6aa0eb89 tempest-ProjectMemberTests-232601277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-298867b2-be95-43cc-8d1e-10dd6aa0eb89 tempest-ProjectMemberTests-232601277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:52 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-298867b2-be95-43cc-8d1e-10dd6aa0eb89 tempest-ProjectMemberTests-232601277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1329831210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53ed9ea2-f613-4b8e-b6a9-9966a74ce8be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='126630bddcf5433fb704f04aac171bde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:52Z,use_quota=True,user_id='f03110d4128243fca6ab7f6b4b51123a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:43:52 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-298867b2-be95-43cc-8d1e-10dd6aa0eb89 tempest-ProjectMemberTests-232601277 None] Creating volume 53ed9ea2-f613-4b8e-b6a9-9966a74ce8be {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:43:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-298867b2-be95-43cc-8d1e-10dd6aa0eb89 tempest-ProjectMemberTests-232601277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-298867b2-be95-43cc-8d1e-10dd6aa0eb89 tempest-ProjectMemberTests-232601277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:52 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-298867b2-be95-43cc-8d1e-10dd6aa0eb89 tempest-ProjectMemberTests-232601277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:52 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-298867b2-be95-43cc-8d1e-10dd6aa0eb89 tempest-ProjectMemberTests-232601277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-298867b2-be95-43cc-8d1e-10dd6aa0eb89 tempest-ProjectMemberTests-232601277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:52 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-298867b2-be95-43cc-8d1e-10dd6aa0eb89 tempest-ProjectMemberTests-232601277 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:43:52 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-298867b2-be95-43cc-8d1e-10dd6aa0eb89 tempest-ProjectMemberTests-232601277 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:43:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-298867b2-be95-43cc-8d1e-10dd6aa0eb89 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:52 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3e03c932-b935-4ccf-bdfa-4928cce3c846 tempest-ProjectReaderTests-1784466903 None] Acquiring lock "cinder-dd3684a7-17c3-4679-a7f3-6c315eb350e2-delete_snapshot" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:52 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be 1073741824 Jul 07 17:43:52 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:52 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3e03c932-b935-4ccf-bdfa-4928cce3c846 tempest-ProjectReaderTests-1784466903 None] Lock "cinder-dd3684a7-17c3-4679-a7f3-6c315eb350e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:52 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3e03c932-b935-4ccf-bdfa-4928cce3c846 tempest-ProjectReaderTests-1784466903 None] Acquiring lock "cinder-quobyte-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:52 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3e03c932-b935-4ccf-bdfa-4928cce3c846 tempest-ProjectReaderTests-1784466903 None] Lock "cinder-quobyte-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:52 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3e03c932-b935-4ccf-bdfa-4928cce3c846 tempest-ProjectReaderTests-1784466903 None] Acquiring lock "cinder-quobyte-dd3684a7-17c3-4679-a7f3-6c315eb350e2" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:52 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3e03c932-b935-4ccf-bdfa-4928cce3c846 tempest-ProjectReaderTests-1784466903 None] Lock "cinder-quobyte-dd3684a7-17c3-4679-a7f3-6c315eb350e2" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:52 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-3e03c932-b935-4ccf-bdfa-4928cce3c846 tempest-ProjectReaderTests-1784466903 None] Deleting offline snapshot dd3684a7-17c3-4679-a7f3-6c315eb350e2 of volume 5a15e6a9-6e31-4c35-a438-d68bce4e7d2d {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:43:52 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-3e03c932-b935-4ccf-bdfa-4928cce3c846 tempest-ProjectReaderTests-1784466903 None] snapshot_file for this snap is: volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d.dd3684a7-17c3-4679-a7f3-6c315eb350e2 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:43:52 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7beb7a55-54c0-42b0-acf3-a558fc55df0b]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3e03c932-b935-4ccf-bdfa-4928cce3c846 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d.dd3684a7-17c3-4679-a7f3-6c315eb350e2 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:52 devstack sudo[107142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d.dd3684a7-17c3-4679-a7f3-6c315eb350e2 Jul 07 17:43:52 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:53 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-298867b2-be95-43cc-8d1e-10dd6aa0eb89 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be 1073741824" returned: 0 in 0.893s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-298867b2-be95-43cc-8d1e-10dd6aa0eb89 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:53 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3e03c932-b935-4ccf-bdfa-4928cce3c846 tempest-ProjectReaderTests-1784466903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d.dd3684a7-17c3-4679-a7f3-6c315eb350e2" returned: 0 in 0.844s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:53 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-3e03c932-b935-4ccf-bdfa-4928cce3c846 tempest-ProjectReaderTests-1784466903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:43:53 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be Jul 07 17:43:53 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:53 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6d7483-690f-45b6-a023-ef021a28e32e]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3e03c932-b935-4ccf-bdfa-4928cce3c846 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:53 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d Jul 07 17:43:53 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:53 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-298867b2-be95-43cc-8d1e-10dd6aa0eb89 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be" returned: 0 in 0.695s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:53 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-298867b2-be95-43cc-8d1e-10dd6aa0eb89 tempest-ProjectMemberTests-232601277 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:43:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-298867b2-be95-43cc-8d1e-10dd6aa0eb89 tempest-ProjectMemberTests-232601277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-298867b2-be95-43cc-8d1e-10dd6aa0eb89 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41f5d490-7563-492b-8755-84a88627c750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-298867b2-be95-43cc-8d1e-10dd6aa0eb89 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc1f9454-ad9e-486b-8acb-c91b012d6c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:53 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-298867b2-be95-43cc-8d1e-10dd6aa0eb89 tempest-ProjectMemberTests-232601277 None] Volume volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be (53ed9ea2-f613-4b8e-b6a9-9966a74ce8be): created successfully Jul 07 17:43:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-298867b2-be95-43cc-8d1e-10dd6aa0eb89 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc1f9454-ad9e-486b-8acb-c91b012d6c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:53 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-298867b2-be95-43cc-8d1e-10dd6aa0eb89 tempest-ProjectMemberTests-232601277 None] Flow 'volume_create_manager' (012f0fb4-d5a5-41a9-ba28-63cc198ffb83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:53 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-298867b2-be95-43cc-8d1e-10dd6aa0eb89 tempest-ProjectMemberTests-232601277 None] Created volume successfully. Jul 07 17:43:53 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3e03c932-b935-4ccf-bdfa-4928cce3c846 tempest-ProjectReaderTests-1784466903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d" returned: 0 in 0.794s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3e03c932-b935-4ccf-bdfa-4928cce3c846 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d.dd3684a7-17c3-4679-a7f3-6c315eb350e2 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:54 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d.dd3684a7-17c3-4679-a7f3-6c315eb350e2 Jul 07 17:43:54 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9be7080e-c437-4b5e-8b78-65ff15d410b9 tempest-ProjectMemberTests-232601277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9be7080e-c437-4b5e-8b78-65ff15d410b9 tempest-ProjectMemberTests-232601277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:54 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-9be7080e-c437-4b5e-8b78-65ff15d410b9 tempest-ProjectMemberTests-232601277 None] Creating offline snapshot 8c16349a-b44a-4979-b805-7a911faa5449 of volume 53ed9ea2-f613-4b8e-b6a9-9966a74ce8be {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:43:54 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8651768-dcbe-4799-bb94-717f534e59d1]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9be7080e-c437-4b5e-8b78-65ff15d410b9 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:54 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be Jul 07 17:43:54 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:54 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3e03c932-b935-4ccf-bdfa-4928cce3c846 tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d.dd3684a7-17c3-4679-a7f3-6c315eb350e2" returned: 0 in 0.771s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3e03c932-b935-4ccf-bdfa-4928cce3c846 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d.dd3684a7-17c3-4679-a7f3-6c315eb350e2 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:54 devstack sudo[107165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d.dd3684a7-17c3-4679-a7f3-6c315eb350e2 Jul 07 17:43:54 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:55 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9be7080e-c437-4b5e-8b78-65ff15d410b9 tempest-ProjectMemberTests-232601277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be" returned: 0 in 0.758s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9be7080e-c437-4b5e-8b78-65ff15d410b9 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be.8c16349a-b44a-4979-b805-7a911faa5449 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:55 devstack sudo[107170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be.8c16349a-b44a-4979-b805-7a911faa5449 1G Jul 07 17:43:55 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:55 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3e03c932-b935-4ccf-bdfa-4928cce3c846 tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d.dd3684a7-17c3-4679-a7f3-6c315eb350e2" returned: 0 in 0.706s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:55 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3e03c932-b935-4ccf-bdfa-4928cce3c846 tempest-ProjectReaderTests-1784466903 None] Lock "cinder-quobyte-dd3684a7-17c3-4679-a7f3-6c315eb350e2" released by "_delete_snapshot" :: held 3.216s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:55 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3e03c932-b935-4ccf-bdfa-4928cce3c846 tempest-ProjectReaderTests-1784466903 None] Lock "cinder-quobyte-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d" released by "delete_snapshot" :: held 3.244s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:55 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-3e03c932-b935-4ccf-bdfa-4928cce3c846 tempest-ProjectReaderTests-1784466903 None] Created reservations ['9de530d3-371f-4900-8385-09809dc8818c', '4be3e9af-f0f7-49ca-809a-b64b7f35b5f4', '8c880657-520c-435d-9722-8ffbfc152c8b', 'c8b57bc2-e975-4cf9-a468-07b1eba05ed3'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:43:55 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-3e03c932-b935-4ccf-bdfa-4928cce3c846 tempest-ProjectReaderTests-1784466903 None] Delete snapshot completed successfully. Jul 07 17:43:55 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3e03c932-b935-4ccf-bdfa-4928cce3c846 tempest-ProjectReaderTests-1784466903 None] Lock "cinder-dd3684a7-17c3-4679-a7f3-6c315eb350e2-delete_snapshot" released by "delete_snapshot" :: held 3.395s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:55 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9be7080e-c437-4b5e-8b78-65ff15d410b9 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be.8c16349a-b44a-4979-b805-7a911faa5449 1G" returned: 0 in 0.809s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9be7080e-c437-4b5e-8b78-65ff15d410b9 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be.8c16349a-b44a-4979-b805-7a911faa5449 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:55 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be.8c16349a-b44a-4979-b805-7a911faa5449 Jul 07 17:43:55 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:56 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-374b44df-d1e0-41a9-9700-1a67dc1a12a8 tempest-ProjectReaderTests-1784466903 None] Acquiring lock "cinder-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:56 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-374b44df-d1e0-41a9-9700-1a67dc1a12a8 tempest-ProjectReaderTests-1784466903 None] Lock "cinder-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:56 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-374b44df-d1e0-41a9-9700-1a67dc1a12a8 tempest-ProjectReaderTests-1784466903 None] Acquiring lock "cinder-quobyte-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:56 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-374b44df-d1e0-41a9-9700-1a67dc1a12a8 tempest-ProjectReaderTests-1784466903 None] Lock "cinder-quobyte-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d" acquired by "delete_volume" :: waited 0.018s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:56 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d799c3-8a68-4278-8024-ba35b7141d9b]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-374b44df-d1e0-41a9-9700-1a67dc1a12a8 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:56 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9be7080e-c437-4b5e-8b78-65ff15d410b9 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be.8c16349a-b44a-4979-b805-7a911faa5449" returned: 0 in 0.696s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:56 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-9be7080e-c437-4b5e-8b78-65ff15d410b9 tempest-ProjectMemberTests-232601277 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be.8c16349a-b44a-4979-b805-7a911faa5449 is being set with open permissions: ugo+rw Jul 07 17:43:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9be7080e-c437-4b5e-8b78-65ff15d410b9 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be.8c16349a-b44a-4979-b805-7a911faa5449 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:56 devstack sudo[107183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be.8c16349a-b44a-4979-b805-7a911faa5449 Jul 07 17:43:56 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:56 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d Jul 07 17:43:56 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:57 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9be7080e-c437-4b5e-8b78-65ff15d410b9 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be.8c16349a-b44a-4979-b805-7a911faa5449" returned: 0 in 0.703s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9be7080e-c437-4b5e-8b78-65ff15d410b9 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:57 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be.info Jul 07 17:43:57 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:57 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-374b44df-d1e0-41a9-9700-1a67dc1a12a8 tempest-ProjectReaderTests-1784466903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d" returned: 0 in 0.848s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-374b44df-d1e0-41a9-9700-1a67dc1a12a8 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:57 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d Jul 07 17:43:57 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:58 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:58 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-374b44df-d1e0-41a9-9700-1a67dc1a12a8 tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d" returned: 0 in 0.627s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9be7080e-c437-4b5e-8b78-65ff15d410b9 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be.info" returned: 0 in 0.683s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:58 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-9be7080e-c437-4b5e-8b78-65ff15d410b9 tempest-ProjectMemberTests-232601277 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be.info is being set with open permissions: ugo+rw Jul 07 17:43:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9be7080e-c437-4b5e-8b78-65ff15d410b9 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:58 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-374b44df-d1e0-41a9-9700-1a67dc1a12a8 tempest-ProjectReaderTests-1784466903 None] Lock "cinder-quobyte-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d" released by "delete_volume" :: held 1.549s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:58 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be.info Jul 07 17:43:58 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:58 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-374b44df-d1e0-41a9-9700-1a67dc1a12a8 tempest-ProjectReaderTests-1784466903 None] Created reservations ['4326b15c-b2ff-471c-bea7-3032a888f748', 'b5c30714-7c11-491a-b92f-029912b0aa67', '67b8492b-5b42-4dcf-8bf7-df82c4520de0', 'a878b12e-7062-46c9-a134-e5b164c9fbf0'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:43:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-374b44df-d1e0-41a9-9700-1a67dc1a12a8 tempest-ProjectReaderTests-1784466903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-374b44df-d1e0-41a9-9700-1a67dc1a12a8 tempest-ProjectReaderTests-1784466903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:58 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-374b44df-d1e0-41a9-9700-1a67dc1a12a8 tempest-ProjectReaderTests-1784466903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:58 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-374b44df-d1e0-41a9-9700-1a67dc1a12a8 tempest-ProjectReaderTests-1784466903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-374b44df-d1e0-41a9-9700-1a67dc1a12a8 tempest-ProjectReaderTests-1784466903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-374b44df-d1e0-41a9-9700-1a67dc1a12a8 tempest-ProjectReaderTests-1784466903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:58 devstack sudo[107198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:43:58 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:58 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9be7080e-c437-4b5e-8b78-65ff15d410b9 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be.info" returned: 0 in 0.685s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9be7080e-c437-4b5e-8b78-65ff15d410b9 tempest-ProjectMemberTests-232601277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.429s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:58 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-9be7080e-c437-4b5e-8b78-65ff15d410b9 tempest-ProjectMemberTests-232601277 None] Create snapshot completed successfully Jul 07 17:43:58 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-374b44df-d1e0-41a9-9700-1a67dc1a12a8 tempest-ProjectReaderTests-1784466903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.711s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:58 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-374b44df-d1e0-41a9-9700-1a67dc1a12a8 tempest-ProjectReaderTests-1784466903 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:43:58 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-374b44df-d1e0-41a9-9700-1a67dc1a12a8 tempest-ProjectReaderTests-1784466903 None] Deleted volume successfully. Jul 07 17:43:58 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-374b44df-d1e0-41a9-9700-1a67dc1a12a8 tempest-ProjectReaderTests-1784466903 None] Lock "cinder-5a15e6a9-6e31-4c35-a438-d68bce4e7d2d-delete_volume" released by "delete_volume" :: held 2.481s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:59 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3f66a32c-4f94-411a-aa88-b2fec855179d tempest-ProjectMemberTests-232601277 None] Acquiring lock "cinder-8c16349a-b44a-4979-b805-7a911faa5449-delete_snapshot" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:59 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3f66a32c-4f94-411a-aa88-b2fec855179d tempest-ProjectMemberTests-232601277 None] Lock "cinder-8c16349a-b44a-4979-b805-7a911faa5449-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:59 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3f66a32c-4f94-411a-aa88-b2fec855179d tempest-ProjectMemberTests-232601277 None] Acquiring lock "cinder-quobyte-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:59 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3f66a32c-4f94-411a-aa88-b2fec855179d tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:59 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3f66a32c-4f94-411a-aa88-b2fec855179d tempest-ProjectMemberTests-232601277 None] Acquiring lock "cinder-quobyte-8c16349a-b44a-4979-b805-7a911faa5449" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:59 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3f66a32c-4f94-411a-aa88-b2fec855179d tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-8c16349a-b44a-4979-b805-7a911faa5449" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:59 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-3f66a32c-4f94-411a-aa88-b2fec855179d tempest-ProjectMemberTests-232601277 None] Deleting offline snapshot 8c16349a-b44a-4979-b805-7a911faa5449 of volume 53ed9ea2-f613-4b8e-b6a9-9966a74ce8be {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:43:59 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-3f66a32c-4f94-411a-aa88-b2fec855179d tempest-ProjectMemberTests-232601277 None] snapshot_file for this snap is: volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be.8c16349a-b44a-4979-b805-7a911faa5449 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:43:59 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[981f7772-8c48-41bf-94f2-162ca9ae0fdd]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3f66a32c-4f94-411a-aa88-b2fec855179d tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be.8c16349a-b44a-4979-b805-7a911faa5449 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:59 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be.8c16349a-b44a-4979-b805-7a911faa5449 Jul 07 17:43:59 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:00 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3f66a32c-4f94-411a-aa88-b2fec855179d tempest-ProjectMemberTests-232601277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be.8c16349a-b44a-4979-b805-7a911faa5449" returned: 0 in 0.850s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:00 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-3f66a32c-4f94-411a-aa88-b2fec855179d tempest-ProjectMemberTests-232601277 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:44:00 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[24611acd-0ce8-492e-9256-6c598ec71fee]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:00 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3f66a32c-4f94-411a-aa88-b2fec855179d tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:00 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be Jul 07 17:44:00 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:01 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3f66a32c-4f94-411a-aa88-b2fec855179d tempest-ProjectMemberTests-232601277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be" returned: 0 in 0.784s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:01 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3f66a32c-4f94-411a-aa88-b2fec855179d tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be.8c16349a-b44a-4979-b805-7a911faa5449 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:01 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be.8c16349a-b44a-4979-b805-7a911faa5449 Jul 07 17:44:01 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:02 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3f66a32c-4f94-411a-aa88-b2fec855179d tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be.8c16349a-b44a-4979-b805-7a911faa5449" returned: 0 in 0.770s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3f66a32c-4f94-411a-aa88-b2fec855179d tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be.8c16349a-b44a-4979-b805-7a911faa5449 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:02 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be.8c16349a-b44a-4979-b805-7a911faa5449 Jul 07 17:44:02 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:02 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:02 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-3f66a32c-4f94-411a-aa88-b2fec855179d tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be.8c16349a-b44a-4979-b805-7a911faa5449" returned: 0 in 0.691s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:02 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3f66a32c-4f94-411a-aa88-b2fec855179d tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-8c16349a-b44a-4979-b805-7a911faa5449" released by "_delete_snapshot" :: held 3.199s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:02 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3f66a32c-4f94-411a-aa88-b2fec855179d tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be" released by "delete_snapshot" :: held 3.223s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:02 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-3f66a32c-4f94-411a-aa88-b2fec855179d tempest-ProjectMemberTests-232601277 None] Created reservations ['22a5b090-7493-4052-9578-6d0aaa052b77', '1f8a099f-8539-4f2d-97b1-225426ca97ab', '351049f8-ad5f-4442-8317-2997af5be76c', 'bbca5d4f-b4ad-495c-991c-36b28ddc961a'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:44:02 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-3f66a32c-4f94-411a-aa88-b2fec855179d tempest-ProjectMemberTests-232601277 None] Delete snapshot completed successfully. Jul 07 17:44:02 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-3f66a32c-4f94-411a-aa88-b2fec855179d tempest-ProjectMemberTests-232601277 None] Lock "cinder-8c16349a-b44a-4979-b805-7a911faa5449-delete_snapshot" released by "delete_snapshot" :: held 3.360s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:03 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-60415e5a-3500-4ccc-9238-d83578a11dbd tempest-ProjectMemberTests-232601277 None] Acquiring lock "cinder-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:03 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-60415e5a-3500-4ccc-9238-d83578a11dbd tempest-ProjectMemberTests-232601277 None] Lock "cinder-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:03 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-60415e5a-3500-4ccc-9238-d83578a11dbd tempest-ProjectMemberTests-232601277 None] Acquiring lock "cinder-quobyte-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:03 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-60415e5a-3500-4ccc-9238-d83578a11dbd tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be" acquired by "delete_volume" :: waited 0.015s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:03 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[90abcd54-255d-4b09-941f-aaaa491a81ce]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:03 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-60415e5a-3500-4ccc-9238-d83578a11dbd tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:04 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be Jul 07 17:44:04 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:04 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-60415e5a-3500-4ccc-9238-d83578a11dbd tempest-ProjectMemberTests-232601277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be" returned: 0 in 0.798s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:04 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-60415e5a-3500-4ccc-9238-d83578a11dbd tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:04 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be Jul 07 17:44:04 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:05 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-60415e5a-3500-4ccc-9238-d83578a11dbd tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be" returned: 0 in 0.668s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:05 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-60415e5a-3500-4ccc-9238-d83578a11dbd tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be" released by "delete_volume" :: held 1.524s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:05 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-60415e5a-3500-4ccc-9238-d83578a11dbd tempest-ProjectMemberTests-232601277 None] Created reservations ['b9c9bfb3-342b-4b70-8c4e-bd0a7fdc4bc5', '58c61553-2f82-4485-b71a-371c5151abea', '470906a1-aa67-4c6d-ba20-1427fb684b97', 'a0931dbb-588a-468f-9616-c8753f44eea9'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:44:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-60415e5a-3500-4ccc-9238-d83578a11dbd tempest-ProjectMemberTests-232601277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-60415e5a-3500-4ccc-9238-d83578a11dbd tempest-ProjectMemberTests-232601277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:05 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-60415e5a-3500-4ccc-9238-d83578a11dbd tempest-ProjectMemberTests-232601277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:05 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-60415e5a-3500-4ccc-9238-d83578a11dbd tempest-ProjectMemberTests-232601277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-60415e5a-3500-4ccc-9238-d83578a11dbd tempest-ProjectMemberTests-232601277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:05 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-60415e5a-3500-4ccc-9238-d83578a11dbd tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:05 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:44:05 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:06 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-60415e5a-3500-4ccc-9238-d83578a11dbd tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.731s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:06 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-60415e5a-3500-4ccc-9238-d83578a11dbd tempest-ProjectMemberTests-232601277 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:44:06 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-60415e5a-3500-4ccc-9238-d83578a11dbd tempest-ProjectMemberTests-232601277 None] Deleted volume successfully. Jul 07 17:44:06 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-60415e5a-3500-4ccc-9238-d83578a11dbd tempest-ProjectMemberTests-232601277 None] Lock "cinder-53ed9ea2-f613-4b8e-b6a9-9966a74ce8be-delete_volume" released by "delete_volume" :: held 2.473s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:06 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-56017610-070e-4f53-bfd6-1ccf393e52d1 tempest-ProjectMemberTests-232601277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:44:06 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-56017610-070e-4f53-bfd6-1ccf393e52d1 tempest-ProjectMemberTests-232601277 None] Flow 'volume_create_manager' (1867fa29-b1bb-4bdf-bb08-e3258ad4d0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:44:06 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-56017610-070e-4f53-bfd6-1ccf393e52d1 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e80da24f-7005-4d08-bed8-cad56e7512df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:06 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-56017610-070e-4f53-bfd6-1ccf393e52d1 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e80da24f-7005-4d08-bed8-cad56e7512df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1742951118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36088b53-4886-4ede-abbc-c3b7c3fb1d93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='126630bddcf5433fb704f04aac171bde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:44:07Z,use_quota=True,user_id='f03110d4128243fca6ab7f6b4b51123a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:06 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-56017610-070e-4f53-bfd6-1ccf393e52d1 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9233c3d7-7f76-4e12-946e-a81463a970d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:06 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-56017610-070e-4f53-bfd6-1ccf393e52d1 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9233c3d7-7f76-4e12-946e-a81463a970d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:06 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-56017610-070e-4f53-bfd6-1ccf393e52d1 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b519e07a-0eb1-47a2-811a-1b5e69834726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:06 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-56017610-070e-4f53-bfd6-1ccf393e52d1 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b519e07a-0eb1-47a2-811a-1b5e69834726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36088b53-4886-4ede-abbc-c3b7c3fb1d93', 'volume_name': 'volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:06 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-56017610-070e-4f53-bfd6-1ccf393e52d1 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6244507a-c214-457b-b376-31197459b960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:06 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-56017610-070e-4f53-bfd6-1ccf393e52d1 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6244507a-c214-457b-b376-31197459b960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:06 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-56017610-070e-4f53-bfd6-1ccf393e52d1 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dbfa91c-3674-45cb-be52-f87c5c187d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:06 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-56017610-070e-4f53-bfd6-1ccf393e52d1 tempest-ProjectMemberTests-232601277 None] Volume 36088b53-4886-4ede-abbc-c3b7c3fb1d93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93', 'volume_size': 1} Jul 07 17:44:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-56017610-070e-4f53-bfd6-1ccf393e52d1 tempest-ProjectMemberTests-232601277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-56017610-070e-4f53-bfd6-1ccf393e52d1 tempest-ProjectMemberTests-232601277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:06 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-56017610-070e-4f53-bfd6-1ccf393e52d1 tempest-ProjectMemberTests-232601277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1742951118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36088b53-4886-4ede-abbc-c3b7c3fb1d93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='126630bddcf5433fb704f04aac171bde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:44:07Z,use_quota=True,user_id='f03110d4128243fca6ab7f6b4b51123a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:44:06 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-56017610-070e-4f53-bfd6-1ccf393e52d1 tempest-ProjectMemberTests-232601277 None] Creating volume 36088b53-4886-4ede-abbc-c3b7c3fb1d93 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:44:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-56017610-070e-4f53-bfd6-1ccf393e52d1 tempest-ProjectMemberTests-232601277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-56017610-070e-4f53-bfd6-1ccf393e52d1 tempest-ProjectMemberTests-232601277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:06 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-56017610-070e-4f53-bfd6-1ccf393e52d1 tempest-ProjectMemberTests-232601277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:06 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-56017610-070e-4f53-bfd6-1ccf393e52d1 tempest-ProjectMemberTests-232601277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-56017610-070e-4f53-bfd6-1ccf393e52d1 tempest-ProjectMemberTests-232601277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:06 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-56017610-070e-4f53-bfd6-1ccf393e52d1 tempest-ProjectMemberTests-232601277 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:44:06 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-56017610-070e-4f53-bfd6-1ccf393e52d1 tempest-ProjectMemberTests-232601277 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:44:06 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-56017610-070e-4f53-bfd6-1ccf393e52d1 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:06 devstack sudo[107234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93 1073741824 Jul 07 17:44:06 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:07 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-56017610-070e-4f53-bfd6-1ccf393e52d1 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93 1073741824" returned: 0 in 0.874s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:07 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-56017610-070e-4f53-bfd6-1ccf393e52d1 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:07 devstack sudo[107240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93 Jul 07 17:44:07 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:08 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-56017610-070e-4f53-bfd6-1ccf393e52d1 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93" returned: 0 in 0.639s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:08 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-56017610-070e-4f53-bfd6-1ccf393e52d1 tempest-ProjectMemberTests-232601277 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:44:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-56017610-070e-4f53-bfd6-1ccf393e52d1 tempest-ProjectMemberTests-232601277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:08 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-56017610-070e-4f53-bfd6-1ccf393e52d1 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dbfa91c-3674-45cb-be52-f87c5c187d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:08 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-56017610-070e-4f53-bfd6-1ccf393e52d1 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa756e54-34d9-46f0-a5cf-590159456b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:08 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-56017610-070e-4f53-bfd6-1ccf393e52d1 tempest-ProjectMemberTests-232601277 None] Volume volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93 (36088b53-4886-4ede-abbc-c3b7c3fb1d93): created successfully Jul 07 17:44:08 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-56017610-070e-4f53-bfd6-1ccf393e52d1 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa756e54-34d9-46f0-a5cf-590159456b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:08 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-56017610-070e-4f53-bfd6-1ccf393e52d1 tempest-ProjectMemberTests-232601277 None] Flow 'volume_create_manager' (1867fa29-b1bb-4bdf-bb08-e3258ad4d0b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:44:08 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-56017610-070e-4f53-bfd6-1ccf393e52d1 tempest-ProjectMemberTests-232601277 None] Created volume successfully. Jul 07 17:44:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-37f1fbb9-c962-4c8f-b5f4-1f0630750b3b tempest-ProjectMemberTests-232601277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-37f1fbb9-c962-4c8f-b5f4-1f0630750b3b tempest-ProjectMemberTests-232601277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:08 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-37f1fbb9-c962-4c8f-b5f4-1f0630750b3b tempest-ProjectMemberTests-232601277 None] Creating offline snapshot 96bfcb20-cdf6-4b5a-be1d-85c4ebf5b762 of volume 36088b53-4886-4ede-abbc-c3b7c3fb1d93 {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:44:08 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48456a5-03f4-4898-bbab-74500f28d515]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:08 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-37f1fbb9-c962-4c8f-b5f4-1f0630750b3b tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:09 devstack sudo[107243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93 Jul 07 17:44:09 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:09 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-37f1fbb9-c962-4c8f-b5f4-1f0630750b3b tempest-ProjectMemberTests-232601277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93" returned: 0 in 0.821s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:09 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-37f1fbb9-c962-4c8f-b5f4-1f0630750b3b tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93.96bfcb20-cdf6-4b5a-be1d-85c4ebf5b762 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:09 devstack sudo[107248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93.96bfcb20-cdf6-4b5a-be1d-85c4ebf5b762 1G Jul 07 17:44:09 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:10 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-37f1fbb9-c962-4c8f-b5f4-1f0630750b3b tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93.96bfcb20-cdf6-4b5a-be1d-85c4ebf5b762 1G" returned: 0 in 0.916s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:10 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-37f1fbb9-c962-4c8f-b5f4-1f0630750b3b tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93.96bfcb20-cdf6-4b5a-be1d-85c4ebf5b762 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:10 devstack sudo[107254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93.96bfcb20-cdf6-4b5a-be1d-85c4ebf5b762 Jul 07 17:44:10 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:11 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-37f1fbb9-c962-4c8f-b5f4-1f0630750b3b tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93.96bfcb20-cdf6-4b5a-be1d-85c4ebf5b762" returned: 0 in 0.743s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:11 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-37f1fbb9-c962-4c8f-b5f4-1f0630750b3b tempest-ProjectMemberTests-232601277 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93.96bfcb20-cdf6-4b5a-be1d-85c4ebf5b762 is being set with open permissions: ugo+rw Jul 07 17:44:11 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-37f1fbb9-c962-4c8f-b5f4-1f0630750b3b tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93.96bfcb20-cdf6-4b5a-be1d-85c4ebf5b762 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:11 devstack sudo[107261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93.96bfcb20-cdf6-4b5a-be1d-85c4ebf5b762 Jul 07 17:44:11 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:12 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-37f1fbb9-c962-4c8f-b5f4-1f0630750b3b tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93.96bfcb20-cdf6-4b5a-be1d-85c4ebf5b762" returned: 0 in 0.723s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-37f1fbb9-c962-4c8f-b5f4-1f0630750b3b tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:12 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93.info Jul 07 17:44:12 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:12 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-37f1fbb9-c962-4c8f-b5f4-1f0630750b3b tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93.info" returned: 0 in 0.720s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:12 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-37f1fbb9-c962-4c8f-b5f4-1f0630750b3b tempest-ProjectMemberTests-232601277 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93.info is being set with open permissions: ugo+rw Jul 07 17:44:12 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-37f1fbb9-c962-4c8f-b5f4-1f0630750b3b tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:12 devstack sudo[107267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93.info Jul 07 17:44:12 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:13 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-37f1fbb9-c962-4c8f-b5f4-1f0630750b3b tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93.info" returned: 0 in 0.773s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:13 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-37f1fbb9-c962-4c8f-b5f4-1f0630750b3b tempest-ProjectMemberTests-232601277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.782s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:13 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-37f1fbb9-c962-4c8f-b5f4-1f0630750b3b tempest-ProjectMemberTests-232601277 None] Create snapshot completed successfully Jul 07 17:44:14 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6cc6dec9-7d22-4ca4-805b-c3ac16f6ad73 tempest-ProjectMemberTests-232601277 None] Acquiring lock "cinder-96bfcb20-cdf6-4b5a-be1d-85c4ebf5b762-delete_snapshot" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:14 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6cc6dec9-7d22-4ca4-805b-c3ac16f6ad73 tempest-ProjectMemberTests-232601277 None] Lock "cinder-96bfcb20-cdf6-4b5a-be1d-85c4ebf5b762-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:14 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6cc6dec9-7d22-4ca4-805b-c3ac16f6ad73 tempest-ProjectMemberTests-232601277 None] Acquiring lock "cinder-quobyte-36088b53-4886-4ede-abbc-c3b7c3fb1d93" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:14 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6cc6dec9-7d22-4ca4-805b-c3ac16f6ad73 tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-36088b53-4886-4ede-abbc-c3b7c3fb1d93" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:14 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6cc6dec9-7d22-4ca4-805b-c3ac16f6ad73 tempest-ProjectMemberTests-232601277 None] Acquiring lock "cinder-quobyte-96bfcb20-cdf6-4b5a-be1d-85c4ebf5b762" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:14 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6cc6dec9-7d22-4ca4-805b-c3ac16f6ad73 tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-96bfcb20-cdf6-4b5a-be1d-85c4ebf5b762" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:14 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-6cc6dec9-7d22-4ca4-805b-c3ac16f6ad73 tempest-ProjectMemberTests-232601277 None] Deleting offline snapshot 96bfcb20-cdf6-4b5a-be1d-85c4ebf5b762 of volume 36088b53-4886-4ede-abbc-c3b7c3fb1d93 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:44:14 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-6cc6dec9-7d22-4ca4-805b-c3ac16f6ad73 tempest-ProjectMemberTests-232601277 None] snapshot_file for this snap is: volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93.96bfcb20-cdf6-4b5a-be1d-85c4ebf5b762 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:44:14 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e215d86-f886-4d85-af5a-c88dbfb7b651]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:14 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6cc6dec9-7d22-4ca4-805b-c3ac16f6ad73 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93.96bfcb20-cdf6-4b5a-be1d-85c4ebf5b762 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:14 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93.96bfcb20-cdf6-4b5a-be1d-85c4ebf5b762 Jul 07 17:44:14 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:15 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6cc6dec9-7d22-4ca4-805b-c3ac16f6ad73 tempest-ProjectMemberTests-232601277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93.96bfcb20-cdf6-4b5a-be1d-85c4ebf5b762" returned: 0 in 0.818s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:15 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-6cc6dec9-7d22-4ca4-805b-c3ac16f6ad73 tempest-ProjectMemberTests-232601277 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:44:15 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[604d3e1d-3b5e-4dbd-9fe6-12616acd14da]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:15 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6cc6dec9-7d22-4ca4-805b-c3ac16f6ad73 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:15 devstack sudo[107275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93 Jul 07 17:44:15 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:16 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6cc6dec9-7d22-4ca4-805b-c3ac16f6ad73 tempest-ProjectMemberTests-232601277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93" returned: 0 in 0.839s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6cc6dec9-7d22-4ca4-805b-c3ac16f6ad73 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93.96bfcb20-cdf6-4b5a-be1d-85c4ebf5b762 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:16 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93.96bfcb20-cdf6-4b5a-be1d-85c4ebf5b762 Jul 07 17:44:16 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:16 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6cc6dec9-7d22-4ca4-805b-c3ac16f6ad73 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93.96bfcb20-cdf6-4b5a-be1d-85c4ebf5b762" returned: 0 in 0.856s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:16 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6cc6dec9-7d22-4ca4-805b-c3ac16f6ad73 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93.96bfcb20-cdf6-4b5a-be1d-85c4ebf5b762 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:16 devstack sudo[107286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93.96bfcb20-cdf6-4b5a-be1d-85c4ebf5b762 Jul 07 17:44:16 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:17 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:17 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6cc6dec9-7d22-4ca4-805b-c3ac16f6ad73 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93.96bfcb20-cdf6-4b5a-be1d-85c4ebf5b762" returned: 0 in 0.695s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:17 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6cc6dec9-7d22-4ca4-805b-c3ac16f6ad73 tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-96bfcb20-cdf6-4b5a-be1d-85c4ebf5b762" released by "_delete_snapshot" :: held 3.309s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:17 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6cc6dec9-7d22-4ca4-805b-c3ac16f6ad73 tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-36088b53-4886-4ede-abbc-c3b7c3fb1d93" released by "delete_snapshot" :: held 3.333s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:17 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-6cc6dec9-7d22-4ca4-805b-c3ac16f6ad73 tempest-ProjectMemberTests-232601277 None] Created reservations ['3667e064-ab41-407a-8882-fec9a46082f0', 'a11d9469-e7b5-4e77-9d19-8118e6a19ac4', '3a938c07-ccb0-4313-a9de-f9ef2b8752a8', 'fb197a62-5851-47af-9f03-0a9779b20d3b'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:44:17 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-6cc6dec9-7d22-4ca4-805b-c3ac16f6ad73 tempest-ProjectMemberTests-232601277 None] Delete snapshot completed successfully. Jul 07 17:44:17 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6cc6dec9-7d22-4ca4-805b-c3ac16f6ad73 tempest-ProjectMemberTests-232601277 None] Lock "cinder-96bfcb20-cdf6-4b5a-be1d-85c4ebf5b762-delete_snapshot" released by "delete_snapshot" :: held 3.491s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:18 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-f903b109-fd22-4355-9373-867c6e717c9b tempest-ProjectMemberTests-232601277 None] Acquiring lock "cinder-36088b53-4886-4ede-abbc-c3b7c3fb1d93-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:18 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-f903b109-fd22-4355-9373-867c6e717c9b tempest-ProjectMemberTests-232601277 None] Lock "cinder-36088b53-4886-4ede-abbc-c3b7c3fb1d93-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:18 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-f903b109-fd22-4355-9373-867c6e717c9b tempest-ProjectMemberTests-232601277 None] Acquiring lock "cinder-quobyte-36088b53-4886-4ede-abbc-c3b7c3fb1d93" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:18 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-f903b109-fd22-4355-9373-867c6e717c9b tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-36088b53-4886-4ede-abbc-c3b7c3fb1d93" acquired by "delete_volume" :: waited 0.021s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:18 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[166f2733-9e03-42a0-ace7-047a5fc2b428]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:18 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f903b109-fd22-4355-9373-867c6e717c9b tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:18 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93 Jul 07 17:44:18 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:19 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f903b109-fd22-4355-9373-867c6e717c9b tempest-ProjectMemberTests-232601277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93" returned: 0 in 0.873s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:19 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f903b109-fd22-4355-9373-867c6e717c9b tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:19 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93 Jul 07 17:44:19 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:20 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f903b109-fd22-4355-9373-867c6e717c9b tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-36088b53-4886-4ede-abbc-c3b7c3fb1d93" returned: 0 in 0.729s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:20 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-f903b109-fd22-4355-9373-867c6e717c9b tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-36088b53-4886-4ede-abbc-c3b7c3fb1d93" released by "delete_volume" :: held 1.671s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:20 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-f903b109-fd22-4355-9373-867c6e717c9b tempest-ProjectMemberTests-232601277 None] Created reservations ['86b12563-2d1a-4a10-ad75-59bac751ae3c', 'cee3cafc-316d-44b9-999f-24a603c33dbf', 'dfdef600-27b8-4138-8f0a-e50aa967a921', '3d94e8c3-d098-4516-a1fa-ddc80d11cb41'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:44:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f903b109-fd22-4355-9373-867c6e717c9b tempest-ProjectMemberTests-232601277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f903b109-fd22-4355-9373-867c6e717c9b tempest-ProjectMemberTests-232601277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:20 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-f903b109-fd22-4355-9373-867c6e717c9b tempest-ProjectMemberTests-232601277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:20 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-f903b109-fd22-4355-9373-867c6e717c9b tempest-ProjectMemberTests-232601277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f903b109-fd22-4355-9373-867c6e717c9b tempest-ProjectMemberTests-232601277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:20 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f903b109-fd22-4355-9373-867c6e717c9b tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:20 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:44:20 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:21 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f903b109-fd22-4355-9373-867c6e717c9b tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.718s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:21 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-f903b109-fd22-4355-9373-867c6e717c9b tempest-ProjectMemberTests-232601277 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:44:21 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-f903b109-fd22-4355-9373-867c6e717c9b tempest-ProjectMemberTests-232601277 None] Deleted volume successfully. Jul 07 17:44:21 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-f903b109-fd22-4355-9373-867c6e717c9b tempest-ProjectMemberTests-232601277 None] Lock "cinder-36088b53-4886-4ede-abbc-c3b7c3fb1d93-delete_volume" released by "delete_volume" :: held 2.622s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:21 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc7aff99-6543-4449-9977-388ddd8eac46 tempest-ProjectMemberTests-232601277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:44:21 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-dc7aff99-6543-4449-9977-388ddd8eac46 tempest-ProjectMemberTests-232601277 None] Flow 'volume_create_manager' (894148d7-3f73-46bf-9fa6-8e834b861e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:44:21 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-dc7aff99-6543-4449-9977-388ddd8eac46 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5a47352-bb46-4ed6-8817-96f0d966d297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:21 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-dc7aff99-6543-4449-9977-388ddd8eac46 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5a47352-bb46-4ed6-8817-96f0d966d297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1138217968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e91fdc5-a4f3-4163-a300-77faf8ddae79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='126630bddcf5433fb704f04aac171bde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:44:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:44:21Z,use_quota=True,user_id='f03110d4128243fca6ab7f6b4b51123a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:21 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-dc7aff99-6543-4449-9977-388ddd8eac46 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1cf8db3-3d95-426d-b631-d7c4f9dca6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:21 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-dc7aff99-6543-4449-9977-388ddd8eac46 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1cf8db3-3d95-426d-b631-d7c4f9dca6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:21 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-dc7aff99-6543-4449-9977-388ddd8eac46 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d37efcae-2144-43b3-b0ac-5f7190f4790a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:21 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-dc7aff99-6543-4449-9977-388ddd8eac46 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d37efcae-2144-43b3-b0ac-5f7190f4790a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e91fdc5-a4f3-4163-a300-77faf8ddae79', 'volume_name': 'volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:21 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-dc7aff99-6543-4449-9977-388ddd8eac46 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffe311a1-2b3c-48a5-b432-1b4f5db95f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:21 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-dc7aff99-6543-4449-9977-388ddd8eac46 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffe311a1-2b3c-48a5-b432-1b4f5db95f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:21 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-dc7aff99-6543-4449-9977-388ddd8eac46 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81e1718c-87ca-4568-bb46-2406ecf806ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:21 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-dc7aff99-6543-4449-9977-388ddd8eac46 tempest-ProjectMemberTests-232601277 None] Volume 3e91fdc5-a4f3-4163-a300-77faf8ddae79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79', 'volume_size': 1} Jul 07 17:44:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-dc7aff99-6543-4449-9977-388ddd8eac46 tempest-ProjectMemberTests-232601277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-dc7aff99-6543-4449-9977-388ddd8eac46 tempest-ProjectMemberTests-232601277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:21 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-dc7aff99-6543-4449-9977-388ddd8eac46 tempest-ProjectMemberTests-232601277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1138217968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e91fdc5-a4f3-4163-a300-77faf8ddae79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='126630bddcf5433fb704f04aac171bde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:44:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:44:21Z,use_quota=True,user_id='f03110d4128243fca6ab7f6b4b51123a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:44:21 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-dc7aff99-6543-4449-9977-388ddd8eac46 tempest-ProjectMemberTests-232601277 None] Creating volume 3e91fdc5-a4f3-4163-a300-77faf8ddae79 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:44:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-dc7aff99-6543-4449-9977-388ddd8eac46 tempest-ProjectMemberTests-232601277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-dc7aff99-6543-4449-9977-388ddd8eac46 tempest-ProjectMemberTests-232601277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:21 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-dc7aff99-6543-4449-9977-388ddd8eac46 tempest-ProjectMemberTests-232601277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:21 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-dc7aff99-6543-4449-9977-388ddd8eac46 tempest-ProjectMemberTests-232601277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-dc7aff99-6543-4449-9977-388ddd8eac46 tempest-ProjectMemberTests-232601277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:21 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-dc7aff99-6543-4449-9977-388ddd8eac46 tempest-ProjectMemberTests-232601277 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:44:21 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-dc7aff99-6543-4449-9977-388ddd8eac46 tempest-ProjectMemberTests-232601277 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:44:21 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-dc7aff99-6543-4449-9977-388ddd8eac46 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:21 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79 1073741824 Jul 07 17:44:21 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:22 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-dc7aff99-6543-4449-9977-388ddd8eac46 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79 1073741824" returned: 0 in 0.940s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:22 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-dc7aff99-6543-4449-9977-388ddd8eac46 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:22 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79 Jul 07 17:44:22 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:23 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-dc7aff99-6543-4449-9977-388ddd8eac46 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79" returned: 0 in 0.677s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:23 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-dc7aff99-6543-4449-9977-388ddd8eac46 tempest-ProjectMemberTests-232601277 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:44:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-dc7aff99-6543-4449-9977-388ddd8eac46 tempest-ProjectMemberTests-232601277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.667s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:23 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-dc7aff99-6543-4449-9977-388ddd8eac46 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81e1718c-87ca-4568-bb46-2406ecf806ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:23 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-dc7aff99-6543-4449-9977-388ddd8eac46 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08f16f7c-558a-4973-8590-71058d63ad13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:23 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-dc7aff99-6543-4449-9977-388ddd8eac46 tempest-ProjectMemberTests-232601277 None] Volume volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79 (3e91fdc5-a4f3-4163-a300-77faf8ddae79): created successfully Jul 07 17:44:23 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-dc7aff99-6543-4449-9977-388ddd8eac46 tempest-ProjectMemberTests-232601277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08f16f7c-558a-4973-8590-71058d63ad13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:23 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-dc7aff99-6543-4449-9977-388ddd8eac46 tempest-ProjectMemberTests-232601277 None] Flow 'volume_create_manager' (894148d7-3f73-46bf-9fa6-8e834b861e53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:44:23 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-dc7aff99-6543-4449-9977-388ddd8eac46 tempest-ProjectMemberTests-232601277 None] Created volume successfully. Jul 07 17:44:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-25c74fdb-d2b9-4aea-82d0-4932f1283cb5 tempest-ProjectMemberTests-232601277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-25c74fdb-d2b9-4aea-82d0-4932f1283cb5 tempest-ProjectMemberTests-232601277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:23 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-25c74fdb-d2b9-4aea-82d0-4932f1283cb5 tempest-ProjectMemberTests-232601277 None] Creating offline snapshot 08ec753d-4f83-4059-97ef-6483d57e7322 of volume 3e91fdc5-a4f3-4163-a300-77faf8ddae79 {{(pid=87233) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:44:23 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[177df8a1-780e-4400-9e82-0bf04dc8b8ce]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:23 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-25c74fdb-d2b9-4aea-82d0-4932f1283cb5 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:23 devstack sudo[107354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79 Jul 07 17:44:23 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:24 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-25c74fdb-d2b9-4aea-82d0-4932f1283cb5 tempest-ProjectMemberTests-232601277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79" returned: 0 in 0.773s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:24 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-25c74fdb-d2b9-4aea-82d0-4932f1283cb5 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79.08ec753d-4f83-4059-97ef-6483d57e7322 1G {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:24 devstack sudo[107359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79.08ec753d-4f83-4059-97ef-6483d57e7322 1G Jul 07 17:44:24 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:25 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-25c74fdb-d2b9-4aea-82d0-4932f1283cb5 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79.08ec753d-4f83-4059-97ef-6483d57e7322 1G" returned: 0 in 0.872s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:25 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-25c74fdb-d2b9-4aea-82d0-4932f1283cb5 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79.08ec753d-4f83-4059-97ef-6483d57e7322 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:25 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79.08ec753d-4f83-4059-97ef-6483d57e7322 Jul 07 17:44:25 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:26 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-25c74fdb-d2b9-4aea-82d0-4932f1283cb5 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79 -F qcow2 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79.08ec753d-4f83-4059-97ef-6483d57e7322" returned: 0 in 0.760s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:26 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-25c74fdb-d2b9-4aea-82d0-4932f1283cb5 tempest-ProjectMemberTests-232601277 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79.08ec753d-4f83-4059-97ef-6483d57e7322 is being set with open permissions: ugo+rw Jul 07 17:44:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-25c74fdb-d2b9-4aea-82d0-4932f1283cb5 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79.08ec753d-4f83-4059-97ef-6483d57e7322 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:26 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79.08ec753d-4f83-4059-97ef-6483d57e7322 Jul 07 17:44:26 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:26 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-25c74fdb-d2b9-4aea-82d0-4932f1283cb5 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79.08ec753d-4f83-4059-97ef-6483d57e7322" returned: 0 in 0.693s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:26 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-25c74fdb-d2b9-4aea-82d0-4932f1283cb5 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:26 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79.info Jul 07 17:44:26 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:27 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-25c74fdb-d2b9-4aea-82d0-4932f1283cb5 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79.info" returned: 0 in 0.701s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:27 devstack cinder-volume[87233]: WARNING cinder.volume.drivers.remotefs [None req-25c74fdb-d2b9-4aea-82d0-4932f1283cb5 tempest-ProjectMemberTests-232601277 None] /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79.info is being set with open permissions: ugo+rw Jul 07 17:44:27 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-25c74fdb-d2b9-4aea-82d0-4932f1283cb5 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79.info {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:27 devstack sudo[107375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79.info Jul 07 17:44:27 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:28 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-25c74fdb-d2b9-4aea-82d0-4932f1283cb5 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79.info" returned: 0 in 0.700s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:28 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-25c74fdb-d2b9-4aea-82d0-4932f1283cb5 tempest-ProjectMemberTests-232601277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.592s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:28 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-25c74fdb-d2b9-4aea-82d0-4932f1283cb5 tempest-ProjectMemberTests-232601277 None] Create snapshot completed successfully Jul 07 17:44:28 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-085e8f1f-20ab-4ede-8815-78a353e11852 tempest-ProjectMemberTests-232601277 None] Acquiring lock "cinder-08ec753d-4f83-4059-97ef-6483d57e7322-delete_snapshot" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:29 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-085e8f1f-20ab-4ede-8815-78a353e11852 tempest-ProjectMemberTests-232601277 None] Lock "cinder-08ec753d-4f83-4059-97ef-6483d57e7322-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:29 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-085e8f1f-20ab-4ede-8815-78a353e11852 tempest-ProjectMemberTests-232601277 None] Acquiring lock "cinder-quobyte-3e91fdc5-a4f3-4163-a300-77faf8ddae79" by "delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:29 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-085e8f1f-20ab-4ede-8815-78a353e11852 tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-3e91fdc5-a4f3-4163-a300-77faf8ddae79" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:29 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-085e8f1f-20ab-4ede-8815-78a353e11852 tempest-ProjectMemberTests-232601277 None] Acquiring lock "cinder-quobyte-08ec753d-4f83-4059-97ef-6483d57e7322" by "_delete_snapshot" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:29 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-085e8f1f-20ab-4ede-8815-78a353e11852 tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-08ec753d-4f83-4059-97ef-6483d57e7322" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:29 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-085e8f1f-20ab-4ede-8815-78a353e11852 tempest-ProjectMemberTests-232601277 None] Deleting offline snapshot 08ec753d-4f83-4059-97ef-6483d57e7322 of volume 3e91fdc5-a4f3-4163-a300-77faf8ddae79 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:44:29 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-085e8f1f-20ab-4ede-8815-78a353e11852 tempest-ProjectMemberTests-232601277 None] snapshot_file for this snap is: volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79.08ec753d-4f83-4059-97ef-6483d57e7322 {{(pid=87233) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:44:29 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4ee2c1-1f34-495c-9f35-e49523b4e0da]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-085e8f1f-20ab-4ede-8815-78a353e11852 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79.08ec753d-4f83-4059-97ef-6483d57e7322 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:29 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79.08ec753d-4f83-4059-97ef-6483d57e7322 Jul 07 17:44:29 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:29 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-085e8f1f-20ab-4ede-8815-78a353e11852 tempest-ProjectMemberTests-232601277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79.08ec753d-4f83-4059-97ef-6483d57e7322" returned: 0 in 0.814s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:29 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-085e8f1f-20ab-4ede-8815-78a353e11852 tempest-ProjectMemberTests-232601277 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87233) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:44:29 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8390da-9dbe-41ad-a0cf-e03007cdc827]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:29 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-085e8f1f-20ab-4ede-8815-78a353e11852 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:30 devstack sudo[107383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79 Jul 07 17:44:30 devstack sudo[107383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:30 devstack sudo[107383]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-085e8f1f-20ab-4ede-8815-78a353e11852 tempest-ProjectMemberTests-232601277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79" returned: 0 in 0.817s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:30 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-085e8f1f-20ab-4ede-8815-78a353e11852 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79.08ec753d-4f83-4059-97ef-6483d57e7322 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:30 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79.08ec753d-4f83-4059-97ef-6483d57e7322 Jul 07 17:44:30 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:31 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-085e8f1f-20ab-4ede-8815-78a353e11852 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79.08ec753d-4f83-4059-97ef-6483d57e7322" returned: 0 in 0.835s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:31 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-085e8f1f-20ab-4ede-8815-78a353e11852 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79.08ec753d-4f83-4059-97ef-6483d57e7322 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:31 devstack sudo[107395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79.08ec753d-4f83-4059-97ef-6483d57e7322 Jul 07 17:44:31 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:32 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:32 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-085e8f1f-20ab-4ede-8815-78a353e11852 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79.08ec753d-4f83-4059-97ef-6483d57e7322" returned: 0 in 0.692s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:32 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-085e8f1f-20ab-4ede-8815-78a353e11852 tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-08ec753d-4f83-4059-97ef-6483d57e7322" released by "_delete_snapshot" :: held 3.265s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:32 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-085e8f1f-20ab-4ede-8815-78a353e11852 tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-3e91fdc5-a4f3-4163-a300-77faf8ddae79" released by "delete_snapshot" :: held 3.293s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:32 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-085e8f1f-20ab-4ede-8815-78a353e11852 tempest-ProjectMemberTests-232601277 None] Created reservations ['ccff7e9b-9eb5-47a2-8fd9-fbe6404e3e56', '71f6d4c0-a37a-4a5d-a1c3-a41ffa4bb5df', '6fa820a4-3b02-4d47-98a4-08bc68acd73a', '24b98321-87b3-4f75-849d-bd2df80b6f1f'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:44:32 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-085e8f1f-20ab-4ede-8815-78a353e11852 tempest-ProjectMemberTests-232601277 None] Delete snapshot completed successfully. Jul 07 17:44:32 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-085e8f1f-20ab-4ede-8815-78a353e11852 tempest-ProjectMemberTests-232601277 None] Lock "cinder-08ec753d-4f83-4059-97ef-6483d57e7322-delete_snapshot" released by "delete_snapshot" :: held 3.483s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:33 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6a52a690-10ef-4c5f-aada-6418e5d31879 tempest-ProjectMemberTests-232601277 None] Acquiring lock "cinder-3e91fdc5-a4f3-4163-a300-77faf8ddae79-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:33 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6a52a690-10ef-4c5f-aada-6418e5d31879 tempest-ProjectMemberTests-232601277 None] Lock "cinder-3e91fdc5-a4f3-4163-a300-77faf8ddae79-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:33 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6a52a690-10ef-4c5f-aada-6418e5d31879 tempest-ProjectMemberTests-232601277 None] Acquiring lock "cinder-quobyte-3e91fdc5-a4f3-4163-a300-77faf8ddae79" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:33 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6a52a690-10ef-4c5f-aada-6418e5d31879 tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-3e91fdc5-a4f3-4163-a300-77faf8ddae79" acquired by "delete_volume" :: waited 0.017s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:33 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aee95e9-c8aa-4b26-ad8e-a062531ec7d6]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:33 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6a52a690-10ef-4c5f-aada-6418e5d31879 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:33 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79 Jul 07 17:44:33 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:34 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6a52a690-10ef-4c5f-aada-6418e5d31879 tempest-ProjectMemberTests-232601277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79" returned: 0 in 0.839s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6a52a690-10ef-4c5f-aada-6418e5d31879 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:34 devstack sudo[107403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79 Jul 07 17:44:34 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:34 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:34 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6a52a690-10ef-4c5f-aada-6418e5d31879 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-3e91fdc5-a4f3-4163-a300-77faf8ddae79" returned: 0 in 0.664s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:34 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6a52a690-10ef-4c5f-aada-6418e5d31879 tempest-ProjectMemberTests-232601277 None] Lock "cinder-quobyte-3e91fdc5-a4f3-4163-a300-77faf8ddae79" released by "delete_volume" :: held 1.569s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:34 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-6a52a690-10ef-4c5f-aada-6418e5d31879 tempest-ProjectMemberTests-232601277 None] Created reservations ['32a32d62-16e8-47ce-b24d-e497c756244e', '2abc5ff0-8c34-4a72-be67-8c6194a4fe83', '250d2da9-a89c-43d1-825b-7ad8a6fdcd42', 'c8e44051-8012-4f40-b0a8-9674bd0ef502'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:44:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-6a52a690-10ef-4c5f-aada-6418e5d31879 tempest-ProjectMemberTests-232601277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-6a52a690-10ef-4c5f-aada-6418e5d31879 tempest-ProjectMemberTests-232601277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:35 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-6a52a690-10ef-4c5f-aada-6418e5d31879 tempest-ProjectMemberTests-232601277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:35 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-6a52a690-10ef-4c5f-aada-6418e5d31879 tempest-ProjectMemberTests-232601277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-6a52a690-10ef-4c5f-aada-6418e5d31879 tempest-ProjectMemberTests-232601277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6a52a690-10ef-4c5f-aada-6418e5d31879 tempest-ProjectMemberTests-232601277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:35 devstack sudo[107406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:44:35 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:35 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:35 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-6a52a690-10ef-4c5f-aada-6418e5d31879 tempest-ProjectMemberTests-232601277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.666s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:35 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-6a52a690-10ef-4c5f-aada-6418e5d31879 tempest-ProjectMemberTests-232601277 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:44:35 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-6a52a690-10ef-4c5f-aada-6418e5d31879 tempest-ProjectMemberTests-232601277 None] Deleted volume successfully. Jul 07 17:44:35 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-6a52a690-10ef-4c5f-aada-6418e5d31879 tempest-ProjectMemberTests-232601277 None] Lock "cinder-3e91fdc5-a4f3-4163-a300-77faf8ddae79-delete_volume" released by "delete_volume" :: held 2.449s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:39 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae34c370-1e70-4fb0-92a1-f39c12a41999 tempest-ProjectReaderTests-337260447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:44:39 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ae34c370-1e70-4fb0-92a1-f39c12a41999 tempest-ProjectReaderTests-337260447 None] Flow 'volume_create_manager' (205a9af2-3b95-4409-bca5-1c2c0a76b3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:44:39 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ae34c370-1e70-4fb0-92a1-f39c12a41999 tempest-ProjectReaderTests-337260447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (234d88af-298f-4326-a223-dc04fdcf87e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:39 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ae34c370-1e70-4fb0-92a1-f39c12a41999 tempest-ProjectReaderTests-337260447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (234d88af-298f-4326-a223-dc04fdcf87e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-172691024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6298721a-0c72-4843-af60-d348a3403653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2f8ca9d538444ffa9413d4fab7485db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:44:39Z,use_quota=True,user_id='7d81f7162cbc46dbbf4406b0f10e942f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:39 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ae34c370-1e70-4fb0-92a1-f39c12a41999 tempest-ProjectReaderTests-337260447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (249a2661-0fe8-42bf-b4d6-5f7806eff913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:39 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ae34c370-1e70-4fb0-92a1-f39c12a41999 tempest-ProjectReaderTests-337260447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (249a2661-0fe8-42bf-b4d6-5f7806eff913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:39 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ae34c370-1e70-4fb0-92a1-f39c12a41999 tempest-ProjectReaderTests-337260447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2fb0b6b-845d-4321-bb90-2bbbc930bea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:39 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ae34c370-1e70-4fb0-92a1-f39c12a41999 tempest-ProjectReaderTests-337260447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2fb0b6b-845d-4321-bb90-2bbbc930bea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6298721a-0c72-4843-af60-d348a3403653', 'volume_name': 'volume-6298721a-0c72-4843-af60-d348a3403653', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:39 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ae34c370-1e70-4fb0-92a1-f39c12a41999 tempest-ProjectReaderTests-337260447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5717db8d-7da5-464b-9b7f-688cdf8e1e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:39 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ae34c370-1e70-4fb0-92a1-f39c12a41999 tempest-ProjectReaderTests-337260447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5717db8d-7da5-464b-9b7f-688cdf8e1e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:39 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ae34c370-1e70-4fb0-92a1-f39c12a41999 tempest-ProjectReaderTests-337260447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ea5722-a598-4e25-9325-48ebee6189d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:39 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-ae34c370-1e70-4fb0-92a1-f39c12a41999 tempest-ProjectReaderTests-337260447 None] Volume 6298721a-0c72-4843-af60-d348a3403653: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6298721a-0c72-4843-af60-d348a3403653', 'volume_size': 1} Jul 07 17:44:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ae34c370-1e70-4fb0-92a1-f39c12a41999 tempest-ProjectReaderTests-337260447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ae34c370-1e70-4fb0-92a1-f39c12a41999 tempest-ProjectReaderTests-337260447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:39 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ae34c370-1e70-4fb0-92a1-f39c12a41999 tempest-ProjectReaderTests-337260447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-172691024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6298721a-0c72-4843-af60-d348a3403653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2f8ca9d538444ffa9413d4fab7485db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:44:39Z,use_quota=True,user_id='7d81f7162cbc46dbbf4406b0f10e942f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:44:39 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-ae34c370-1e70-4fb0-92a1-f39c12a41999 tempest-ProjectReaderTests-337260447 None] Creating volume 6298721a-0c72-4843-af60-d348a3403653 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:44:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ae34c370-1e70-4fb0-92a1-f39c12a41999 tempest-ProjectReaderTests-337260447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ae34c370-1e70-4fb0-92a1-f39c12a41999 tempest-ProjectReaderTests-337260447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:39 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ae34c370-1e70-4fb0-92a1-f39c12a41999 tempest-ProjectReaderTests-337260447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:39 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ae34c370-1e70-4fb0-92a1-f39c12a41999 tempest-ProjectReaderTests-337260447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ae34c370-1e70-4fb0-92a1-f39c12a41999 tempest-ProjectReaderTests-337260447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:39 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ae34c370-1e70-4fb0-92a1-f39c12a41999 tempest-ProjectReaderTests-337260447 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:44:39 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-ae34c370-1e70-4fb0-92a1-f39c12a41999 tempest-ProjectReaderTests-337260447 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:44:39 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ae34c370-1e70-4fb0-92a1-f39c12a41999 tempest-ProjectReaderTests-337260447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6298721a-0c72-4843-af60-d348a3403653 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:39 devstack sudo[107409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6298721a-0c72-4843-af60-d348a3403653 1073741824 Jul 07 17:44:39 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:40 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ae34c370-1e70-4fb0-92a1-f39c12a41999 tempest-ProjectReaderTests-337260447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6298721a-0c72-4843-af60-d348a3403653 1073741824" returned: 0 in 0.817s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:40 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ae34c370-1e70-4fb0-92a1-f39c12a41999 tempest-ProjectReaderTests-337260447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6298721a-0c72-4843-af60-d348a3403653 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:40 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6298721a-0c72-4843-af60-d348a3403653 Jul 07 17:44:40 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:41 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-ae34c370-1e70-4fb0-92a1-f39c12a41999 tempest-ProjectReaderTests-337260447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6298721a-0c72-4843-af60-d348a3403653" returned: 0 in 0.667s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:41 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-ae34c370-1e70-4fb0-92a1-f39c12a41999 tempest-ProjectReaderTests-337260447 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:44:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-ae34c370-1e70-4fb0-92a1-f39c12a41999 tempest-ProjectReaderTests-337260447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:41 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ae34c370-1e70-4fb0-92a1-f39c12a41999 tempest-ProjectReaderTests-337260447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ea5722-a598-4e25-9325-48ebee6189d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6298721a-0c72-4843-af60-d348a3403653', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:41 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ae34c370-1e70-4fb0-92a1-f39c12a41999 tempest-ProjectReaderTests-337260447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be0443f8-c6eb-4ed7-9eb5-3446f5110127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:41 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-ae34c370-1e70-4fb0-92a1-f39c12a41999 tempest-ProjectReaderTests-337260447 None] Volume volume-6298721a-0c72-4843-af60-d348a3403653 (6298721a-0c72-4843-af60-d348a3403653): created successfully Jul 07 17:44:41 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ae34c370-1e70-4fb0-92a1-f39c12a41999 tempest-ProjectReaderTests-337260447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be0443f8-c6eb-4ed7-9eb5-3446f5110127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:41 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-ae34c370-1e70-4fb0-92a1-f39c12a41999 tempest-ProjectReaderTests-337260447 None] Flow 'volume_create_manager' (205a9af2-3b95-4409-bca5-1c2c0a76b3da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:44:41 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-ae34c370-1e70-4fb0-92a1-f39c12a41999 tempest-ProjectReaderTests-337260447 None] Created volume successfully. Jul 07 17:44:41 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c5c04c35-ecd8-4d09-a44e-bdd271fcb91c tempest-ProjectReaderTests-337260447 None] Acquiring lock "cinder-6298721a-0c72-4843-af60-d348a3403653-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:41 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c5c04c35-ecd8-4d09-a44e-bdd271fcb91c tempest-ProjectReaderTests-337260447 None] Lock "cinder-6298721a-0c72-4843-af60-d348a3403653-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:41 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c5c04c35-ecd8-4d09-a44e-bdd271fcb91c tempest-ProjectReaderTests-337260447 None] Acquiring lock "cinder-quobyte-6298721a-0c72-4843-af60-d348a3403653" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:41 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c5c04c35-ecd8-4d09-a44e-bdd271fcb91c tempest-ProjectReaderTests-337260447 None] Lock "cinder-quobyte-6298721a-0c72-4843-af60-d348a3403653" acquired by "delete_volume" :: waited 0.016s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:41 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97a2307-a5b2-4d9c-8edf-e1bf8ea0089b]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:41 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c5c04c35-ecd8-4d09-a44e-bdd271fcb91c tempest-ProjectReaderTests-337260447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6298721a-0c72-4843-af60-d348a3403653 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:42 devstack sudo[107419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6298721a-0c72-4843-af60-d348a3403653 Jul 07 17:44:42 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:42 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c5c04c35-ecd8-4d09-a44e-bdd271fcb91c tempest-ProjectReaderTests-337260447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6298721a-0c72-4843-af60-d348a3403653" returned: 0 in 0.797s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:42 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c5c04c35-ecd8-4d09-a44e-bdd271fcb91c tempest-ProjectReaderTests-337260447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6298721a-0c72-4843-af60-d348a3403653 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:42 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6298721a-0c72-4843-af60-d348a3403653 Jul 07 17:44:42 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:43 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:44:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:43 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:44:43 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:43 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c5c04c35-ecd8-4d09-a44e-bdd271fcb91c tempest-ProjectReaderTests-337260447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-6298721a-0c72-4843-af60-d348a3403653" returned: 0 in 0.766s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:43 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c5c04c35-ecd8-4d09-a44e-bdd271fcb91c tempest-ProjectReaderTests-337260447 None] Lock "cinder-quobyte-6298721a-0c72-4843-af60-d348a3403653" released by "delete_volume" :: held 1.612s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:43 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-c5c04c35-ecd8-4d09-a44e-bdd271fcb91c tempest-ProjectReaderTests-337260447 None] Created reservations ['749322c6-4a52-448a-81e1-ba3ba126d88a', '9ef1f35b-f637-4f9c-886e-6031a9e906e5', '9157d59c-1431-44e5-b402-7948a9da31fa', '41a463a6-767a-47c8-8b4f-0ed9bd884032'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:44:43 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:SELECT=83,cinder:INSERT=29,cinder:UPDATE=88,cinder:DELETE=7 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:44:43 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:UPDATE=110,cinder:SELECT=67,cinder:DELETE=9,cinder:INSERT=28 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:44:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c5c04c35-ecd8-4d09-a44e-bdd271fcb91c tempest-ProjectReaderTests-337260447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c5c04c35-ecd8-4d09-a44e-bdd271fcb91c tempest-ProjectReaderTests-337260447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c5c04c35-ecd8-4d09-a44e-bdd271fcb91c tempest-ProjectReaderTests-337260447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:43 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-c5c04c35-ecd8-4d09-a44e-bdd271fcb91c tempest-ProjectReaderTests-337260447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-c5c04c35-ecd8-4d09-a44e-bdd271fcb91c tempest-ProjectReaderTests-337260447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:43 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c5c04c35-ecd8-4d09-a44e-bdd271fcb91c tempest-ProjectReaderTests-337260447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:43 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:44:43 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:44 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.699s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:44 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:44:44 devstack cinder-volume[87233]: DEBUG oslo_service.periodic_task [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87233) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:44:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread count: 28 {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:44:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-bbd746f5-d15e-4823-a54a-2ee0708780b7 None None] thread info: [<_MainThread(MainThread, started 126077716062336)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87233) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:44:44 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-c5c04c35-ecd8-4d09-a44e-bdd271fcb91c tempest-ProjectReaderTests-337260447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.803s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:44 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-c5c04c35-ecd8-4d09-a44e-bdd271fcb91c tempest-ProjectReaderTests-337260447 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:44:44 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-c5c04c35-ecd8-4d09-a44e-bdd271fcb91c tempest-ProjectReaderTests-337260447 None] Deleted volume successfully. Jul 07 17:44:44 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-c5c04c35-ecd8-4d09-a44e-bdd271fcb91c tempest-ProjectReaderTests-337260447 None] Lock "cinder-6298721a-0c72-4843-af60-d348a3403653-delete_volume" released by "delete_volume" :: held 2.667s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:44 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cceac2d-a55d-429b-9dd6-496c6045fa78 tempest-ProjectReaderTests-337260447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:44:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-8cceac2d-a55d-429b-9dd6-496c6045fa78 tempest-ProjectReaderTests-337260447 None] Flow 'volume_create_manager' (bb0cd420-626f-4fd0-b77d-b2b9846f5576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:44:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-8cceac2d-a55d-429b-9dd6-496c6045fa78 tempest-ProjectReaderTests-337260447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea38aa47-66ff-414e-9069-ee25f94dbf9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-8cceac2d-a55d-429b-9dd6-496c6045fa78 tempest-ProjectReaderTests-337260447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea38aa47-66ff-414e-9069-ee25f94dbf9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:44:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1931926420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=868266d3-dd92-43dd-b536-3cc8bfe0caad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2f8ca9d538444ffa9413d4fab7485db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:44:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:44:45Z,use_quota=True,user_id='7d81f7162cbc46dbbf4406b0f10e942f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-8cceac2d-a55d-429b-9dd6-496c6045fa78 tempest-ProjectReaderTests-337260447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d473c7b0-dca9-4df0-bcb2-2a4252bfed22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-8cceac2d-a55d-429b-9dd6-496c6045fa78 tempest-ProjectReaderTests-337260447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d473c7b0-dca9-4df0-bcb2-2a4252bfed22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-8cceac2d-a55d-429b-9dd6-496c6045fa78 tempest-ProjectReaderTests-337260447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ade328b2-78b4-4556-929d-238b147fe9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-8cceac2d-a55d-429b-9dd6-496c6045fa78 tempest-ProjectReaderTests-337260447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ade328b2-78b4-4556-929d-238b147fe9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '868266d3-dd92-43dd-b536-3cc8bfe0caad', 'volume_name': 'volume-868266d3-dd92-43dd-b536-3cc8bfe0caad', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-8cceac2d-a55d-429b-9dd6-496c6045fa78 tempest-ProjectReaderTests-337260447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (096f765b-ba5f-44a7-ac8b-f4b80b3eebd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-8cceac2d-a55d-429b-9dd6-496c6045fa78 tempest-ProjectReaderTests-337260447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (096f765b-ba5f-44a7-ac8b-f4b80b3eebd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:44 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-8cceac2d-a55d-429b-9dd6-496c6045fa78 tempest-ProjectReaderTests-337260447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0e39073-9849-4655-ac4a-558a6b097374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:44 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-8cceac2d-a55d-429b-9dd6-496c6045fa78 tempest-ProjectReaderTests-337260447 None] Volume 868266d3-dd92-43dd-b536-3cc8bfe0caad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-868266d3-dd92-43dd-b536-3cc8bfe0caad', 'volume_size': 1} Jul 07 17:44:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-8cceac2d-a55d-429b-9dd6-496c6045fa78 tempest-ProjectReaderTests-337260447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-8cceac2d-a55d-429b-9dd6-496c6045fa78 tempest-ProjectReaderTests-337260447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:44 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-8cceac2d-a55d-429b-9dd6-496c6045fa78 tempest-ProjectReaderTests-337260447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:44:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1931926420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=868266d3-dd92-43dd-b536-3cc8bfe0caad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2f8ca9d538444ffa9413d4fab7485db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:44:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:44:45Z,use_quota=True,user_id='7d81f7162cbc46dbbf4406b0f10e942f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:44:44 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-8cceac2d-a55d-429b-9dd6-496c6045fa78 tempest-ProjectReaderTests-337260447 None] Creating volume 868266d3-dd92-43dd-b536-3cc8bfe0caad {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:44:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-8cceac2d-a55d-429b-9dd6-496c6045fa78 tempest-ProjectReaderTests-337260447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-8cceac2d-a55d-429b-9dd6-496c6045fa78 tempest-ProjectReaderTests-337260447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:44 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-8cceac2d-a55d-429b-9dd6-496c6045fa78 tempest-ProjectReaderTests-337260447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:44 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-8cceac2d-a55d-429b-9dd6-496c6045fa78 tempest-ProjectReaderTests-337260447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-8cceac2d-a55d-429b-9dd6-496c6045fa78 tempest-ProjectReaderTests-337260447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:44 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-8cceac2d-a55d-429b-9dd6-496c6045fa78 tempest-ProjectReaderTests-337260447 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:44:44 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-8cceac2d-a55d-429b-9dd6-496c6045fa78 tempest-ProjectReaderTests-337260447 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:44:44 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8cceac2d-a55d-429b-9dd6-496c6045fa78 tempest-ProjectReaderTests-337260447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-868266d3-dd92-43dd-b536-3cc8bfe0caad 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:44 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-868266d3-dd92-43dd-b536-3cc8bfe0caad 1073741824 Jul 07 17:44:44 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:45 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8cceac2d-a55d-429b-9dd6-496c6045fa78 tempest-ProjectReaderTests-337260447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-868266d3-dd92-43dd-b536-3cc8bfe0caad 1073741824" returned: 0 in 0.870s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:45 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8cceac2d-a55d-429b-9dd6-496c6045fa78 tempest-ProjectReaderTests-337260447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-868266d3-dd92-43dd-b536-3cc8bfe0caad {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:45 devstack sudo[107440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-868266d3-dd92-43dd-b536-3cc8bfe0caad Jul 07 17:44:45 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:46 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-8cceac2d-a55d-429b-9dd6-496c6045fa78 tempest-ProjectReaderTests-337260447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-868266d3-dd92-43dd-b536-3cc8bfe0caad" returned: 0 in 0.657s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:46 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-8cceac2d-a55d-429b-9dd6-496c6045fa78 tempest-ProjectReaderTests-337260447 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:44:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-8cceac2d-a55d-429b-9dd6-496c6045fa78 tempest-ProjectReaderTests-337260447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:46 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-8cceac2d-a55d-429b-9dd6-496c6045fa78 tempest-ProjectReaderTests-337260447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0e39073-9849-4655-ac4a-558a6b097374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-868266d3-dd92-43dd-b536-3cc8bfe0caad', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:46 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-8cceac2d-a55d-429b-9dd6-496c6045fa78 tempest-ProjectReaderTests-337260447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ab8990e-23ab-4d8d-9029-2bedd4f7d74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:46 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-8cceac2d-a55d-429b-9dd6-496c6045fa78 tempest-ProjectReaderTests-337260447 None] Volume volume-868266d3-dd92-43dd-b536-3cc8bfe0caad (868266d3-dd92-43dd-b536-3cc8bfe0caad): created successfully Jul 07 17:44:46 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-8cceac2d-a55d-429b-9dd6-496c6045fa78 tempest-ProjectReaderTests-337260447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ab8990e-23ab-4d8d-9029-2bedd4f7d74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:46 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-8cceac2d-a55d-429b-9dd6-496c6045fa78 tempest-ProjectReaderTests-337260447 None] Flow 'volume_create_manager' (bb0cd420-626f-4fd0-b77d-b2b9846f5576) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:44:46 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-8cceac2d-a55d-429b-9dd6-496c6045fa78 tempest-ProjectReaderTests-337260447 None] Created volume successfully. Jul 07 17:44:46 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a856b818-33a1-4e0c-abc7-4424249cca54 tempest-ProjectReaderTests-337260447 None] Acquiring lock "cinder-868266d3-dd92-43dd-b536-3cc8bfe0caad-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:46 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a856b818-33a1-4e0c-abc7-4424249cca54 tempest-ProjectReaderTests-337260447 None] Lock "cinder-868266d3-dd92-43dd-b536-3cc8bfe0caad-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:46 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a856b818-33a1-4e0c-abc7-4424249cca54 tempest-ProjectReaderTests-337260447 None] Acquiring lock "cinder-quobyte-868266d3-dd92-43dd-b536-3cc8bfe0caad" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:46 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a856b818-33a1-4e0c-abc7-4424249cca54 tempest-ProjectReaderTests-337260447 None] Lock "cinder-quobyte-868266d3-dd92-43dd-b536-3cc8bfe0caad" acquired by "delete_volume" :: waited 0.019s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:46 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b614ceed-8a6c-4d11-97df-30acc2af2173]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:46 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a856b818-33a1-4e0c-abc7-4424249cca54 tempest-ProjectReaderTests-337260447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-868266d3-dd92-43dd-b536-3cc8bfe0caad {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:47 devstack sudo[107443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-868266d3-dd92-43dd-b536-3cc8bfe0caad Jul 07 17:44:47 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:47 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a856b818-33a1-4e0c-abc7-4424249cca54 tempest-ProjectReaderTests-337260447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-868266d3-dd92-43dd-b536-3cc8bfe0caad" returned: 0 in 0.884s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:47 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a856b818-33a1-4e0c-abc7-4424249cca54 tempest-ProjectReaderTests-337260447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-868266d3-dd92-43dd-b536-3cc8bfe0caad {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:47 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-868266d3-dd92-43dd-b536-3cc8bfe0caad Jul 07 17:44:47 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:48 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a856b818-33a1-4e0c-abc7-4424249cca54 tempest-ProjectReaderTests-337260447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-868266d3-dd92-43dd-b536-3cc8bfe0caad" returned: 0 in 0.691s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:48 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a856b818-33a1-4e0c-abc7-4424249cca54 tempest-ProjectReaderTests-337260447 None] Lock "cinder-quobyte-868266d3-dd92-43dd-b536-3cc8bfe0caad" released by "delete_volume" :: held 1.618s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:48 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-a856b818-33a1-4e0c-abc7-4424249cca54 tempest-ProjectReaderTests-337260447 None] Created reservations ['efa4ce2c-e7a3-402b-ab35-615cf3a59676', '24ebc945-2c2e-46a0-983b-07ddb21559eb', '655962df-c894-4710-a24e-324567373ab1', 'e715ab86-d3fc-4369-ada2-56b4bedf0b74'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:44:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a856b818-33a1-4e0c-abc7-4424249cca54 tempest-ProjectReaderTests-337260447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a856b818-33a1-4e0c-abc7-4424249cca54 tempest-ProjectReaderTests-337260447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:48 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-a856b818-33a1-4e0c-abc7-4424249cca54 tempest-ProjectReaderTests-337260447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:48 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-a856b818-33a1-4e0c-abc7-4424249cca54 tempest-ProjectReaderTests-337260447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-a856b818-33a1-4e0c-abc7-4424249cca54 tempest-ProjectReaderTests-337260447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:48 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a856b818-33a1-4e0c-abc7-4424249cca54 tempest-ProjectReaderTests-337260447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:48 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:44:48 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:49 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-a856b818-33a1-4e0c-abc7-4424249cca54 tempest-ProjectReaderTests-337260447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.838s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:49 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-a856b818-33a1-4e0c-abc7-4424249cca54 tempest-ProjectReaderTests-337260447 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:44:49 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-a856b818-33a1-4e0c-abc7-4424249cca54 tempest-ProjectReaderTests-337260447 None] Deleted volume successfully. Jul 07 17:44:49 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-a856b818-33a1-4e0c-abc7-4424249cca54 tempest-ProjectReaderTests-337260447 None] Lock "cinder-868266d3-dd92-43dd-b536-3cc8bfe0caad-delete_volume" released by "delete_volume" :: held 2.723s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:49 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-73aab985-4d3c-485b-b02c-e1f51102cea6 tempest-ProjectReaderTests-337260447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:44:49 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-73aab985-4d3c-485b-b02c-e1f51102cea6 tempest-ProjectReaderTests-337260447 None] Flow 'volume_create_manager' (7e67386c-6a9a-4783-88bd-4aefa2e6f55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:44:49 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-73aab985-4d3c-485b-b02c-e1f51102cea6 tempest-ProjectReaderTests-337260447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ff1e73c-d0a7-4128-b1a9-2b0a6bcd5987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:49 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-73aab985-4d3c-485b-b02c-e1f51102cea6 tempest-ProjectReaderTests-337260447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ff1e73c-d0a7-4128-b1a9-2b0a6bcd5987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:44:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1713463332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c14821d-71fe-42a3-b993-9c973e81b9d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2f8ca9d538444ffa9413d4fab7485db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:44:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:44:50Z,use_quota=True,user_id='7d81f7162cbc46dbbf4406b0f10e942f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:49 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-73aab985-4d3c-485b-b02c-e1f51102cea6 tempest-ProjectReaderTests-337260447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08720b95-4265-4b33-8011-53b207c182b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:49 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-73aab985-4d3c-485b-b02c-e1f51102cea6 tempest-ProjectReaderTests-337260447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08720b95-4265-4b33-8011-53b207c182b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:49 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-73aab985-4d3c-485b-b02c-e1f51102cea6 tempest-ProjectReaderTests-337260447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96757807-16b3-484c-bfd6-6127cef4bd16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:49 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-73aab985-4d3c-485b-b02c-e1f51102cea6 tempest-ProjectReaderTests-337260447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96757807-16b3-484c-bfd6-6127cef4bd16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c14821d-71fe-42a3-b993-9c973e81b9d1', 'volume_name': 'volume-2c14821d-71fe-42a3-b993-9c973e81b9d1', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:49 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-73aab985-4d3c-485b-b02c-e1f51102cea6 tempest-ProjectReaderTests-337260447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (777706b8-2b5b-4d9e-87b6-ce75ace47a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:49 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-73aab985-4d3c-485b-b02c-e1f51102cea6 tempest-ProjectReaderTests-337260447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (777706b8-2b5b-4d9e-87b6-ce75ace47a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:49 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-73aab985-4d3c-485b-b02c-e1f51102cea6 tempest-ProjectReaderTests-337260447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb3803ef-7762-4d56-b54e-1f9d0f543427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:49 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-73aab985-4d3c-485b-b02c-e1f51102cea6 tempest-ProjectReaderTests-337260447 None] Volume 2c14821d-71fe-42a3-b993-9c973e81b9d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c14821d-71fe-42a3-b993-9c973e81b9d1', 'volume_size': 1} Jul 07 17:44:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-73aab985-4d3c-485b-b02c-e1f51102cea6 tempest-ProjectReaderTests-337260447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-73aab985-4d3c-485b-b02c-e1f51102cea6 tempest-ProjectReaderTests-337260447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:49 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-73aab985-4d3c-485b-b02c-e1f51102cea6 tempest-ProjectReaderTests-337260447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:44:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1713463332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c14821d-71fe-42a3-b993-9c973e81b9d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2f8ca9d538444ffa9413d4fab7485db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:44:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:44:50Z,use_quota=True,user_id='7d81f7162cbc46dbbf4406b0f10e942f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:44:49 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-73aab985-4d3c-485b-b02c-e1f51102cea6 tempest-ProjectReaderTests-337260447 None] Creating volume 2c14821d-71fe-42a3-b993-9c973e81b9d1 {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:44:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-73aab985-4d3c-485b-b02c-e1f51102cea6 tempest-ProjectReaderTests-337260447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-73aab985-4d3c-485b-b02c-e1f51102cea6 tempest-ProjectReaderTests-337260447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:49 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-73aab985-4d3c-485b-b02c-e1f51102cea6 tempest-ProjectReaderTests-337260447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:49 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-73aab985-4d3c-485b-b02c-e1f51102cea6 tempest-ProjectReaderTests-337260447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-73aab985-4d3c-485b-b02c-e1f51102cea6 tempest-ProjectReaderTests-337260447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:49 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-73aab985-4d3c-485b-b02c-e1f51102cea6 tempest-ProjectReaderTests-337260447 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:44:49 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-73aab985-4d3c-485b-b02c-e1f51102cea6 tempest-ProjectReaderTests-337260447 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:44:49 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-73aab985-4d3c-485b-b02c-e1f51102cea6 tempest-ProjectReaderTests-337260447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2c14821d-71fe-42a3-b993-9c973e81b9d1 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:49 devstack sudo[107454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2c14821d-71fe-42a3-b993-9c973e81b9d1 1073741824 Jul 07 17:44:49 devstack sudo[107454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:50 devstack sudo[107454]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-73aab985-4d3c-485b-b02c-e1f51102cea6 tempest-ProjectReaderTests-337260447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2c14821d-71fe-42a3-b993-9c973e81b9d1 1073741824" returned: 0 in 0.943s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:50 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-73aab985-4d3c-485b-b02c-e1f51102cea6 tempest-ProjectReaderTests-337260447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2c14821d-71fe-42a3-b993-9c973e81b9d1 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:50 devstack sudo[107459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2c14821d-71fe-42a3-b993-9c973e81b9d1 Jul 07 17:44:50 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:51 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-73aab985-4d3c-485b-b02c-e1f51102cea6 tempest-ProjectReaderTests-337260447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2c14821d-71fe-42a3-b993-9c973e81b9d1" returned: 0 in 0.762s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:51 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-73aab985-4d3c-485b-b02c-e1f51102cea6 tempest-ProjectReaderTests-337260447 None] <== create_volume: return (1757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:44:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-73aab985-4d3c-485b-b02c-e1f51102cea6 tempest-ProjectReaderTests-337260447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.761s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-73aab985-4d3c-485b-b02c-e1f51102cea6 tempest-ProjectReaderTests-337260447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb3803ef-7762-4d56-b54e-1f9d0f543427) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c14821d-71fe-42a3-b993-9c973e81b9d1', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-73aab985-4d3c-485b-b02c-e1f51102cea6 tempest-ProjectReaderTests-337260447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (816d956d-852d-4cc1-af7f-2e267cc8bef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:51 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-73aab985-4d3c-485b-b02c-e1f51102cea6 tempest-ProjectReaderTests-337260447 None] Volume volume-2c14821d-71fe-42a3-b993-9c973e81b9d1 (2c14821d-71fe-42a3-b993-9c973e81b9d1): created successfully Jul 07 17:44:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-73aab985-4d3c-485b-b02c-e1f51102cea6 tempest-ProjectReaderTests-337260447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (816d956d-852d-4cc1-af7f-2e267cc8bef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:51 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-73aab985-4d3c-485b-b02c-e1f51102cea6 tempest-ProjectReaderTests-337260447 None] Flow 'volume_create_manager' (7e67386c-6a9a-4783-88bd-4aefa2e6f55f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:44:51 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-73aab985-4d3c-485b-b02c-e1f51102cea6 tempest-ProjectReaderTests-337260447 None] Created volume successfully. Jul 07 17:44:51 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-7595cd19-43b9-4d6b-88f2-8e058d1a6833 tempest-ProjectReaderTests-337260447 None] Acquiring lock "cinder-2c14821d-71fe-42a3-b993-9c973e81b9d1-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:51 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-7595cd19-43b9-4d6b-88f2-8e058d1a6833 tempest-ProjectReaderTests-337260447 None] Lock "cinder-2c14821d-71fe-42a3-b993-9c973e81b9d1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:51 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-7595cd19-43b9-4d6b-88f2-8e058d1a6833 tempest-ProjectReaderTests-337260447 None] Acquiring lock "cinder-quobyte-2c14821d-71fe-42a3-b993-9c973e81b9d1" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:51 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-7595cd19-43b9-4d6b-88f2-8e058d1a6833 tempest-ProjectReaderTests-337260447 None] Lock "cinder-quobyte-2c14821d-71fe-42a3-b993-9c973e81b9d1" acquired by "delete_volume" :: waited 0.017s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:51 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fa0d36-6f4e-4466-bed6-839527d124fd]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:51 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7595cd19-43b9-4d6b-88f2-8e058d1a6833 tempest-ProjectReaderTests-337260447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2c14821d-71fe-42a3-b993-9c973e81b9d1 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:52 devstack sudo[107463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2c14821d-71fe-42a3-b993-9c973e81b9d1 Jul 07 17:44:52 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:52 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7595cd19-43b9-4d6b-88f2-8e058d1a6833 tempest-ProjectReaderTests-337260447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2c14821d-71fe-42a3-b993-9c973e81b9d1" returned: 0 in 0.796s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:52 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7595cd19-43b9-4d6b-88f2-8e058d1a6833 tempest-ProjectReaderTests-337260447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2c14821d-71fe-42a3-b993-9c973e81b9d1 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:52 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2c14821d-71fe-42a3-b993-9c973e81b9d1 Jul 07 17:44:52 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:53 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7595cd19-43b9-4d6b-88f2-8e058d1a6833 tempest-ProjectReaderTests-337260447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-2c14821d-71fe-42a3-b993-9c973e81b9d1" returned: 0 in 0.671s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:53 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-7595cd19-43b9-4d6b-88f2-8e058d1a6833 tempest-ProjectReaderTests-337260447 None] Lock "cinder-quobyte-2c14821d-71fe-42a3-b993-9c973e81b9d1" released by "delete_volume" :: held 1.512s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:53 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-7595cd19-43b9-4d6b-88f2-8e058d1a6833 tempest-ProjectReaderTests-337260447 None] Created reservations ['d9d5eb0a-7d79-4b3b-a234-0041ee70371d', '22c03333-e97b-41d5-ba95-6f358e1bf0d4', 'fbaac7e2-71bc-44b8-b8c4-0270019b602c', '2b693c7c-f4f5-4ffc-abea-53b13032bb3c'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:44:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-7595cd19-43b9-4d6b-88f2-8e058d1a6833 tempest-ProjectReaderTests-337260447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-7595cd19-43b9-4d6b-88f2-8e058d1a6833 tempest-ProjectReaderTests-337260447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:53 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-7595cd19-43b9-4d6b-88f2-8e058d1a6833 tempest-ProjectReaderTests-337260447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:53 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-7595cd19-43b9-4d6b-88f2-8e058d1a6833 tempest-ProjectReaderTests-337260447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-7595cd19-43b9-4d6b-88f2-8e058d1a6833 tempest-ProjectReaderTests-337260447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:53 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7595cd19-43b9-4d6b-88f2-8e058d1a6833 tempest-ProjectReaderTests-337260447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:53 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:44:53 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:54 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-7595cd19-43b9-4d6b-88f2-8e058d1a6833 tempest-ProjectReaderTests-337260447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.663s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:54 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-7595cd19-43b9-4d6b-88f2-8e058d1a6833 tempest-ProjectReaderTests-337260447 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:44:54 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-7595cd19-43b9-4d6b-88f2-8e058d1a6833 tempest-ProjectReaderTests-337260447 None] Deleted volume successfully. Jul 07 17:44:54 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-7595cd19-43b9-4d6b-88f2-8e058d1a6833 tempest-ProjectReaderTests-337260447 None] Lock "cinder-2c14821d-71fe-42a3-b993-9c973e81b9d1-delete_volume" released by "delete_volume" :: held 2.476s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:54 devstack cinder-volume[87233]: DEBUG cinder.volume.flows.manager.create_volume [None req-9092811a-b82f-4b34-bfb3-d110c7bd9b4f tempest-ProjectReaderTests-337260447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87233) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:44:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-9092811a-b82f-4b34-bfb3-d110c7bd9b4f tempest-ProjectReaderTests-337260447 None] Flow 'volume_create_manager' (db9f40c6-c88c-45b5-b46c-cedd95595fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:44:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-9092811a-b82f-4b34-bfb3-d110c7bd9b4f tempest-ProjectReaderTests-337260447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64854ec5-0fd1-457f-8a40-57de8ccd0d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-9092811a-b82f-4b34-bfb3-d110c7bd9b4f tempest-ProjectReaderTests-337260447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64854ec5-0fd1-457f-8a40-57de8ccd0d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1203950434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c076dd6-8a6e-4c1a-b743-9ad8fc5efb3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2f8ca9d538444ffa9413d4fab7485db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:44:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:44:55Z,use_quota=True,user_id='7d81f7162cbc46dbbf4406b0f10e942f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-9092811a-b82f-4b34-bfb3-d110c7bd9b4f tempest-ProjectReaderTests-337260447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83fdeb48-28bf-4923-b3c3-21f4b896ba8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-9092811a-b82f-4b34-bfb3-d110c7bd9b4f tempest-ProjectReaderTests-337260447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83fdeb48-28bf-4923-b3c3-21f4b896ba8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-9092811a-b82f-4b34-bfb3-d110c7bd9b4f tempest-ProjectReaderTests-337260447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d88c957b-5e53-4169-a34f-bf1c0646360f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-9092811a-b82f-4b34-bfb3-d110c7bd9b4f tempest-ProjectReaderTests-337260447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d88c957b-5e53-4169-a34f-bf1c0646360f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c076dd6-8a6e-4c1a-b743-9ad8fc5efb3c', 'volume_name': 'volume-5c076dd6-8a6e-4c1a-b743-9ad8fc5efb3c', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-9092811a-b82f-4b34-bfb3-d110c7bd9b4f tempest-ProjectReaderTests-337260447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70690233-0f7d-42b5-b12e-3f64f45f2feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-9092811a-b82f-4b34-bfb3-d110c7bd9b4f tempest-ProjectReaderTests-337260447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70690233-0f7d-42b5-b12e-3f64f45f2feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:54 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-9092811a-b82f-4b34-bfb3-d110c7bd9b4f tempest-ProjectReaderTests-337260447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23032a86-995c-4f25-9f93-e98d05167604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:54 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-9092811a-b82f-4b34-bfb3-d110c7bd9b4f tempest-ProjectReaderTests-337260447 None] Volume 5c076dd6-8a6e-4c1a-b743-9ad8fc5efb3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c076dd6-8a6e-4c1a-b743-9ad8fc5efb3c', 'volume_size': 1} Jul 07 17:44:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9092811a-b82f-4b34-bfb3-d110c7bd9b4f tempest-ProjectReaderTests-337260447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9092811a-b82f-4b34-bfb3-d110c7bd9b4f tempest-ProjectReaderTests-337260447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:54 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-9092811a-b82f-4b34-bfb3-d110c7bd9b4f tempest-ProjectReaderTests-337260447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1203950434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c076dd6-8a6e-4c1a-b743-9ad8fc5efb3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2f8ca9d538444ffa9413d4fab7485db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:44:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:44:55Z,use_quota=True,user_id='7d81f7162cbc46dbbf4406b0f10e942f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e30892b-2480-490b-8188-2e0fe652f867),volume_type_id=4e30892b-2480-490b-8188-2e0fe652f867)}" {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:44:54 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.remotefs [None req-9092811a-b82f-4b34-bfb3-d110c7bd9b4f tempest-ProjectReaderTests-337260447 None] Creating volume 5c076dd6-8a6e-4c1a-b743-9ad8fc5efb3c {{(pid=87233) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:44:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9092811a-b82f-4b34-bfb3-d110c7bd9b4f tempest-ProjectReaderTests-337260447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9092811a-b82f-4b34-bfb3-d110c7bd9b4f tempest-ProjectReaderTests-337260447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:54 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-9092811a-b82f-4b34-bfb3-d110c7bd9b4f tempest-ProjectReaderTests-337260447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:54 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-9092811a-b82f-4b34-bfb3-d110c7bd9b4f tempest-ProjectReaderTests-337260447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9092811a-b82f-4b34-bfb3-d110c7bd9b4f tempest-ProjectReaderTests-337260447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:54 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-9092811a-b82f-4b34-bfb3-d110c7bd9b4f tempest-ProjectReaderTests-337260447 None] Selected osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 as target Quobyte volume. {{(pid=87233) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:44:54 devstack cinder-volume[87233]: INFO cinder.volume.drivers.remotefs [None req-9092811a-b82f-4b34-bfb3-d110c7bd9b4f tempest-ProjectReaderTests-337260447 None] casted to osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7 Jul 07 17:44:54 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9092811a-b82f-4b34-bfb3-d110c7bd9b4f tempest-ProjectReaderTests-337260447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c076dd6-8a6e-4c1a-b743-9ad8fc5efb3c 1073741824 {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:54 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c076dd6-8a6e-4c1a-b743-9ad8fc5efb3c 1073741824 Jul 07 17:44:54 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:55 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9092811a-b82f-4b34-bfb3-d110c7bd9b4f tempest-ProjectReaderTests-337260447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c076dd6-8a6e-4c1a-b743-9ad8fc5efb3c 1073741824" returned: 0 in 0.908s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:55 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9092811a-b82f-4b34-bfb3-d110c7bd9b4f tempest-ProjectReaderTests-337260447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c076dd6-8a6e-4c1a-b743-9ad8fc5efb3c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:55 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c076dd6-8a6e-4c1a-b743-9ad8fc5efb3c Jul 07 17:44:55 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:56 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-9092811a-b82f-4b34-bfb3-d110c7bd9b4f tempest-ProjectReaderTests-337260447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c076dd6-8a6e-4c1a-b743-9ad8fc5efb3c" returned: 0 in 0.786s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:56 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-9092811a-b82f-4b34-bfb3-d110c7bd9b4f tempest-ProjectReaderTests-337260447 None] <== create_volume: return (1744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'} {{(pid=87233) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:44:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-9092811a-b82f-4b34-bfb3-d110c7bd9b4f tempest-ProjectReaderTests-337260447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.747s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:56 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-9092811a-b82f-4b34-bfb3-d110c7bd9b4f tempest-ProjectReaderTests-337260447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23032a86-995c-4f25-9f93-e98d05167604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c076dd6-8a6e-4c1a-b743-9ad8fc5efb3c', 'volume_size': 1}' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:56 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-9092811a-b82f-4b34-bfb3-d110c7bd9b4f tempest-ProjectReaderTests-337260447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1578972-1bf3-4471-a787-400cd46f80f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:56 devstack cinder-volume[87233]: INFO cinder.volume.flows.manager.create_volume [None req-9092811a-b82f-4b34-bfb3-d110c7bd9b4f tempest-ProjectReaderTests-337260447 None] Volume volume-5c076dd6-8a6e-4c1a-b743-9ad8fc5efb3c (5c076dd6-8a6e-4c1a-b743-9ad8fc5efb3c): created successfully Jul 07 17:44:56 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-9092811a-b82f-4b34-bfb3-d110c7bd9b4f tempest-ProjectReaderTests-337260447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1578972-1bf3-4471-a787-400cd46f80f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87233) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:56 devstack cinder-volume[87233]: DEBUG cinder.volume.manager [None req-9092811a-b82f-4b34-bfb3-d110c7bd9b4f tempest-ProjectReaderTests-337260447 None] Flow 'volume_create_manager' (db9f40c6-c88c-45b5-b46c-cedd95595fd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87233) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:44:56 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-9092811a-b82f-4b34-bfb3-d110c7bd9b4f tempest-ProjectReaderTests-337260447 None] Created volume successfully. Jul 07 17:44:56 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-f83fab8f-b3ee-459f-a34c-1ddfddf11f05 tempest-ProjectReaderTests-337260447 None] Acquiring lock "cinder-5c076dd6-8a6e-4c1a-b743-9ad8fc5efb3c-delete_volume" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:56 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-f83fab8f-b3ee-459f-a34c-1ddfddf11f05 tempest-ProjectReaderTests-337260447 None] Lock "cinder-5c076dd6-8a6e-4c1a-b743-9ad8fc5efb3c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:56 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-f83fab8f-b3ee-459f-a34c-1ddfddf11f05 tempest-ProjectReaderTests-337260447 None] Acquiring lock "cinder-quobyte-5c076dd6-8a6e-4c1a-b743-9ad8fc5efb3c" by "delete_volume" {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:56 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-f83fab8f-b3ee-459f-a34c-1ddfddf11f05 tempest-ProjectReaderTests-337260447 None] Lock "cinder-quobyte-5c076dd6-8a6e-4c1a-b743-9ad8fc5efb3c" acquired by "delete_volume" :: waited 0.022s {{(pid=87233) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:56 devstack cinder-volume[87233]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb88c34-0e0f-4213-9458-a4dc16962a76]: (4, 'qcow2') {{(pid=88360) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:56 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f83fab8f-b3ee-459f-a34c-1ddfddf11f05 tempest-ProjectReaderTests-337260447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c076dd6-8a6e-4c1a-b743-9ad8fc5efb3c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:57 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c076dd6-8a6e-4c1a-b743-9ad8fc5efb3c Jul 07 17:44:57 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:57 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f83fab8f-b3ee-459f-a34c-1ddfddf11f05 tempest-ProjectReaderTests-337260447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c076dd6-8a6e-4c1a-b743-9ad8fc5efb3c" returned: 0 in 0.841s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:57 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f83fab8f-b3ee-459f-a34c-1ddfddf11f05 tempest-ProjectReaderTests-337260447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c076dd6-8a6e-4c1a-b743-9ad8fc5efb3c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:57 devstack sudo[107490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c076dd6-8a6e-4c1a-b743-9ad8fc5efb3c Jul 07 17:44:57 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:58 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f83fab8f-b3ee-459f-a34c-1ddfddf11f05 tempest-ProjectReaderTests-337260447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c/volume-5c076dd6-8a6e-4c1a-b743-9ad8fc5efb3c" returned: 0 in 0.652s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:58 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-f83fab8f-b3ee-459f-a34c-1ddfddf11f05 tempest-ProjectReaderTests-337260447 None] Lock "cinder-quobyte-5c076dd6-8a6e-4c1a-b743-9ad8fc5efb3c" released by "delete_volume" :: held 1.537s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:58 devstack cinder-volume[87233]: DEBUG cinder.quota [None req-f83fab8f-b3ee-459f-a34c-1ddfddf11f05 tempest-ProjectReaderTests-337260447 None] Created reservations ['0654649a-02ba-47f8-9a61-7c842b609ea7', 'a59b64ca-21cc-4b5e-aafe-970e192f24e7', '6ebaeac7-2777-42b5-8f57-a4b835eaf3ce', '6fc2af6b-2a50-407e-931f-2c82bc472fe6'] {{(pid=87233) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:44:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f83fab8f-b3ee-459f-a34c-1ddfddf11f05 tempest-ProjectReaderTests-337260447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f83fab8f-b3ee-459f-a34c-1ddfddf11f05 tempest-ProjectReaderTests-337260447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:58 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-f83fab8f-b3ee-459f-a34c-1ddfddf11f05 tempest-ProjectReaderTests-337260447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7': None} {{(pid=87233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:58 devstack cinder-volume[87233]: DEBUG cinder.volume.drivers.quobyte [None req-f83fab8f-b3ee-459f-a34c-1ddfddf11f05 tempest-ProjectReaderTests-337260447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0efeab34-1645-42e9-be6d-2107c0bff7b7'] {{(pid=87233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.lockutils [None req-f83fab8f-b3ee-459f-a34c-1ddfddf11f05 tempest-ProjectReaderTests-337260447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:58 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f83fab8f-b3ee-459f-a34c-1ddfddf11f05 tempest-ProjectReaderTests-337260447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:58 devstack sudo[107493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c Jul 07 17:44:58 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:59 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:59 devstack cinder-volume[87233]: DEBUG oslo_concurrency.processutils [None req-f83fab8f-b3ee-459f-a34c-1ddfddf11f05 tempest-ProjectReaderTests-337260447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a993134a03012115d852dedfc89e8c" returned: 0 in 0.694s {{(pid=87233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:59 devstack cinder-volume[87233]: DEBUG cinder.manager [None req-f83fab8f-b3ee-459f-a34c-1ddfddf11f05 tempest-ProjectReaderTests-337260447 None] Notifying Schedulers of capabilities ... {{(pid=87233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:44:59 devstack cinder-volume[87233]: INFO cinder.volume.manager [None req-f83fab8f-b3ee-459f-a34c-1ddfddf11f05 tempest-ProjectReaderTests-337260447 None] Deleted volume successfully. Jul 07 17:44:59 devstack cinder-volume[87233]: DEBUG cinder.coordination [None req-f83fab8f-b3ee-459f-a34c-1ddfddf11f05 tempest-ProjectReaderTests-337260447 None] Lock "cinder-5c076dd6-8a6e-4c1a-b743-9ad8fc5efb3c-delete_volume" released by "delete_volume" :: held 2.497s {{(pid=87233) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:08 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:UPDATE=35,cinder:DELETE=3,cinder:SELECT=24,cinder:INSERT=8 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:45:09 devstack cinder-volume[87233]: DEBUG dbcounter [-] [87233] Writing DB stats cinder:UPDATE=43,cinder:SELECT=21,cinder:DELETE=4,cinder:INSERT=7 {{(pid=87233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}